Jul 03 00:57:38 devstack cinder-volume[75625]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jul 03 00:57:38 devstack cinder-volume[75625]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 03 00:57:38 devstack cinder-volume[75625]: we strongly recommend against using it for new projects.
Jul 03 00:57:38 devstack cinder-volume[75625]: If you are already using Eventlet, we recommend migrating to a different
Jul 03 00:57:38 devstack cinder-volume[75625]: framework.  For more detail see
Jul 03 00:57:38 devstack cinder-volume[75625]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 03 00:57:38 devstack cinder-volume[75625]:   import eventlet  # noqa
Jul 03 00:57:41 devstack cinder-volume[75625]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75625) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 03 00:57:41 devstack cinder-volume[75625]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75625) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 03 00:57:41 devstack cinder-volume[75625]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75625) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 03 00:57:41 devstack cinder-volume[75625]: INFO dbcounter [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] Registered counter for database cinder
Jul 03 00:57:42 devstack cinder-volume[75625]: DEBUG oslo_db.sqlalchemy.engines [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75625) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 03 00:57:42 devstack cinder-volume[75625]: DEBUG dbcounter [-] [75625] Writer thread running {{(pid=75625) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 03 00:57:42 devstack cinder-volume[75625]: INFO cinder.rpc [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jul 03 00:57:42 devstack cinder-volume[75625]: INFO cinder.rpc [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jul 03 00:57:42 devstack cinder-volume[75625]: DEBUG oslo_db.sqlalchemy.engines [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75625) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 03 00:57:42 devstack cinder-volume[75625]: INFO cinder.volume.manager [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] Determined volume DB was empty at startup.
Jul 03 00:57:42 devstack cinder-volume[75625]: DEBUG cinder.volume.manager [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75625) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jul 03 00:57:42 devstack cinder-volume[75625]: INFO cinder.volume.manager [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] Service not found for updating active_backend_id, assuming default for driver init.
Jul 03 00:57:42 devstack cinder-volume[75625]: WARNING stevedore.named [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 03 00:57:42 devstack cinder-volume[75625]: WARNING castellan.key_manager [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 03 00:57:42 devstack cinder-volume[75625]: WARNING cinder.keymgr.conf_key_mgr [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 03 00:57:42 devstack cinder-volume[75625]: DEBUG cinder.volume.drivers.lvm [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75625) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Jul 03 00:57:42 devstack cinder-volume[75625]: DEBUG oslo_concurrency.processutils [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75625) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_concurrency.processutils [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] CMD "cinder-rtstool verify" returned: 0 in 0.662s {{(pid=75625) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_db.sqlalchemy.engines [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75625) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 03 00:57:43 devstack cinder-volume[75625]: INFO cinder.rpc [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Jul 03 00:57:43 devstack cinder-volume[75625]: INFO cinder.rpc [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Jul 03 00:57:43 devstack cinder-volume[75625]: WARNING stevedore.named [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 03 00:57:43 devstack cinder-volume[75625]: WARNING castellan.key_manager [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 03 00:57:43 devstack cinder-volume[75625]: INFO cinder.volume.manager [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_db.sqlalchemy.engines [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75625) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 03 00:57:43 devstack cinder-volume[75625]: INFO oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] Starting 1 workers
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] Started child 75794 {{(pid=75625) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] Full set of CONF: {{(pid=75625) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] ******************************************************************************** {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] Configuration options gathered from: {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] ================================================================================ {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] allow_availability_zone_fallback = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] allow_compression_on_image_upload = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] allowed_direct_url_schemes     = [] {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] api_rate_limit                 = True {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] auth_strategy                  = keystone {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] az_cache_duration              = 3600 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backend_availability_zone      = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backend_host                   = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75794]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backend_name                   = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backend_stats_polling_interval = 60 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backup_api_class               = cinder.backup.api.API {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backup_name_template           = backup-%s {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backup_use_same_host           = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backup_use_temp_snapshot       = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] chap_password                  = **** {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] chap_username                  =  {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] cinder_internal_tenant_project_id = ca895bd40bcb4a719e595432ed69a23c {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] cinder_internal_tenant_user_id = 144d173bcacc4401bb970270b629174f {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] cloned_volume_same_az          = True {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] cluster                        = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] compression_format             = gzip {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] compute_api_class              = cinder.compute.nova.API {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] config_dir                     = [] {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] config_source                  = [] {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] control_exchange               = openstack {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] debug                          = True {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] default_availability_zone      = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] default_group_type             = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] default_volume_type            = lvmdriver-1 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] disk_geometry                  = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] driver_client_cert             = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] driver_client_cert_key         = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] driver_data_namespace          = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] driver_ssl_cert_path           = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] driver_ssl_cert_verify         = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] driver_use_ssl                 = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] enable_force_upload            = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] enable_new_services            = True {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] enable_unsupported_driver      = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] enabled_backends               = ['lvmdriver-1'] {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] enforce_multipath_for_image_xfer = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] filter_function                = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] glance_api_insecure            = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] glance_api_servers             = ['http://192.168.122.176/image'] {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] glance_api_ssl_compression     = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] glance_ca_certificates_file    = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] glance_catalog_info            = image:glance:publicURL {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] glance_certfile                = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] glance_keyfile                 = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] glance_num_retries             = 3 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] glance_request_timeout         = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] goodness_function              = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] graceful_shutdown_timeout      = 5 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] group_api_class                = cinder.group.api.API {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] host                           = devstack {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] image_compress_on_upload       = True {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] image_conversion_address_space_limit = 1 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] image_conversion_cpu_limit     = 60 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] image_conversion_disable       = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] image_upload_use_cinder_backend = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] image_upload_use_internal_tenant = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] image_volume_cache_enabled     = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] image_volume_cache_max_count   = 0 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] image_volume_cache_max_size_gb = 0 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] init_host_max_objects_retrieval = 0 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] instance_format                = [instance: %(uuid)s]  {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] iscsi_target_flags             =  {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] iscsi_write_cache              = on {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] iser_helper                    = tgtadm {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] iser_ip_address                = 192.168.122.176 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] iser_port                      = 3260 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] log_color                      = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] log_config_append              = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] log_dir                        = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] log_file                       = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] log_options                    = True {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] log_rotate_interval            = 1 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] log_rotate_interval_type       = days {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] log_rotation_type              = none {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] max_age                        = 0 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] max_logfile_count              = 30 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] max_logfile_size_mb            = 200 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] max_over_subscription_ratio    = 20.0 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] message_reap_interval          = 86400 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] message_ttl                    = 2592000 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] migration_create_volume_timeout_secs = 300 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] monkey_patch                   = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] monkey_patch_modules           = [] {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] my_ip                          = 192.168.122.176 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] no_snapshot_gb_quota           = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] num_iser_scan_tries            = 3 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] num_shell_tries                = 3 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] num_volume_device_scan_tries   = 3 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] nvmeof_conn_info_version       = 1 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] nvmet_ns_id                    = 10 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] nvmet_port_id                  = 1 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] osapi_max_limit                = 1000 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] osapi_volume_ext_list          = [] {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75794]: INFO cinder.volume.manager [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] Starting volume driver LVMVolumeDriver (3.0.0)
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] osapi_volume_listen            = 0.0.0.0 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] osapi_volume_listen_port       = 8776 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] osapi_volume_use_ssl           = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] osapi_volume_workers           = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] per_volume_size_limit          = -1 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] periodic_fuzzy_delay           = 60 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] periodic_interval              = 60 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] project_id_regex               = [0-9a-f\-]+ {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] public_endpoint                = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] publish_errors                 = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] quota_backup_gigabytes         = 1000 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] quota_backups                  = 10 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] quota_gigabytes                = 1000 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] quota_groups                   = 10 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] quota_snapshots                = 10 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] quota_volumes                  = 10 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] rate_limit_burst               = 0 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] rate_limit_except_level        = CRITICAL {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] rate_limit_interval            = 0 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] reinit_driver_count            = 3 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] replication_device             = **** {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] report_discard_supported       = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] report_interval                = 120 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] reservation_clean_interval     = 86400 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] reservation_expire             = 86400 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] reserved_image_namespaces      = [] {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] reserved_percentage            = 0 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] rpc_response_timeout           = 120 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] run_external_periodic_tasks    = True {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] scst_target_driver             = iscsi {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] scst_target_iqn_name           = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] service_down_time              = 720 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] shell_completion               = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] snapshot_name_template         = snapshot-%s {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] snapshot_same_host             = True {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] split_loggers                  = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] state_path                     = /opt/stack/data/cinder {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] storage_availability_zone      = nova {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] storage_protocol               = iSCSI {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] syslog_log_facility            = LOG_USER {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] target_helper                  = lioadm {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] target_ip_address              = 192.168.122.176 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] target_port                    = 3260 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] target_protocol                = iscsi {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] target_secondary_ip_addresses  = [] {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] trace_flags                    = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] transfer_api_class             = cinder.transfer.api.API {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] transport_url                  = **** {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] until_refresh                  = 0 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] use_chap_auth                  = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] use_default_quota_class        = True {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] use_journal                    = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] use_json                       = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] use_multipath_for_image_xfer   = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] use_stderr                     = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] use_syslog                     = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] verify_glance_signatures       = enabled {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] volume_api_class               = cinder.volume.api.API {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] volume_backend_name            = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] volume_clear                   = zero {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] volume_clear_ionice            = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] volume_clear_size              = 0 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] volume_copy_bps_limit          = 0 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] volume_dd_blocksize            = 1M {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] volume_name_template           = volume-%s {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] volume_service_inithost_offload = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] volume_usage_audit_period      = month {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] zoning_mode                    = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] oslo_concurrency.disable_process_locking = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] keystone_authtoken.auth_section = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] keystone_authtoken.auth_type   = password {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] keystone_authtoken.auth_version = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] keystone_authtoken.cache       = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] keystone_authtoken.certfile    = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] keystone_authtoken.delay_auth_decision = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.045s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] keystone_authtoken.http_connect_timeout = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] keystone_authtoken.include_service_catalog = True {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] keystone_authtoken.insecure    = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] keystone_authtoken.interface   = public {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] keystone_authtoken.keyfile     = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] keystone_authtoken.memcache_password =  {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] keystone_authtoken.memcache_username =  {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] keystone_authtoken.region_name = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] keystone_authtoken.service_token_roles_required = True {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] keystone_authtoken.service_type = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] keystone_authtoken.token_cache_time = 300 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.176/identity {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] cache.backend                  = dogpile.cache.null {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] cache.backend_argument         = **** {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] cache.backend_expiration_time  = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] cache.config_prefix            = cache.oslo {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] cache.debug_cache_backend      = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] cache.enable_retry_client      = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] cache.enable_socket_keepalive  = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] cache.enabled                  = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] cache.expiration_time          = 600 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] cache.hashclient_retry_attempts = 2 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] cache.memcache_dead_retry      = 300 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] cache.memcache_pool_maxsize    = 10 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] cache.memcache_sasl_enabled    = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] cache.password                 = **** {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] cache.proxies                  = [] {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] cache.redis_db                 = 0 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] cache.redis_sentinel_service_name = mymaster {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] cache.redis_server             = localhost:6379 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] cache.retry_attempts           = 2 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] cache.retry_delay              = 0.0 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] cache.socket_keepalive_count   = 1 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] cache.socket_keepalive_idle    = 1 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] cache.socket_keepalive_interval = 1 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] cache.socket_timeout           = 1.0 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] cache.tls_allowed_ciphers      = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] cache.tls_cafile               = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] cache.tls_certfile             = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] cache.tls_enabled              = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] cache.tls_keyfile              = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] cache.username                 = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] coordination.backend_url       = **** {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] database.asyncio_connection    = **** {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] database.asyncio_slave_connection = **** {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] database.backend               = sqlalchemy {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] database.connection            = **** {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] database.connection_debug      = 0 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] database.connection_parameters =  {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] database.connection_recycle_time = 3600 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] database.connection_trace      = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] database.db_inc_retry_interval = True {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] database.db_max_retries        = 20 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] database.db_max_retry_interval = 10 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] database.db_retry_interval     = 1 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] database.max_overflow          = 50 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] database.max_pool_size         = 5 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] database.max_retries           = 10 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] database.mysql_wsrep_sync_wait = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] database.pool_timeout          = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] database.retry_interval        = 10 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] database.slave_connection      = **** {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] database.sqlite_synchronous    = True {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] database.synchronous_reader    = True {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] database.use_db_reconnect      = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] profiler.connection_string     = messaging:// {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] profiler.enabled               = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] profiler.es_doc_type           = notification {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] profiler.es_scroll_size        = 10000 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] profiler.es_scroll_time        = 2m {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] profiler.filter_error_trace    = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] profiler.hmac_keys             = **** {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] profiler.sentinel_service_name = mymaster {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] profiler.socket_timeout        = 0.1 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] profiler.trace_requests        = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] profiler.trace_sqlalchemy      = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] profiler_jaeger.process_tags   = {} {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] profiler_jaeger.service_name_prefix = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] profiler_otlp.service_name_prefix = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] oslo_policy.enforce_new_defaults = True {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] oslo_policy.enforce_scope      = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] oslo_policy.policy_default_rule = default {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] oslo_policy.policy_file        = policy.yaml {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] oslo_policy.remote_timeout     = 60.0 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] privsep_osbrick.group          = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] privsep_osbrick.helper_command = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] privsep_osbrick.user           = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] cinder_sys_admin.group         = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] cinder_sys_admin.helper_command = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] cinder_sys_admin.user          = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] service_user.auth_section      = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] service_user.auth_type         = password {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] service_user.cafile            = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] service_user.certfile          = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] service_user.collect_timing    = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] service_user.insecure          = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] service_user.keyfile           = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] service_user.send_service_user_token = True {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] service_user.split_loggers     = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] service_user.timeout           = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] glance.auth_section            = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] glance.auth_type               = password {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] glance.certfile                = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] glance.collect_timing          = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] glance.insecure                = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] glance.keyfile                 = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] glance.region_name             = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] glance.split_loggers           = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] glance.timeout                 = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backend_defaults.backend_availability_zone = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backend_defaults.chap_password = **** {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backend_defaults.chap_username =  {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backend_defaults.disk_geometry = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backend_defaults.driver_client_cert = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backend_defaults.driver_client_cert_key = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backend_defaults.driver_data_namespace = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backend_defaults.driver_use_ssl = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backend_defaults.enable_unsupported_driver = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backend_defaults.extra_capabilities = {} {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backend_defaults.filter_function = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backend_defaults.goodness_function = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backend_defaults.iscsi_target_flags =  {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backend_defaults.iscsi_write_cache = on {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backend_defaults.iser_helper   = tgtadm {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backend_defaults.iser_ip_address = 192.168.122.176 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backend_defaults.iser_port     = 3260 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backend_defaults.lvm_mirrors   = 0 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backend_defaults.lvm_share_target = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backend_defaults.lvm_type      = auto {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backend_defaults.num_shell_tries = 3 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backend_defaults.nvmet_port_id = 1 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backend_defaults.replication_device = **** {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack sudo[75798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backend_defaults.report_discard_supported = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backend_defaults.reserved_percentage = 0 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backend_defaults.scst_target_driver = iscsi {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backend_defaults.scst_target_iqn_name = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backend_defaults.storage_protocol = iSCSI {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack sudo[75798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backend_defaults.target_helper = tgtadm {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backend_defaults.target_ip_address = 192.168.122.176 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backend_defaults.target_port   = 3260 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backend_defaults.target_protocol = iscsi {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backend_defaults.trace_flags   = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backend_defaults.unique_fqdn_network = True {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backend_defaults.use_chap_auth = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backend_defaults.volume_backend_name = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backend_defaults.volume_clear  = zero {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backend_defaults.volume_clear_ionice = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backend_defaults.volume_clear_size = 0 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backend_defaults.volume_group  = cinder-volumes {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] oslo_reports.file_event_handler = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] oslo_reports.log_dir           = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] lvmdriver-1.backend_availability_zone = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] lvmdriver-1.backend_host       = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] lvmdriver-1.chap_password      = **** {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] lvmdriver-1.chap_username      = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] lvmdriver-1.chiscsi_conf       = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] lvmdriver-1.disk_geometry      = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] lvmdriver-1.driver_client_cert = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] lvmdriver-1.driver_data_namespace = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] lvmdriver-1.driver_use_ssl     = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] lvmdriver-1.extra_capabilities = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] lvmdriver-1.filter_function    = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] lvmdriver-1.goodness_function  = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] lvmdriver-1.iser_helper        = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] lvmdriver-1.iser_ip_address    = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] lvmdriver-1.iser_port          = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] lvmdriver-1.iser_target_prefix = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] lvmdriver-1.lvm_conf_file      = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] lvmdriver-1.lvm_mirrors        = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] lvmdriver-1.lvm_share_target   = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] lvmdriver-1.lvm_type           = auto {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] lvmdriver-1.num_shell_tries    = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] lvmdriver-1.nvmet_port_id      = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] lvmdriver-1.replication_device = **** {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] lvmdriver-1.report_discard_supported = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] lvmdriver-1.reserved_percentage = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] lvmdriver-1.scst_target_driver = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] lvmdriver-1.storage_protocol   = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] lvmdriver-1.target_helper      = lioadm {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] lvmdriver-1.target_ip_address  = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] lvmdriver-1.target_port        = 3260 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] lvmdriver-1.target_protocol    = iscsi {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] lvmdriver-1.trace_flags        = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] lvmdriver-1.use_chap_auth      = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] lvmdriver-1.volume_clear       = zero {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] lvmdriver-1.volume_clear_size  = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] lvmdriver-1.volumes_dir        = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] oslo_messaging_rabbit.ssl      = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] oslo_messaging_notifications.driver = [] {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] oslo_messaging_notifications.retry = -1 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] oslo_messaging_notifications.transport_url = **** {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] key_manager.fixed_key          = **** {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] barbican.barbican_api_version  = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] barbican.barbican_endpoint     = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] barbican.barbican_endpoint_type = public {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] barbican.barbican_region_name  = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] barbican.cafile                = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] barbican.certfile              = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] barbican.collect_timing        = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] barbican.insecure              = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] barbican.keyfile               = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] barbican.number_of_retries     = 60 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] barbican.retry_delay           = 1 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] barbican.send_service_user_token = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] barbican.split_loggers         = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] barbican.timeout               = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] barbican.verify_ssl            = True {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] barbican.verify_ssl_path       = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] barbican_service_user.auth_section = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] barbican_service_user.auth_type = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] barbican_service_user.cafile   = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] barbican_service_user.certfile = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] barbican_service_user.collect_timing = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] barbican_service_user.insecure = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] barbican_service_user.keyfile  = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] barbican_service_user.split_loggers = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] barbican_service_user.timeout  = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] vault.approle_role_id          = **** {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] vault.approle_secret_id        = **** {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] vault.kv_mountpoint            = secret {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] vault.kv_path                  = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] vault.kv_version               = 2 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] vault.namespace                = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] vault.root_token_id            = **** {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] vault.ssl_ca_crt_file          = None {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] vault.timeout                  = 60.0 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] vault.use_ssl                  = False {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 00:57:43 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] ******************************************************************************** {{(pid=75625) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jul 03 00:57:44 devstack sudo[75798]: pam_unix(sudo:session): session closed for user root
Jul 03 00:57:44 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.767s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 00:57:44 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 00:57:44 devstack sudo[75964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 03 00:57:44 devstack sudo[75964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 00:57:45 devstack sudo[75964]: pam_unix(sudo:session): session closed for user root
Jul 03 00:57:45 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.714s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 00:57:45 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 00:57:45 devstack cinder-volume[75794]: INFO cinder.brick.local_dev.lvm [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Jul 03 00:57:45 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 00:57:45 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 00:57:45 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 00:57:45 devstack sudo[76188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 03 00:57:45 devstack sudo[76188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 00:57:45 devstack sudo[76188]: pam_unix(sudo:session): session closed for user root
Jul 03 00:57:45 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.683s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 00:57:45 devstack cinder-volume[75794]: DEBUG cinder.brick.local_dev.lvm [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75794) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Jul 03 00:57:45 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 00:57:45 devstack sudo[76363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 03 00:57:45 devstack sudo[76363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 00:57:46 devstack sudo[76363]: pam_unix(sudo:session): session closed for user root
Jul 03 00:57:46 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.126s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 00:57:46 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 00:57:46 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 00:57:46 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 00:57:46 devstack sudo[76535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 03 00:57:46 devstack sudo[76535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 00:57:47 devstack sudo[76535]: pam_unix(sudo:session): session closed for user root
Jul 03 00:57:47 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.761s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 00:57:47 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 00:57:47 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 00:57:47 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 00:57:47 devstack sudo[76578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Jul 03 00:57:47 devstack sudo[76578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 00:57:48 devstack sudo[76578]: pam_unix(sudo:session): session closed for user root
Jul 03 00:57:48 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.711s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 00:57:48 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 00:57:48 devstack sudo[76582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 03 00:57:48 devstack sudo[76582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 00:57:49 devstack sudo[76582]: pam_unix(sudo:session): session closed for user root
Jul 03 00:57:49 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.860s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 00:57:49 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 00:57:49 devstack sudo[76593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 03 00:57:49 devstack sudo[76593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 00:57:50 devstack sudo[76593]: pam_unix(sudo:session): session closed for user root
Jul 03 00:57:50 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.782s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 00:57:50 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 00:57:50 devstack sudo[76597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 00:57:50 devstack sudo[76597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 00:57:50 devstack sudo[76597]: pam_unix(sudo:session): session closed for user root
Jul 03 00:57:50 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.836s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 00:57:50 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 00:57:50 devstack sudo[76603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 03 00:57:50 devstack sudo[76603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 00:57:51 devstack sudo[76603]: pam_unix(sudo:session): session closed for user root
Jul 03 00:57:51 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.718s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 00:57:51 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 00:57:51 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 00:57:51 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 00:57:51 devstack sudo[76611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 03 00:57:51 devstack sudo[76611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 00:57:52 devstack sudo[76611]: pam_unix(sudo:session): session closed for user root
Jul 03 00:57:52 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.704s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 00:57:52 devstack cinder-volume[75794]: INFO cinder.volume.drivers.lvm [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] Enabling LVM thin provisioning by default because a thin pool exists.
Jul 03 00:57:52 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 00:57:52 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 00:57:52 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 00:57:52 devstack sudo[76621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 03 00:57:52 devstack sudo[76621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 00:57:53 devstack sudo[76621]: pam_unix(sudo:session): session closed for user root
Jul 03 00:57:53 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.770s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 00:57:53 devstack cinder-volume[75794]: DEBUG cinder.volume.drivers.lvm [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] Updating volume stats {{(pid=75794) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 03 00:57:53 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 00:57:53 devstack sudo[76737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 03 00:57:53 devstack sudo[76737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 00:57:53 devstack cinder-volume[75625]: DEBUG dbcounter [-] [75625] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75625) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 00:57:53 devstack sudo[76737]: pam_unix(sudo:session): session closed for user root
Jul 03 00:57:53 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.648s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 00:57:53 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 00:57:53 devstack sudo[76878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 00:57:53 devstack sudo[76878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 00:57:54 devstack sudo[76878]: pam_unix(sudo:session): session closed for user root
Jul 03 00:57:54 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.660s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 00:57:54 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 00:57:54 devstack sudo[76882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 03 00:57:54 devstack sudo[76882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 00:57:55 devstack sudo[76882]: pam_unix(sudo:session): session closed for user root
Jul 03 00:57:55 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.621s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 00:57:55 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 00:57:55 devstack sudo[76885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 00:57:55 devstack sudo[76885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 00:57:55 devstack sudo[76885]: pam_unix(sudo:session): session closed for user root
Jul 03 00:57:55 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.667s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 00:57:55 devstack cinder-volume[75794]: INFO cinder.volume.driver [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] Driver hasn't implemented _init_vendor_properties()
Jul 03 00:57:55 devstack cinder-volume[75794]: DEBUG cinder.volume.driver [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75794) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jul 03 00:57:55 devstack cinder-volume[75794]: DEBUG oslo_db.sqlalchemy.engines [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75794) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 03 00:57:55 devstack cinder-volume[75794]: DEBUG dbcounter [-] [75794] Writer thread running {{(pid=75794) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 03 00:57:55 devstack cinder-volume[75794]: DEBUG cinder.db.api [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] Building query based on filter {{(pid=75794) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jul 03 00:57:55 devstack cinder-volume[75794]: DEBUG cinder.image.image_utils [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75794) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jul 03 00:57:55 devstack cinder-volume[75794]: INFO cinder.keymgr.migration [None req-46f3b85b-3236-43db-a0dc-09f1a0f65fde None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jul 03 00:57:55 devstack cinder-volume[75794]: DEBUG cinder.volume.drivers.lvm [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] Updating volume stats {{(pid=75794) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 03 00:57:55 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 00:57:55 devstack sudo[76889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 03 00:57:55 devstack sudo[76889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 00:57:56 devstack sudo[76889]: pam_unix(sudo:session): session closed for user root
Jul 03 00:57:56 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.663s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 00:57:56 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 00:57:56 devstack sudo[76896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 00:57:56 devstack sudo[76896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 00:57:57 devstack sudo[76896]: pam_unix(sudo:session): session closed for user root
Jul 03 00:57:57 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.631s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 00:57:57 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 00:57:57 devstack sudo[76900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 03 00:57:57 devstack sudo[76900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 00:57:57 devstack sudo[76900]: pam_unix(sudo:session): session closed for user root
Jul 03 00:57:57 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.659s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 00:57:57 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 00:57:57 devstack sudo[76904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 00:57:57 devstack sudo[76904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 00:57:58 devstack sudo[76904]: pam_unix(sudo:session): session closed for user root
Jul 03 00:57:58 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.656s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 00:57:58 devstack cinder-volume[75794]: DEBUG cinder.manager [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] Notifying Schedulers of capabilities ... {{(pid=75794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 00:57:58 devstack cinder-volume[75794]: INFO cinder.volume.manager [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] Driver initialization completed successfully.
Jul 03 00:57:58 devstack cinder-volume[75794]: INFO cinder.manager [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] Initiating service 2 cleanup
Jul 03 00:57:58 devstack cinder-volume[75794]: INFO cinder.manager [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] Service 2 cleanup completed.
Jul 03 00:57:58 devstack cinder-volume[75794]: DEBUG cinder.service [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] Creating RPC server for service cinder-volume {{(pid=75794) start /opt/stack/cinder/cinder/service.py:231}}
Jul 03 00:57:58 devstack cinder-volume[75794]: DEBUG cinder.service [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75794) start /opt/stack/cinder/cinder/service.py:237}}
Jul 03 00:57:58 devstack cinder-volume[75794]: INFO cinder.volume.manager [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Jul 03 00:57:58 devstack cinder-volume[75794]: DEBUG cinder.volume.drivers.lvm [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] Updating volume stats {{(pid=75794) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 03 00:57:58 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 00:57:58 devstack sudo[76908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 03 00:57:58 devstack sudo[76908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 00:57:59 devstack sudo[76908]: pam_unix(sudo:session): session closed for user root
Jul 03 00:57:59 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.704s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 00:57:59 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 00:57:59 devstack sudo[76911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 00:57:59 devstack sudo[76911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 00:58:00 devstack sudo[76911]: pam_unix(sudo:session): session closed for user root
Jul 03 00:58:00 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.680s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 00:58:00 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 00:58:00 devstack sudo[76968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 03 00:58:00 devstack sudo[76968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 00:58:00 devstack sudo[76968]: pam_unix(sudo:session): session closed for user root
Jul 03 00:58:00 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.644s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 00:58:00 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 00:58:00 devstack sudo[76974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 00:58:00 devstack sudo[76974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 00:58:01 devstack sudo[76974]: pam_unix(sudo:session): session closed for user root
Jul 03 00:58:01 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.633s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 00:58:01 devstack cinder-volume[75794]: INFO cinder.volume.manager [None req-97fe3df5-067e-4b67-a31b-695fbfdc5f2d None None] Driver post RPC initialization completed successfully.
Jul 03 00:58:05 devstack cinder-volume[75794]: DEBUG oslo_service.periodic_task [None req-20fc65b3-847d-45d9-a3db-b3df4aba5aa9 None None] Running periodic task VolumeManager._thread_info {{(pid=75794) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 00:58:05 devstack cinder-volume[75794]: DEBUG cinder.volume.manager [None req-20fc65b3-847d-45d9-a3db-b3df4aba5aa9 None None] thread count: 6 {{(pid=75794) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 00:58:05 devstack cinder-volume[75794]: DEBUG cinder.volume.manager [None req-20fc65b3-847d-45d9-a3db-b3df4aba5aa9 None None] thread info: [<_MainThread(MainThread, started 136813454192768)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136813342534016)>, <Thread(Thread-3 (stat_writer), started daemon 136813343352832)>, <Thread(Rabbit-heartbeat, started daemon 136813342714560)>, <Thread(Thread-5 (_runner), started daemon 136813342333696)>, <Thread(Thread-7 (_runner), started daemon 136813340315776)>] {{(pid=75794) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 00:58:08 devstack cinder-volume[75794]: DEBUG dbcounter [-] [75794] Writing DB stats cinder:SELECT=3 {{(pid=75794) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 00:58:11 devstack cinder-volume[75794]: DEBUG dbcounter [-] [75794] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75794) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 00:59:05 devstack cinder-volume[75794]: DEBUG oslo_service.periodic_task [None req-20fc65b3-847d-45d9-a3db-b3df4aba5aa9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75794) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 00:59:05 devstack cinder-volume[75794]: DEBUG cinder.volume.drivers.lvm [None req-20fc65b3-847d-45d9-a3db-b3df4aba5aa9 None None] Updating volume stats {{(pid=75794) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 03 00:59:05 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-20fc65b3-847d-45d9-a3db-b3df4aba5aa9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 00:59:05 devstack sudo[78724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 03 00:59:05 devstack sudo[78724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 00:59:05 devstack sudo[78724]: pam_unix(sudo:session): session closed for user root
Jul 03 00:59:05 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-20fc65b3-847d-45d9-a3db-b3df4aba5aa9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.603s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 00:59:06 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-20fc65b3-847d-45d9-a3db-b3df4aba5aa9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 00:59:06 devstack sudo[78727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 00:59:06 devstack sudo[78727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 00:59:06 devstack sudo[78727]: pam_unix(sudo:session): session closed for user root
Jul 03 00:59:06 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-20fc65b3-847d-45d9-a3db-b3df4aba5aa9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.640s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 00:59:06 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-20fc65b3-847d-45d9-a3db-b3df4aba5aa9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 00:59:06 devstack sudo[78730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 03 00:59:06 devstack sudo[78730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 00:59:07 devstack sudo[78730]: pam_unix(sudo:session): session closed for user root
Jul 03 00:59:07 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-20fc65b3-847d-45d9-a3db-b3df4aba5aa9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.642s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 00:59:07 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-20fc65b3-847d-45d9-a3db-b3df4aba5aa9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 00:59:07 devstack sudo[78734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 00:59:07 devstack sudo[78734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 00:59:07 devstack sudo[78734]: pam_unix(sudo:session): session closed for user root
Jul 03 00:59:07 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-20fc65b3-847d-45d9-a3db-b3df4aba5aa9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.639s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 00:59:07 devstack cinder-volume[75794]: DEBUG cinder.manager [None req-20fc65b3-847d-45d9-a3db-b3df4aba5aa9 None None] Notifying Schedulers of capabilities ... {{(pid=75794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 00:59:07 devstack cinder-volume[75794]: DEBUG oslo_service.periodic_task [None req-20fc65b3-847d-45d9-a3db-b3df4aba5aa9 None None] Running periodic task VolumeManager._thread_info {{(pid=75794) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 00:59:07 devstack cinder-volume[75794]: DEBUG cinder.volume.manager [None req-20fc65b3-847d-45d9-a3db-b3df4aba5aa9 None None] thread count: 6 {{(pid=75794) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 00:59:07 devstack cinder-volume[75794]: DEBUG cinder.volume.manager [None req-20fc65b3-847d-45d9-a3db-b3df4aba5aa9 None None] thread info: [<_MainThread(MainThread, started 136813454192768)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136813342534016)>, <Thread(Thread-3 (stat_writer), started daemon 136813343352832)>, <Thread(Rabbit-heartbeat, started daemon 136813342714560)>, <Thread(Thread-5 (_runner), started daemon 136813342333696)>, <Thread(Thread-7 (_runner), started daemon 136813340315776)>] {{(pid=75794) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 01:00:05 devstack cinder-volume[75794]: DEBUG oslo_service.periodic_task [None req-20fc65b3-847d-45d9-a3db-b3df4aba5aa9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75794) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 01:00:05 devstack cinder-volume[75794]: DEBUG cinder.volume.drivers.lvm [None req-20fc65b3-847d-45d9-a3db-b3df4aba5aa9 None None] Updating volume stats {{(pid=75794) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 03 01:00:05 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-20fc65b3-847d-45d9-a3db-b3df4aba5aa9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:00:05 devstack sudo[81937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 03 01:00:05 devstack sudo[81937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:00:06 devstack sudo[81937]: pam_unix(sudo:session): session closed for user root
Jul 03 01:00:06 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-20fc65b3-847d-45d9-a3db-b3df4aba5aa9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.651s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:00:06 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-20fc65b3-847d-45d9-a3db-b3df4aba5aa9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:00:06 devstack sudo[81942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 01:00:06 devstack sudo[81942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:00:06 devstack sudo[81942]: pam_unix(sudo:session): session closed for user root
Jul 03 01:00:06 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-20fc65b3-847d-45d9-a3db-b3df4aba5aa9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.633s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:00:06 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-20fc65b3-847d-45d9-a3db-b3df4aba5aa9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:00:06 devstack sudo[81950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 03 01:00:06 devstack sudo[81950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:00:07 devstack sudo[81950]: pam_unix(sudo:session): session closed for user root
Jul 03 01:00:07 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-20fc65b3-847d-45d9-a3db-b3df4aba5aa9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.633s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:00:07 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-20fc65b3-847d-45d9-a3db-b3df4aba5aa9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:00:07 devstack sudo[81961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 01:00:07 devstack sudo[81961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:00:07 devstack sudo[81961]: pam_unix(sudo:session): session closed for user root
Jul 03 01:00:07 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-20fc65b3-847d-45d9-a3db-b3df4aba5aa9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.648s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:00:07 devstack cinder-volume[75794]: DEBUG cinder.manager [None req-20fc65b3-847d-45d9-a3db-b3df4aba5aa9 None None] Notifying Schedulers of capabilities ... {{(pid=75794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:00:07 devstack cinder-volume[75794]: DEBUG oslo_service.periodic_task [None req-20fc65b3-847d-45d9-a3db-b3df4aba5aa9 None None] Running periodic task VolumeManager._thread_info {{(pid=75794) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 01:00:07 devstack cinder-volume[75794]: DEBUG cinder.volume.manager [None req-20fc65b3-847d-45d9-a3db-b3df4aba5aa9 None None] thread count: 6 {{(pid=75794) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 01:00:07 devstack cinder-volume[75794]: DEBUG cinder.volume.manager [None req-20fc65b3-847d-45d9-a3db-b3df4aba5aa9 None None] thread info: [<_MainThread(MainThread, started 136813454192768)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136813342534016)>, <Thread(Thread-3 (stat_writer), started daemon 136813343352832)>, <Thread(Rabbit-heartbeat, started daemon 136813342714560)>, <Thread(Thread-5 (_runner), started daemon 136813342333696)>, <Thread(Thread-7 (_runner), started daemon 136813340315776)>] {{(pid=75794) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 01:00:11 devstack cinder-volume[75794]: DEBUG dbcounter [-] [75794] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75794) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:01:05 devstack cinder-volume[75794]: DEBUG oslo_service.periodic_task [None req-20fc65b3-847d-45d9-a3db-b3df4aba5aa9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75794) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 01:01:05 devstack cinder-volume[75794]: DEBUG cinder.volume.drivers.lvm [None req-20fc65b3-847d-45d9-a3db-b3df4aba5aa9 None None] Updating volume stats {{(pid=75794) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 03 01:01:05 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-20fc65b3-847d-45d9-a3db-b3df4aba5aa9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:01:05 devstack sudo[83862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 03 01:01:05 devstack sudo[83862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:01:06 devstack sudo[83862]: pam_unix(sudo:session): session closed for user root
Jul 03 01:01:06 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-20fc65b3-847d-45d9-a3db-b3df4aba5aa9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.631s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:01:06 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-20fc65b3-847d-45d9-a3db-b3df4aba5aa9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:01:06 devstack sudo[83885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 01:01:06 devstack sudo[83885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:01:06 devstack sudo[83885]: pam_unix(sudo:session): session closed for user root
Jul 03 01:01:06 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-20fc65b3-847d-45d9-a3db-b3df4aba5aa9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.654s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:01:06 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-20fc65b3-847d-45d9-a3db-b3df4aba5aa9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:01:06 devstack sudo[83899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 03 01:01:06 devstack sudo[83899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:01:07 devstack sudo[83899]: pam_unix(sudo:session): session closed for user root
Jul 03 01:01:07 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-20fc65b3-847d-45d9-a3db-b3df4aba5aa9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.676s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:01:07 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-20fc65b3-847d-45d9-a3db-b3df4aba5aa9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:01:07 devstack sudo[83925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 01:01:07 devstack sudo[83925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:01:08 devstack sudo[83925]: pam_unix(sudo:session): session closed for user root
Jul 03 01:01:08 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-20fc65b3-847d-45d9-a3db-b3df4aba5aa9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.663s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:01:08 devstack cinder-volume[75794]: DEBUG cinder.manager [None req-20fc65b3-847d-45d9-a3db-b3df4aba5aa9 None None] Notifying Schedulers of capabilities ... {{(pid=75794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:01:08 devstack cinder-volume[75794]: DEBUG oslo_service.periodic_task [None req-20fc65b3-847d-45d9-a3db-b3df4aba5aa9 None None] Running periodic task VolumeManager._thread_info {{(pid=75794) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 01:01:08 devstack cinder-volume[75794]: DEBUG cinder.volume.manager [None req-20fc65b3-847d-45d9-a3db-b3df4aba5aa9 None None] thread count: 6 {{(pid=75794) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 01:01:08 devstack cinder-volume[75794]: DEBUG cinder.volume.manager [None req-20fc65b3-847d-45d9-a3db-b3df4aba5aa9 None None] thread info: [<_MainThread(MainThread, started 136813454192768)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136813342534016)>, <Thread(Thread-3 (stat_writer), started daemon 136813343352832)>, <Thread(Rabbit-heartbeat, started daemon 136813342714560)>, <Thread(Thread-5 (_runner), started daemon 136813342333696)>, <Thread(Thread-7 (_runner), started daemon 136813340315776)>] {{(pid=75794) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 01:02:05 devstack cinder-volume[75794]: DEBUG oslo_service.periodic_task [None req-20fc65b3-847d-45d9-a3db-b3df4aba5aa9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75794) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 01:02:05 devstack cinder-volume[75794]: DEBUG cinder.volume.drivers.lvm [None req-20fc65b3-847d-45d9-a3db-b3df4aba5aa9 None None] Updating volume stats {{(pid=75794) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 03 01:02:05 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-20fc65b3-847d-45d9-a3db-b3df4aba5aa9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:02:05 devstack sudo[85304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 03 01:02:05 devstack sudo[85304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:02:06 devstack sudo[85304]: pam_unix(sudo:session): session closed for user root
Jul 03 01:02:06 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-20fc65b3-847d-45d9-a3db-b3df4aba5aa9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.641s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:02:06 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-20fc65b3-847d-45d9-a3db-b3df4aba5aa9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:02:06 devstack sudo[85335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 01:02:06 devstack sudo[85335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:02:06 devstack sudo[85335]: pam_unix(sudo:session): session closed for user root
Jul 03 01:02:06 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-20fc65b3-847d-45d9-a3db-b3df4aba5aa9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.680s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:02:06 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-20fc65b3-847d-45d9-a3db-b3df4aba5aa9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:02:06 devstack sudo[85344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 03 01:02:06 devstack sudo[85344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:02:07 devstack sudo[85344]: pam_unix(sudo:session): session closed for user root
Jul 03 01:02:07 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-20fc65b3-847d-45d9-a3db-b3df4aba5aa9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.653s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:02:07 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-20fc65b3-847d-45d9-a3db-b3df4aba5aa9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:02:07 devstack sudo[85349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 01:02:07 devstack sudo[85349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:02:07 devstack sudo[85349]: pam_unix(sudo:session): session closed for user root
Jul 03 01:02:07 devstack cinder-volume[75794]: DEBUG oslo_concurrency.processutils [None req-20fc65b3-847d-45d9-a3db-b3df4aba5aa9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.612s {{(pid=75794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:02:07 devstack cinder-volume[75794]: DEBUG cinder.manager [None req-20fc65b3-847d-45d9-a3db-b3df4aba5aa9 None None] Notifying Schedulers of capabilities ... {{(pid=75794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:02:08 devstack cinder-volume[75794]: DEBUG oslo_service.periodic_task [None req-20fc65b3-847d-45d9-a3db-b3df4aba5aa9 None None] Running periodic task VolumeManager._thread_info {{(pid=75794) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 01:02:08 devstack cinder-volume[75794]: DEBUG cinder.volume.manager [None req-20fc65b3-847d-45d9-a3db-b3df4aba5aa9 None None] thread count: 6 {{(pid=75794) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 01:02:08 devstack cinder-volume[75794]: DEBUG cinder.volume.manager [None req-20fc65b3-847d-45d9-a3db-b3df4aba5aa9 None None] thread info: [<_MainThread(MainThread, started 136813454192768)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136813342534016)>, <Thread(Thread-3 (stat_writer), started daemon 136813343352832)>, <Thread(Rabbit-heartbeat, started daemon 136813342714560)>, <Thread(Thread-5 (_runner), started daemon 136813342333696)>, <Thread(Thread-7 (_runner), started daemon 136813340315776)>] {{(pid=75794) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 01:02:11 devstack cinder-volume[75794]: DEBUG dbcounter [-] [75794] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75794) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:02:27 devstack cinder-volume[75625]: INFO oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] Caught SIGTERM, stopping children
Jul 03 01:02:27 devstack cinder-volume[75625]: DEBUG oslo_concurrency.lockutils [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] Acquiring lock "singleton_lock" {{(pid=75625) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 03 01:02:27 devstack cinder-volume[75625]: DEBUG oslo_concurrency.lockutils [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] Acquired lock "singleton_lock" {{(pid=75625) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 03 01:02:27 devstack cinder-volume[75625]: DEBUG oslo_concurrency.lockutils [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] Releasing lock "singleton_lock" {{(pid=75625) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 03 01:02:27 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] Stop services. {{(pid=75625) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Jul 03 01:02:27 devstack cinder-volume[75625]: DEBUG oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] Killing children. {{(pid=75625) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Jul 03 01:02:27 devstack cinder-volume[75625]: INFO oslo_service.backend._eventlet.service [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] Waiting on 1 children to exit
Jul 03 01:02:32 devstack cinder-volume[75794]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting
Jul 03 01:02:32 devstack cinder-volume[85954]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jul 03 01:02:32 devstack cinder-volume[85954]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 03 01:02:32 devstack cinder-volume[85954]: we strongly recommend against using it for new projects.
Jul 03 01:02:32 devstack cinder-volume[85954]: If you are already using Eventlet, we recommend migrating to a different
Jul 03 01:02:32 devstack cinder-volume[85954]: framework.  For more detail see
Jul 03 01:02:32 devstack cinder-volume[85954]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 03 01:02:32 devstack cinder-volume[85954]:   import eventlet  # noqa
Jul 03 01:02:33 devstack cinder-volume[75794]: DEBUG oslo_concurrency.lockutils [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] Acquiring lock "singleton_lock" {{(pid=75794) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 03 01:02:33 devstack cinder-volume[75794]: DEBUG oslo_concurrency.lockutils [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] Acquired lock "singleton_lock" {{(pid=75794) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 03 01:02:33 devstack cinder-volume[75794]: DEBUG oslo_concurrency.lockutils [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] Releasing lock "singleton_lock" {{(pid=75794) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 03 01:02:33 devstack cinder-volume[75794]: WARNING amqp [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 03 01:02:33 devstack cinder-volume[75794]: WARNING amqp [None req-33cd232d-7ce0-4439-b246-df19853cdbef None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 03 01:02:35 devstack cinder-volume[85954]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85954) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 03 01:02:35 devstack cinder-volume[85954]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85954) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 03 01:02:35 devstack cinder-volume[85954]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85954) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 03 01:02:35 devstack cinder-volume[85954]: INFO dbcounter [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] Registered counter for database cinder
Jul 03 01:02:35 devstack cinder-volume[85954]: DEBUG oslo_db.sqlalchemy.engines [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85954) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG dbcounter [-] [85954] Writer thread running {{(pid=85954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 03 01:02:36 devstack cinder-volume[85954]: INFO cinder.rpc [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jul 03 01:02:36 devstack cinder-volume[85954]: INFO cinder.rpc [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_db.sqlalchemy.engines [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85954) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 03 01:02:36 devstack cinder-volume[85954]: INFO cinder.volume.manager [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] Determined volume DB was empty at startup.
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG cinder.volume.manager [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85954) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jul 03 01:02:36 devstack cinder-volume[85954]: INFO cinder.volume.manager [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] Service not found for updating active_backend_id, assuming default for driver init.
Jul 03 01:02:36 devstack cinder-volume[85954]: WARNING stevedore.named [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 03 01:02:36 devstack cinder-volume[85954]: WARNING castellan.key_manager [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 03 01:02:36 devstack cinder-volume[85954]: WARNING cinder.keymgr.conf_key_mgr [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 03 01:02:36 devstack cinder-volume[85954]: INFO cinder.volume.manager [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_db.sqlalchemy.engines [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85954) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 03 01:02:36 devstack cinder-volume[85954]: INFO oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] Starting 1 workers
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] Started child 86228 {{(pid=85954) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] Full set of CONF: {{(pid=85954) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] ******************************************************************************** {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] Configuration options gathered from: {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] ================================================================================ {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jul 03 01:02:36 devstack cinder-volume[86228]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] allow_availability_zone_fallback = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] allow_compression_on_image_upload = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] allowed_direct_url_schemes     = [] {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] api_rate_limit                 = True {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] auth_strategy                  = keystone {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_availability_zone      = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_host                   = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_name                   = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_stats_polling_interval = 60 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backup_api_class               = cinder.backup.api.API {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backup_name_template           = backup-%s {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backup_use_same_host           = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backup_use_temp_snapshot       = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] chap_password                  = **** {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] chap_username                  =  {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] cinder_internal_tenant_project_id = ca895bd40bcb4a719e595432ed69a23c {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] cinder_internal_tenant_user_id = 144d173bcacc4401bb970270b629174f {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] cluster                        = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] compression_format             = gzip {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] compute_api_class              = cinder.compute.nova.API {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] config_dir                     = [] {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] config_source                  = [] {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] control_exchange               = openstack {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] debug                          = True {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] default_availability_zone      = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] default_group_type             = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] default_volume_type            = QuobyteHD {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] disk_geometry                  = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] driver_client_cert             = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] driver_client_cert_key         = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] driver_data_namespace          = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] driver_ssl_cert_path           = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] driver_ssl_cert_verify         = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] driver_use_ssl                 = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] enable_new_services            = True {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] enable_unsupported_driver      = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] enabled_backends               = ['QuobyteHD'] {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] enforce_multipath_for_image_xfer = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] filter_function                = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] glance_api_insecure            = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] glance_api_servers             = ['http://192.168.122.176/image'] {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] glance_api_ssl_compression     = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] glance_ca_certificates_file    = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] glance_catalog_info            = image:glance:publicURL {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] glance_certfile                = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] glance_keyfile                 = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] glance_num_retries             = 3 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] glance_request_timeout         = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] goodness_function              = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] graceful_shutdown_timeout      = 5 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[86228]: INFO cinder.volume.manager [None req-764914f6-bdd2-49a6-807f-ea804489c35a None None] Starting volume driver QuobyteDriver (1.1.14)
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] group_api_class                = cinder.group.api.API {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[86228]: DEBUG cinder.volume.drivers.remotefs [None req-764914f6-bdd2-49a6-807f-ea804489c35a None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86228) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] host                           = devstack {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] image_compress_on_upload       = True {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] image_conversion_address_space_limit = 1 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] image_conversion_cpu_limit     = 60 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] image_conversion_disable       = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] image_upload_use_cinder_backend = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] image_upload_use_internal_tenant = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] image_volume_cache_enabled     = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] image_volume_cache_max_count   = 0 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] image_volume_cache_max_size_gb = 0 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] init_host_max_objects_retrieval = 0 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] instance_format                = [instance: %(uuid)s]  {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] iscsi_target_flags             =  {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] iscsi_write_cache              = on {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] iser_helper                    = tgtadm {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] iser_ip_address                = 192.168.122.176 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] iser_port                      = 3260 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] log_color                      = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] log_config_append              = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] log_dir                        = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] log_file                       = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] log_options                    = True {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] log_rotate_interval            = 1 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] log_rotate_interval_type       = days {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] log_rotation_type              = none {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] max_age                        = 0 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] max_logfile_count              = 30 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] max_logfile_size_mb            = 200 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] max_over_subscription_ratio    = 20.0 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] message_reap_interval          = 86400 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] message_ttl                    = 2592000 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] migration_create_volume_timeout_secs = 300 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] monkey_patch                   = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] monkey_patch_modules           = [] {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] my_ip                          = 192.168.122.176 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] no_snapshot_gb_quota           = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] num_iser_scan_tries            = 3 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] num_shell_tries                = 3 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] num_volume_device_scan_tries   = 3 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] nvmeof_conn_info_version       = 1 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] nvmet_ns_id                    = 10 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] nvmet_port_id                  = 1 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] osapi_max_limit                = 1000 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] osapi_volume_ext_list          = [] {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] osapi_volume_listen_port       = 8776 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] osapi_volume_use_ssl           = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] osapi_volume_workers           = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] per_volume_size_limit          = -1 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] periodic_fuzzy_delay           = 60 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] periodic_interval              = 60 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] public_endpoint                = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] publish_errors                 = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] quota_backup_gigabytes         = 1000 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] quota_backups                  = 10 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] quota_gigabytes                = 1000 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] quota_groups                   = 10 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] quota_snapshots                = 10 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] quota_volumes                  = 10 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] rate_limit_burst               = 0 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] rate_limit_except_level        = CRITICAL {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] rate_limit_interval            = 0 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] reinit_driver_count            = 3 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] replication_device             = **** {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] report_discard_supported       = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] report_interval                = 120 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] reservation_clean_interval     = 86400 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] reservation_expire             = 86400 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] reserved_image_namespaces      = [] {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] reserved_percentage            = 0 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] rpc_response_timeout           = 120 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] run_external_periodic_tasks    = True {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] scst_target_driver             = iscsi {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] scst_target_iqn_name           = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] service_down_time              = 720 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] shell_completion               = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] snapshot_name_template         = snapshot-%s {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] split_loggers                  = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] state_path                     = /opt/stack/data/cinder {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] storage_availability_zone      = nova {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] storage_protocol               = iSCSI {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] syslog_log_facility            = LOG_USER {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] target_helper                  = lioadm {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] target_ip_address              = 192.168.122.176 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] target_port                    = 3260 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] target_protocol                = iscsi {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] target_secondary_ip_addresses  = [] {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[86228]: DEBUG cinder.volume.drivers.quobyte [None req-764914f6-bdd2-49a6-807f-ea804489c35a None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86228) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Jul 03 01:02:36 devstack cinder-volume[86228]: WARNING cinder.volume.drivers.quobyte [None req-764914f6-bdd2-49a6-807f-ea804489c35a None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Jul 03 01:02:36 devstack cinder-volume[86228]: WARNING cinder.volume.drivers.quobyte [None req-764914f6-bdd2-49a6-807f-ea804489c35a None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] trace_flags                    = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[86228]: DEBUG oslo_concurrency.processutils [None req-764914f6-bdd2-49a6-807f-ea804489c35a None None] Running cmd (subprocess): mount.quobyte {{(pid=86228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] transport_url                  = **** {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] until_refresh                  = 0 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] use_chap_auth                  = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] use_default_quota_class        = True {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] use_journal                    = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] use_json                       = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] use_multipath_for_image_xfer   = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] use_stderr                     = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] use_syslog                     = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] verify_glance_signatures       = enabled {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] volume_api_class               = cinder.volume.api.API {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] volume_backend_name            = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] volume_clear                   = zero {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] volume_clear_ionice            = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] volume_clear_size              = 0 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] volume_copy_bps_limit          = 0 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] volume_dd_blocksize            = 1M {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] volume_name_template           = volume-%s {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] volume_service_inithost_offload = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] volume_usage_audit_period      = month {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] zoning_mode                    = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] oslo_concurrency.disable_process_locking = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] keystone_authtoken.auth_section = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] keystone_authtoken.auth_type   = password {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] keystone_authtoken.auth_version = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] keystone_authtoken.cache       = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] keystone_authtoken.certfile    = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] keystone_authtoken.include_service_catalog = True {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] keystone_authtoken.insecure    = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] keystone_authtoken.interface   = public {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] keystone_authtoken.keyfile     = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] keystone_authtoken.memcache_password =  {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] keystone_authtoken.memcache_username =  {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] keystone_authtoken.region_name = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] keystone_authtoken.service_type = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.176/identity {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] cache.backend                  = dogpile.cache.null {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] cache.backend_argument         = **** {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] cache.backend_expiration_time  = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] cache.config_prefix            = cache.oslo {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] cache.debug_cache_backend      = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] cache.enable_retry_client      = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] cache.enable_socket_keepalive  = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] cache.enabled                  = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] cache.expiration_time          = 600 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] cache.hashclient_retry_attempts = 2 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] cache.memcache_dead_retry      = 300 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] cache.memcache_pool_maxsize    = 10 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] cache.memcache_sasl_enabled    = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] cache.password                 = **** {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] cache.proxies                  = [] {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] cache.redis_db                 = 0 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] cache.redis_server             = localhost:6379 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] cache.retry_attempts           = 2 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] cache.retry_delay              = 0.0 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] cache.socket_keepalive_count   = 1 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] cache.socket_keepalive_idle    = 1 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] cache.socket_keepalive_interval = 1 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] cache.socket_timeout           = 1.0 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] cache.tls_allowed_ciphers      = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] cache.tls_cafile               = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] cache.tls_certfile             = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] cache.tls_enabled              = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] cache.tls_keyfile              = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] cache.username                 = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] coordination.backend_url       = **** {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] database.asyncio_connection    = **** {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] database.asyncio_slave_connection = **** {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] database.backend               = sqlalchemy {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] database.connection            = **** {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] database.connection_debug      = 0 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] database.connection_parameters =  {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] database.connection_recycle_time = 3600 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] database.connection_trace      = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] database.db_inc_retry_interval = True {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] database.db_max_retries        = 20 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] database.db_max_retry_interval = 10 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] database.db_retry_interval     = 1 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] database.max_overflow          = 50 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] database.max_pool_size         = 5 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] database.max_retries           = 10 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] database.mysql_wsrep_sync_wait = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] database.pool_timeout          = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] database.retry_interval        = 10 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] database.slave_connection      = **** {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] database.sqlite_synchronous    = True {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] database.synchronous_reader    = True {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] database.use_db_reconnect      = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] profiler.connection_string     = messaging:// {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] profiler.enabled               = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] profiler.es_doc_type           = notification {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] profiler.es_scroll_size        = 10000 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] profiler.es_scroll_time        = 2m {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] profiler.filter_error_trace    = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] profiler.hmac_keys             = **** {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] profiler.sentinel_service_name = mymaster {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] profiler.socket_timeout        = 0.1 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] profiler.trace_requests        = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] profiler.trace_sqlalchemy      = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] profiler_jaeger.process_tags   = {} {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] profiler_jaeger.service_name_prefix = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] profiler_otlp.service_name_prefix = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] oslo_policy.enforce_new_defaults = True {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] oslo_policy.enforce_scope      = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] oslo_policy.policy_default_rule = default {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack quobyte-client[86229]: Reading configuration file: /etc/quobyte/client.cfg
Jul 03 01:02:36 devstack quobyte-client[86229]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] oslo_policy.policy_file        = policy.yaml {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] privsep_osbrick.group          = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] privsep_osbrick.helper_command = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] privsep_osbrick.user           = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] cinder_sys_admin.group         = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] cinder_sys_admin.helper_command = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] cinder_sys_admin.user          = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[86228]: DEBUG oslo_concurrency.processutils [None req-764914f6-bdd2-49a6-807f-ea804489c35a None None] CMD "mount.quobyte" returned: 1 in 0.108s {{(pid=86228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:02:36 devstack cinder-volume[86228]: DEBUG oslo_concurrency.lockutils [None req-764914f6-bdd2-49a6-807f-ea804489c35a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:02:36 devstack cinder-volume[86228]: DEBUG oslo_concurrency.lockutils [None req-764914f6-bdd2-49a6-807f-ea804489c35a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:02:36 devstack cinder-volume[86228]: DEBUG cinder.volume.drivers.quobyte [None req-764914f6-bdd2-49a6-807f-ea804489c35a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] service_user.auth_section      = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] service_user.auth_type         = password {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] service_user.cafile            = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[86228]: INFO cinder.volume.drivers.quobyte [None req-764914f6-bdd2-49a6-807f-ea804489c35a None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 ...
Jul 03 01:02:36 devstack cinder-volume[86228]: DEBUG oslo_concurrency.processutils [None req-764914f6-bdd2-49a6-807f-ea804489c35a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc -c /etc/quobyte/client-cinder.cfg {{(pid=86228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] service_user.certfile          = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] service_user.collect_timing    = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] service_user.insecure          = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] service_user.keyfile           = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] service_user.send_service_user_token = True {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] service_user.split_loggers     = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] service_user.timeout           = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] glance.auth_section            = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] glance.auth_type               = password {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] glance.certfile                = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] glance.collect_timing          = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] glance.insecure                = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] glance.keyfile                 = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] glance.region_name             = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] glance.split_loggers           = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] glance.timeout                 = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.backend_availability_zone = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.chap_password = **** {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.chap_username =  {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.disk_geometry = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.driver_client_cert = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.driver_client_cert_key = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.driver_data_namespace = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.driver_use_ssl = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.extra_capabilities = {} {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.filter_function = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.goodness_function = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.iscsi_target_flags =  {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.iscsi_write_cache = on {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.iser_helper   = tgtadm {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.iser_ip_address = 192.168.122.176 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.iser_port     = 3260 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.nas_host      =  {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.nas_login     = admin {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.nas_mount_options = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.nas_password  = **** {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.nas_private_key =  {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.nas_share_path =  {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.num_shell_tries = 3 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.quobyte_volume_url = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.replication_device = **** {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.report_discard_supported = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.reserved_percentage = 0 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.target_helper = tgtadm {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.target_ip_address = 192.168.122.176 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.target_port   = 3260 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.target_protocol = iscsi {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.trace_flags   = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.unique_fqdn_network = True {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.use_chap_auth = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.volume_backend_name = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.volume_clear  = zero {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.volume_clear_ionice = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.volume_clear_size = 0 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack sudo[86232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc -c /etc/quobyte/client-cinder.cfg
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] oslo_reports.file_event_handler = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] oslo_reports.log_dir           = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack sudo[86232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.backend_availability_zone = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.backend_host         = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.chap_password        = **** {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.chap_username        = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.chiscsi_conf         = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.disk_geometry        = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.driver_client_cert   = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.driver_data_namespace = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.driver_use_ssl       = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.extra_capabilities   = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.filter_function      = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.goodness_function    = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.iser_helper          = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.iser_ip_address      = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.iser_port            = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.iser_target_prefix   = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.nas_host             = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.nas_login            = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.nas_mount_options    = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.nas_password         = **** {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.nas_private_key      = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.nas_share_path       = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.nas_ssh_port         = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.num_shell_tries      = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.nvmet_port_id        = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.replication_device   = **** {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.report_discard_supported = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.reserved_percentage  = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.scst_target_driver   = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.storage_protocol     = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.target_helper        = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.target_ip_address    = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.target_port          = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.target_prefix        = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.target_protocol      = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.trace_flags          = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.use_chap_auth        = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.volume_clear         = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.volume_clear_size    = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] QuobyteHD.volumes_dir          = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] oslo_messaging_rabbit.ssl      = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] oslo_messaging_notifications.driver = [] {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] oslo_messaging_notifications.retry = -1 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] key_manager.fixed_key          = **** {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] barbican.barbican_api_version  = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] barbican.barbican_endpoint     = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] barbican.barbican_endpoint_type = public {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] barbican.barbican_region_name  = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] barbican.cafile                = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] barbican.certfile              = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] barbican.collect_timing        = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] barbican.insecure              = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] barbican.keyfile               = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] barbican.number_of_retries     = 60 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] barbican.retry_delay           = 1 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] barbican.send_service_user_token = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] barbican.split_loggers         = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] barbican.timeout               = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] barbican.verify_ssl            = True {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] barbican.verify_ssl_path       = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] barbican_service_user.auth_section = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] barbican_service_user.auth_type = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] barbican_service_user.cafile   = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] barbican_service_user.certfile = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] barbican_service_user.collect_timing = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] barbican_service_user.insecure = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] barbican_service_user.keyfile  = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] barbican_service_user.split_loggers = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] barbican_service_user.timeout  = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] vault.approle_role_id          = **** {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] vault.approle_secret_id        = **** {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] vault.kv_mountpoint            = secret {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] vault.kv_path                  = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] vault.kv_version               = 2 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] vault.namespace                = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] vault.root_token_id            = **** {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] vault.ssl_ca_crt_file          = None {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] vault.timeout                  = 60.0 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] vault.use_ssl                  = False {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:36 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] ******************************************************************************** {{(pid=85954) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jul 03 01:02:37 devstack sudo[86232]: pam_unix(sudo:session): session closed for user root
Jul 03 01:02:37 devstack cinder-volume[86228]: DEBUG oslo_concurrency.processutils [None req-764914f6-bdd2-49a6-807f-ea804489c35a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.911s {{(pid=86228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:02:37 devstack cinder-volume[86228]: INFO cinder.volume.drivers.quobyte [None req-764914f6-bdd2-49a6-807f-ea804489c35a None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 succeeded
Jul 03 01:02:37 devstack cinder-volume[86228]: DEBUG cinder.volume.drivers.quobyte [None req-764914f6-bdd2-49a6-807f-ea804489c35a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:02:37 devstack cinder-volume[86228]: DEBUG oslo_concurrency.lockutils [None req-764914f6-bdd2-49a6-807f-ea804489c35a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.925s {{(pid=86228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:02:37 devstack cinder-volume[86228]: DEBUG oslo_concurrency.processutils [None req-764914f6-bdd2-49a6-807f-ea804489c35a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:02:37 devstack sudo[86326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:02:37 devstack sudo[86326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:02:38 devstack sudo[86326]: pam_unix(sudo:session): session closed for user root
Jul 03 01:02:38 devstack cinder-volume[86228]: DEBUG oslo_concurrency.processutils [None req-764914f6-bdd2-49a6-807f-ea804489c35a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.711s {{(pid=86228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:02:38 devstack cinder-volume[86228]: INFO cinder.volume.driver [None req-764914f6-bdd2-49a6-807f-ea804489c35a None None] Driver hasn't implemented _init_vendor_properties()
Jul 03 01:02:38 devstack cinder-volume[86228]: DEBUG cinder.volume.driver [None req-764914f6-bdd2-49a6-807f-ea804489c35a None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.75777053833, 'free_capacity_gb': 1775.75777053833, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86228) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jul 03 01:02:38 devstack cinder-volume[86228]: DEBUG oslo_db.sqlalchemy.engines [None req-764914f6-bdd2-49a6-807f-ea804489c35a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86228) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 03 01:02:38 devstack cinder-volume[86228]: DEBUG dbcounter [-] [86228] Writer thread running {{(pid=86228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 03 01:02:38 devstack cinder-volume[86228]: DEBUG cinder.db.api [None req-764914f6-bdd2-49a6-807f-ea804489c35a None None] Building query based on filter {{(pid=86228) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jul 03 01:02:38 devstack cinder-volume[86228]: DEBUG cinder.image.image_utils [None req-764914f6-bdd2-49a6-807f-ea804489c35a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86228) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jul 03 01:02:38 devstack cinder-volume[86228]: INFO cinder.keymgr.migration [None req-dfc903aa-5f8e-4c6e-8f8d-88d21bc0e3bd None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jul 03 01:02:38 devstack cinder-volume[86228]: DEBUG oslo_concurrency.lockutils [None req-764914f6-bdd2-49a6-807f-ea804489c35a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:02:38 devstack cinder-volume[86228]: DEBUG oslo_concurrency.lockutils [None req-764914f6-bdd2-49a6-807f-ea804489c35a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:02:38 devstack cinder-volume[86228]: DEBUG cinder.volume.drivers.quobyte [None req-764914f6-bdd2-49a6-807f-ea804489c35a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:02:38 devstack cinder-volume[86228]: DEBUG cinder.volume.drivers.quobyte [None req-764914f6-bdd2-49a6-807f-ea804489c35a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:02:38 devstack cinder-volume[86228]: DEBUG oslo_concurrency.lockutils [None req-764914f6-bdd2-49a6-807f-ea804489c35a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:02:38 devstack cinder-volume[86228]: DEBUG oslo_concurrency.processutils [None req-764914f6-bdd2-49a6-807f-ea804489c35a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:02:38 devstack sudo[86348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:02:38 devstack sudo[86348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:02:39 devstack sudo[86348]: pam_unix(sudo:session): session closed for user root
Jul 03 01:02:39 devstack cinder-volume[86228]: DEBUG oslo_concurrency.processutils [None req-764914f6-bdd2-49a6-807f-ea804489c35a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.613s {{(pid=86228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:02:39 devstack cinder-volume[86228]: DEBUG cinder.manager [None req-764914f6-bdd2-49a6-807f-ea804489c35a None None] Notifying Schedulers of capabilities ... {{(pid=86228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:02:39 devstack cinder-volume[86228]: INFO cinder.volume.manager [None req-764914f6-bdd2-49a6-807f-ea804489c35a None None] Driver initialization completed successfully.
Jul 03 01:02:39 devstack cinder-volume[86228]: INFO cinder.manager [None req-764914f6-bdd2-49a6-807f-ea804489c35a None None] Initiating service 3 cleanup
Jul 03 01:02:39 devstack cinder-volume[86228]: INFO cinder.manager [None req-764914f6-bdd2-49a6-807f-ea804489c35a None None] Service 3 cleanup completed.
Jul 03 01:02:39 devstack cinder-volume[86228]: DEBUG cinder.service [None req-764914f6-bdd2-49a6-807f-ea804489c35a None None] Creating RPC server for service cinder-volume {{(pid=86228) start /opt/stack/cinder/cinder/service.py:231}}
Jul 03 01:02:39 devstack cinder-volume[86228]: DEBUG cinder.service [None req-764914f6-bdd2-49a6-807f-ea804489c35a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86228) start /opt/stack/cinder/cinder/service.py:237}}
Jul 03 01:02:39 devstack cinder-volume[86228]: INFO cinder.volume.manager [None req-764914f6-bdd2-49a6-807f-ea804489c35a None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Jul 03 01:02:39 devstack cinder-volume[86228]: DEBUG oslo_concurrency.lockutils [None req-764914f6-bdd2-49a6-807f-ea804489c35a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:02:39 devstack cinder-volume[86228]: DEBUG oslo_concurrency.lockutils [None req-764914f6-bdd2-49a6-807f-ea804489c35a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:02:39 devstack cinder-volume[86228]: DEBUG cinder.volume.drivers.quobyte [None req-764914f6-bdd2-49a6-807f-ea804489c35a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:02:39 devstack cinder-volume[86228]: DEBUG cinder.volume.drivers.quobyte [None req-764914f6-bdd2-49a6-807f-ea804489c35a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:02:39 devstack cinder-volume[86228]: DEBUG oslo_concurrency.lockutils [None req-764914f6-bdd2-49a6-807f-ea804489c35a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:02:39 devstack cinder-volume[86228]: DEBUG oslo_concurrency.processutils [None req-764914f6-bdd2-49a6-807f-ea804489c35a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:02:39 devstack sudo[86367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:02:39 devstack sudo[86367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:02:40 devstack sudo[86367]: pam_unix(sudo:session): session closed for user root
Jul 03 01:02:40 devstack cinder-volume[86228]: DEBUG oslo_concurrency.processutils [None req-764914f6-bdd2-49a6-807f-ea804489c35a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.892s {{(pid=86228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:02:40 devstack cinder-volume[86228]: INFO cinder.volume.manager [None req-764914f6-bdd2-49a6-807f-ea804489c35a None None] Driver post RPC initialization completed successfully.
Jul 03 01:02:44 devstack cinder-volume[86228]: DEBUG oslo_concurrency.lockutils [None req-fcf4e114-3be8-48bc-9614-1116a7e0051c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:02:44 devstack cinder-volume[86228]: DEBUG oslo_concurrency.lockutils [None req-fcf4e114-3be8-48bc-9614-1116a7e0051c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:02:44 devstack cinder-volume[86228]: DEBUG cinder.volume.drivers.quobyte [None req-fcf4e114-3be8-48bc-9614-1116a7e0051c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:02:44 devstack cinder-volume[86228]: DEBUG cinder.volume.drivers.quobyte [None req-fcf4e114-3be8-48bc-9614-1116a7e0051c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:02:44 devstack cinder-volume[86228]: DEBUG oslo_concurrency.lockutils [None req-fcf4e114-3be8-48bc-9614-1116a7e0051c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:02:44 devstack cinder-volume[86228]: DEBUG oslo_concurrency.processutils [None req-fcf4e114-3be8-48bc-9614-1116a7e0051c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:02:44 devstack sudo[86556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:02:44 devstack sudo[86556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:02:44 devstack sudo[86556]: pam_unix(sudo:session): session closed for user root
Jul 03 01:02:44 devstack cinder-volume[86228]: DEBUG oslo_concurrency.processutils [None req-fcf4e114-3be8-48bc-9614-1116a7e0051c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.587s {{(pid=86228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:02:44 devstack cinder-volume[86228]: DEBUG cinder.manager [None req-fcf4e114-3be8-48bc-9614-1116a7e0051c None None] Notifying Schedulers of capabilities ... {{(pid=86228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:02:46 devstack cinder-volume[85954]: DEBUG dbcounter [-] [85954] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=85954) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:02:47 devstack cinder-volume[85954]: INFO oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] Caught SIGTERM, stopping children
Jul 03 01:02:47 devstack cinder-volume[85954]: DEBUG oslo_concurrency.lockutils [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] Acquiring lock "singleton_lock" {{(pid=85954) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 03 01:02:47 devstack cinder-volume[85954]: DEBUG oslo_concurrency.lockutils [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] Acquired lock "singleton_lock" {{(pid=85954) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 03 01:02:47 devstack cinder-volume[85954]: DEBUG oslo_concurrency.lockutils [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] Releasing lock "singleton_lock" {{(pid=85954) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 03 01:02:47 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] Stop services. {{(pid=85954) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Jul 03 01:02:47 devstack cinder-volume[85954]: DEBUG oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] Killing children. {{(pid=85954) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Jul 03 01:02:47 devstack cinder-volume[85954]: INFO oslo_service.backend._eventlet.service [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] Waiting on 1 children to exit
Jul 03 01:02:50 devstack cinder-volume[86228]: DEBUG dbcounter [-] [86228] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:02:50 devstack cinder-volume[86228]: DEBUG dbcounter [-] [86228] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=86228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:02:52 devstack cinder-volume[86228]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting
Jul 03 01:02:52 devstack cinder-volume[86650]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jul 03 01:02:52 devstack cinder-volume[86650]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 03 01:02:52 devstack cinder-volume[86650]: we strongly recommend against using it for new projects.
Jul 03 01:02:52 devstack cinder-volume[86650]: If you are already using Eventlet, we recommend migrating to a different
Jul 03 01:02:52 devstack cinder-volume[86650]: framework.  For more detail see
Jul 03 01:02:52 devstack cinder-volume[86650]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 03 01:02:52 devstack cinder-volume[86650]:   import eventlet  # noqa
Jul 03 01:02:52 devstack cinder-volume[86228]: DEBUG oslo_concurrency.lockutils [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] Acquiring lock "singleton_lock" {{(pid=86228) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 03 01:02:52 devstack cinder-volume[86228]: DEBUG oslo_concurrency.lockutils [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] Acquired lock "singleton_lock" {{(pid=86228) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 03 01:02:52 devstack cinder-volume[86228]: DEBUG oslo_concurrency.lockutils [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] Releasing lock "singleton_lock" {{(pid=86228) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 03 01:02:52 devstack cinder-volume[86228]: WARNING amqp [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 03 01:02:52 devstack cinder-volume[86228]: WARNING amqp [None req-55af7a75-4510-4ced-8065-2faf901cdd84 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 03 01:02:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86650) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 03 01:02:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86650) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 03 01:02:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86650) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 03 01:02:55 devstack cinder-volume[86650]: INFO dbcounter [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] Registered counter for database cinder
Jul 03 01:02:55 devstack cinder-volume[86650]: DEBUG oslo_db.sqlalchemy.engines [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86650) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writer thread running {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 03 01:02:56 devstack cinder-volume[86650]: INFO cinder.rpc [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jul 03 01:02:56 devstack cinder-volume[86650]: INFO cinder.rpc [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_db.sqlalchemy.engines [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86650) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 03 01:02:56 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] Determined volume DB was empty at startup.
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86650) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jul 03 01:02:56 devstack cinder-volume[86650]: WARNING stevedore.named [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 03 01:02:56 devstack cinder-volume[86650]: WARNING castellan.key_manager [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 03 01:02:56 devstack cinder-volume[86650]: WARNING cinder.keymgr.conf_key_mgr [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 03 01:02:56 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] Image-volume cache disabled for host devstack@QuobyteHD.
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_db.sqlalchemy.engines [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86650) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 03 01:02:56 devstack cinder-volume[86650]: INFO oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] Starting 1 workers
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] Started child 86891 {{(pid=86650) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] Full set of CONF: {{(pid=86650) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] ******************************************************************************** {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] Configuration options gathered from: {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] ================================================================================ {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] allow_availability_zone_fallback = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] allow_compression_on_image_upload = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] allowed_direct_url_schemes     = [] {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] api_rate_limit                 = True {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] auth_strategy                  = keystone {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_availability_zone      = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_host                   = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_name                   = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_stats_polling_interval = 60 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backup_api_class               = cinder.backup.api.API {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backup_name_template           = backup-%s {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backup_use_same_host           = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backup_use_temp_snapshot       = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] chap_password                  = **** {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] chap_username                  =  {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86891]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] cinder_internal_tenant_project_id = ca895bd40bcb4a719e595432ed69a23c {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] cinder_internal_tenant_user_id = 144d173bcacc4401bb970270b629174f {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] cluster                        = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] compression_format             = gzip {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] compute_api_class              = cinder.compute.nova.API {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] config_dir                     = [] {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] config_source                  = [] {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] control_exchange               = openstack {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] debug                          = True {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] default_availability_zone      = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] default_group_type             = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] default_volume_type            = QuobyteHD {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] disk_geometry                  = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] driver_client_cert             = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] driver_client_cert_key         = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] driver_data_namespace          = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] driver_ssl_cert_path           = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] driver_ssl_cert_verify         = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] driver_use_ssl                 = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] enable_new_services            = True {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] enable_unsupported_driver      = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] enabled_backends               = ['QuobyteHD'] {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] enforce_multipath_for_image_xfer = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] filter_function                = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] glance_api_insecure            = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] glance_api_servers             = ['http://192.168.122.176/image'] {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] glance_api_ssl_compression     = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] glance_ca_certificates_file    = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] glance_catalog_info            = image:glance:publicURL {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] glance_certfile                = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] glance_keyfile                 = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] glance_num_retries             = 3 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] glance_request_timeout         = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] goodness_function              = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] graceful_shutdown_timeout      = 5 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] group_api_class                = cinder.group.api.API {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] host                           = devstack {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] image_compress_on_upload       = True {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] image_conversion_address_space_limit = 1 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] image_conversion_cpu_limit     = 60 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] image_conversion_disable       = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] image_upload_use_cinder_backend = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] image_upload_use_internal_tenant = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] image_volume_cache_enabled     = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] image_volume_cache_max_count   = 0 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] image_volume_cache_max_size_gb = 0 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] init_host_max_objects_retrieval = 0 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] instance_format                = [instance: %(uuid)s]  {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] iscsi_target_flags             =  {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] iscsi_write_cache              = on {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] iser_helper                    = tgtadm {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] iser_ip_address                = 192.168.122.176 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] iser_port                      = 3260 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] log_color                      = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] log_config_append              = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] log_dir                        = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] log_file                       = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] log_options                    = True {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] log_rotate_interval            = 1 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] log_rotate_interval_type       = days {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] log_rotation_type              = none {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] max_age                        = 0 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] max_logfile_count              = 30 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] max_logfile_size_mb            = 200 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] max_over_subscription_ratio    = 20.0 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] message_reap_interval          = 86400 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] message_ttl                    = 2592000 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] migration_create_volume_timeout_secs = 300 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] monkey_patch                   = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] monkey_patch_modules           = [] {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] my_ip                          = 192.168.122.176 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] no_snapshot_gb_quota           = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] num_iser_scan_tries            = 3 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] num_shell_tries                = 3 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] num_volume_device_scan_tries   = 3 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] nvmeof_conn_info_version       = 1 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] nvmet_ns_id                    = 10 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] nvmet_port_id                  = 1 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] osapi_max_limit                = 1000 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] osapi_volume_ext_list          = [] {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] osapi_volume_listen_port       = 8776 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] osapi_volume_use_ssl           = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] osapi_volume_workers           = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] per_volume_size_limit          = -1 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] periodic_fuzzy_delay           = 60 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] periodic_interval              = 60 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] public_endpoint                = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] publish_errors                 = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] quota_backup_gigabytes         = 1000 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] quota_backups                  = 10 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] quota_gigabytes                = 1000 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] quota_groups                   = 10 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] quota_snapshots                = 10 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] quota_volumes                  = 10 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] rate_limit_burst               = 0 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] rate_limit_except_level        = CRITICAL {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] rate_limit_interval            = 0 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] reinit_driver_count            = 3 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] replication_device             = **** {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] report_discard_supported       = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] report_interval                = 120 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] reservation_clean_interval     = 86400 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] reservation_expire             = 86400 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] reserved_image_namespaces      = [] {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] reserved_percentage            = 0 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] rpc_response_timeout           = 120 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] run_external_periodic_tasks    = True {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] scst_target_driver             = iscsi {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] scst_target_iqn_name           = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] service_down_time              = 720 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] shell_completion               = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] snapshot_name_template         = snapshot-%s {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] split_loggers                  = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] state_path                     = /opt/stack/data/cinder {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-94b56a5f-56db-4d22-93cb-d36fd8ca64c7 None None] Starting volume driver QuobyteDriver (1.1.14)
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] storage_availability_zone      = nova {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-94b56a5f-56db-4d22-93cb-d36fd8ca64c7 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86891) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] storage_protocol               = iSCSI {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] syslog_log_facility            = LOG_USER {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] target_helper                  = lioadm {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] target_ip_address              = 192.168.122.176 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] target_port                    = 3260 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] target_protocol                = iscsi {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] target_secondary_ip_addresses  = [] {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] trace_flags                    = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] transport_url                  = **** {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] until_refresh                  = 0 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] use_chap_auth                  = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] use_default_quota_class        = True {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] use_journal                    = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] use_json                       = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] use_multipath_for_image_xfer   = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] use_stderr                     = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] use_syslog                     = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] verify_glance_signatures       = enabled {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] volume_api_class               = cinder.volume.api.API {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] volume_backend_name            = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] volume_clear                   = zero {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] volume_clear_ionice            = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] volume_clear_size              = 0 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] volume_copy_bps_limit          = 0 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] volume_dd_blocksize            = 1M {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] volume_name_template           = volume-%s {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] volume_service_inithost_offload = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] volume_usage_audit_period      = month {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] zoning_mode                    = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] oslo_concurrency.disable_process_locking = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] keystone_authtoken.auth_section = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] keystone_authtoken.auth_type   = password {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] keystone_authtoken.auth_version = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] keystone_authtoken.cache       = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] keystone_authtoken.certfile    = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] keystone_authtoken.delay_auth_decision = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] keystone_authtoken.http_connect_timeout = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] keystone_authtoken.include_service_catalog = True {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] keystone_authtoken.insecure    = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] keystone_authtoken.interface   = public {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] keystone_authtoken.keyfile     = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] keystone_authtoken.memcache_password =  {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] keystone_authtoken.memcache_username =  {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] keystone_authtoken.region_name = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] keystone_authtoken.service_token_roles_required = True {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] keystone_authtoken.service_type = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] keystone_authtoken.token_cache_time = 300 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.176/identity {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] cache.backend                  = dogpile.cache.null {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] cache.backend_argument         = **** {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] cache.backend_expiration_time  = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] cache.config_prefix            = cache.oslo {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] cache.debug_cache_backend      = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] cache.enable_retry_client      = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] cache.enable_socket_keepalive  = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] cache.enabled                  = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] cache.expiration_time          = 600 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] cache.hashclient_retry_attempts = 2 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] cache.memcache_dead_retry      = 300 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] cache.memcache_pool_maxsize    = 10 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] cache.memcache_sasl_enabled    = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] cache.password                 = **** {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] cache.proxies                  = [] {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] cache.redis_db                 = 0 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] cache.redis_sentinel_service_name = mymaster {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] cache.redis_server             = localhost:6379 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] cache.retry_attempts           = 2 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] cache.retry_delay              = 0.0 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] cache.socket_keepalive_count   = 1 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] cache.socket_keepalive_idle    = 1 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] cache.socket_keepalive_interval = 1 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] cache.socket_timeout           = 1.0 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] cache.tls_allowed_ciphers      = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] cache.tls_cafile               = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] cache.tls_certfile             = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] cache.tls_enabled              = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] cache.tls_keyfile              = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] cache.username                 = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] coordination.backend_url       = **** {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] database.asyncio_connection    = **** {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] database.asyncio_slave_connection = **** {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] database.backend               = sqlalchemy {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] database.connection            = **** {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] database.connection_debug      = 0 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] database.connection_parameters =  {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] database.connection_recycle_time = 3600 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] database.connection_trace      = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] database.db_inc_retry_interval = True {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] database.db_max_retries        = 20 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] database.db_max_retry_interval = 10 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] database.db_retry_interval     = 1 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] database.max_overflow          = 50 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] database.max_pool_size         = 5 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] database.max_retries           = 10 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] database.mysql_wsrep_sync_wait = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] database.pool_timeout          = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] database.retry_interval        = 10 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] database.slave_connection      = **** {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] database.sqlite_synchronous    = True {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] database.synchronous_reader    = True {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] database.use_db_reconnect      = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] profiler.connection_string     = messaging:// {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] profiler.enabled               = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] profiler.es_doc_type           = notification {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] profiler.es_scroll_size        = 10000 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] profiler.es_scroll_time        = 2m {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] profiler.filter_error_trace    = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] profiler.hmac_keys             = **** {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] profiler.sentinel_service_name = mymaster {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] profiler.socket_timeout        = 0.1 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] profiler.trace_requests        = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] profiler.trace_sqlalchemy      = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] profiler_jaeger.process_tags   = {} {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] profiler_jaeger.service_name_prefix = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] profiler_otlp.service_name_prefix = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] oslo_policy.enforce_new_defaults = True {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] oslo_policy.enforce_scope      = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] oslo_policy.policy_default_rule = default {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] oslo_policy.policy_file        = policy.yaml {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] privsep_osbrick.group          = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] privsep_osbrick.helper_command = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] privsep_osbrick.user           = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] cinder_sys_admin.group         = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] cinder_sys_admin.helper_command = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] cinder_sys_admin.user          = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] service_user.auth_section      = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] service_user.auth_type         = password {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] service_user.cafile            = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] service_user.certfile          = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] service_user.collect_timing    = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] service_user.insecure          = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] service_user.keyfile           = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] service_user.send_service_user_token = True {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] service_user.split_loggers     = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] service_user.timeout           = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] glance.auth_section            = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] glance.auth_type               = password {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] glance.certfile                = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] glance.collect_timing          = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] glance.insecure                = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] glance.keyfile                 = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] glance.region_name             = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] glance.split_loggers           = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] glance.timeout                 = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.backend_availability_zone = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-94b56a5f-56db-4d22-93cb-d36fd8ca64c7 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86891) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.chap_password = **** {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.chap_username =  {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.disk_geometry = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.driver_client_cert = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.driver_client_cert_key = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.quobyte [None req-94b56a5f-56db-4d22-93cb-d36fd8ca64c7 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.driver_data_namespace = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.quobyte [None req-94b56a5f-56db-4d22-93cb-d36fd8ca64c7 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.driver_use_ssl = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.enable_unsupported_driver = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.extra_capabilities = {} {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-94b56a5f-56db-4d22-93cb-d36fd8ca64c7 None None] Running cmd (subprocess): mount.quobyte {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.filter_function = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.goodness_function = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.iscsi_target_flags =  {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.iscsi_write_cache = on {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.iser_helper   = tgtadm {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.iser_ip_address = 192.168.122.176 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.iser_port     = 3260 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.nas_host      =  {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.nas_login     = admin {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.nas_mount_options = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.nas_password  = **** {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.nas_private_key =  {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.nas_share_path =  {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.num_shell_tries = 3 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.nvmet_port_id = 1 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.quobyte_client_cfg = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.quobyte_volume_url = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.replication_device = **** {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.report_discard_supported = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.reserved_percentage = 0 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.scst_target_driver = iscsi {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.scst_target_iqn_name = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.storage_protocol = iSCSI {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.target_helper = tgtadm {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.target_ip_address = 192.168.122.176 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.target_port   = 3260 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.target_protocol = iscsi {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.trace_flags   = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.unique_fqdn_network = True {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.use_chap_auth = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.volume_backend_name = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.volume_clear  = zero {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.volume_clear_ionice = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.volume_clear_size = 0 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] oslo_reports.file_event_handler = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] oslo_reports.log_dir           = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.backend_availability_zone = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.backend_host         = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.chap_password        = **** {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.chap_username        = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.chiscsi_conf         = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.disk_geometry        = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.driver_client_cert   = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.driver_client_cert_key = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.driver_data_namespace = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.driver_use_ssl       = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.extra_capabilities   = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.filter_function      = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.goodness_function    = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.iser_helper          = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.iser_ip_address      = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.iser_port            = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.iser_target_prefix   = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.nas_host             = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.nas_login            = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.nas_mount_options    = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.nas_password         = **** {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.nas_private_key      = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.nas_share_path       = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.nas_ssh_port         = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.num_shell_tries      = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.nvmet_port_id        = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.replication_device   = **** {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.report_discard_supported = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.reserved_percentage  = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.scst_target_driver   = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.storage_protocol     = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.target_helper        = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.target_ip_address    = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.target_port          = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.target_prefix        = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.target_protocol      = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.trace_flags          = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.use_chap_auth        = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.volume_clear         = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.volume_clear_size    = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] QuobyteHD.volumes_dir          = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack quobyte-client[86896]: Reading configuration file: /etc/quobyte/client.cfg
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack quobyte-client[86896]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-94b56a5f-56db-4d22-93cb-d36fd8ca64c7 None None] CMD "mount.quobyte" returned: 1 in 0.056s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-94b56a5f-56db-4d22-93cb-d36fd8ca64c7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-94b56a5f-56db-4d22-93cb-d36fd8ca64c7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-94b56a5f-56db-4d22-93cb-d36fd8ca64c7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] oslo_messaging_rabbit.ssl      = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-94b56a5f-56db-4d22-93cb-d36fd8ca64c7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] oslo_messaging_notifications.driver = [] {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-94b56a5f-56db-4d22-93cb-d36fd8ca64c7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] oslo_messaging_notifications.retry = -1 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-94b56a5f-56db-4d22-93cb-d36fd8ca64c7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] oslo_messaging_notifications.transport_url = **** {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] key_manager.fixed_key          = **** {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] barbican.barbican_api_version  = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] barbican.barbican_endpoint     = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] barbican.barbican_endpoint_type = public {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] barbican.barbican_region_name  = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] barbican.cafile                = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] barbican.certfile              = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] barbican.collect_timing        = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] barbican.insecure              = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] barbican.keyfile               = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] barbican.number_of_retries     = 60 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] barbican.retry_delay           = 1 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] barbican.send_service_user_token = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] barbican.split_loggers         = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] barbican.timeout               = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] barbican.verify_ssl            = True {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] barbican.verify_ssl_path       = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] barbican_service_user.auth_section = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] barbican_service_user.auth_type = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] barbican_service_user.cafile   = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] barbican_service_user.certfile = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] barbican_service_user.collect_timing = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] barbican_service_user.insecure = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] barbican_service_user.keyfile  = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] barbican_service_user.split_loggers = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] barbican_service_user.timeout  = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] vault.approle_role_id          = **** {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] vault.approle_secret_id        = **** {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] vault.kv_mountpoint            = secret {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] vault.kv_path                  = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] vault.kv_version               = 2 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] vault.namespace                = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] vault.root_token_id            = **** {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] vault.ssl_ca_crt_file          = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] vault.timeout                  = 60.0 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] vault.use_ssl                  = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 01:02:56 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-5cf1e17b-8ab5-4373-932f-55ed788af19b None None] ******************************************************************************** {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jul 03 01:02:56 devstack sudo[86897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:02:56 devstack sudo[86897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:02:57 devstack sudo[86897]: pam_unix(sudo:session): session closed for user root
Jul 03 01:02:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-94b56a5f-56db-4d22-93cb-d36fd8ca64c7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.651s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:02:57 devstack cinder-volume[86891]: INFO cinder.volume.driver [None req-94b56a5f-56db-4d22-93cb-d36fd8ca64c7 None None] Driver hasn't implemented _init_vendor_properties()
Jul 03 01:02:57 devstack cinder-volume[86891]: DEBUG cinder.volume.driver [None req-94b56a5f-56db-4d22-93cb-d36fd8ca64c7 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.75777053833, 'free_capacity_gb': 1775.75777053833, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86891) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jul 03 01:02:57 devstack cinder-volume[86891]: DEBUG oslo_db.sqlalchemy.engines [None req-94b56a5f-56db-4d22-93cb-d36fd8ca64c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86891) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 03 01:02:57 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writer thread running {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 03 01:02:57 devstack cinder-volume[86891]: DEBUG cinder.db.api [None req-94b56a5f-56db-4d22-93cb-d36fd8ca64c7 None None] Building query based on filter {{(pid=86891) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jul 03 01:02:57 devstack cinder-volume[86891]: DEBUG cinder.image.image_utils [None req-94b56a5f-56db-4d22-93cb-d36fd8ca64c7 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86891) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jul 03 01:02:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-94b56a5f-56db-4d22-93cb-d36fd8ca64c7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:02:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-94b56a5f-56db-4d22-93cb-d36fd8ca64c7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:02:57 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-94b56a5f-56db-4d22-93cb-d36fd8ca64c7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:02:57 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-94b56a5f-56db-4d22-93cb-d36fd8ca64c7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:02:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-94b56a5f-56db-4d22-93cb-d36fd8ca64c7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:02:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-94b56a5f-56db-4d22-93cb-d36fd8ca64c7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:02:57 devstack cinder-volume[86891]: INFO cinder.keymgr.migration [None req-3ad98e18-d245-42cc-9bcf-0ec72c77fdaf None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jul 03 01:02:57 devstack sudo[86902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:02:57 devstack sudo[86902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:02:58 devstack sudo[86902]: pam_unix(sudo:session): session closed for user root
Jul 03 01:02:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-94b56a5f-56db-4d22-93cb-d36fd8ca64c7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.694s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:02:58 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-94b56a5f-56db-4d22-93cb-d36fd8ca64c7 None None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:02:58 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-94b56a5f-56db-4d22-93cb-d36fd8ca64c7 None None] Driver initialization completed successfully.
Jul 03 01:02:58 devstack cinder-volume[86891]: INFO cinder.manager [None req-94b56a5f-56db-4d22-93cb-d36fd8ca64c7 None None] Initiating service 3 cleanup
Jul 03 01:02:58 devstack cinder-volume[86891]: INFO cinder.manager [None req-94b56a5f-56db-4d22-93cb-d36fd8ca64c7 None None] Service 3 cleanup completed.
Jul 03 01:02:58 devstack cinder-volume[86891]: DEBUG cinder.service [None req-94b56a5f-56db-4d22-93cb-d36fd8ca64c7 None None] Creating RPC server for service cinder-volume {{(pid=86891) start /opt/stack/cinder/cinder/service.py:231}}
Jul 03 01:02:58 devstack cinder-volume[86891]: DEBUG cinder.service [None req-94b56a5f-56db-4d22-93cb-d36fd8ca64c7 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86891) start /opt/stack/cinder/cinder/service.py:237}}
Jul 03 01:02:58 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-94b56a5f-56db-4d22-93cb-d36fd8ca64c7 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Jul 03 01:02:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-94b56a5f-56db-4d22-93cb-d36fd8ca64c7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:02:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-94b56a5f-56db-4d22-93cb-d36fd8ca64c7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:02:58 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-94b56a5f-56db-4d22-93cb-d36fd8ca64c7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:02:58 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-94b56a5f-56db-4d22-93cb-d36fd8ca64c7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:02:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-94b56a5f-56db-4d22-93cb-d36fd8ca64c7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:02:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-94b56a5f-56db-4d22-93cb-d36fd8ca64c7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:02:58 devstack sudo[86938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:02:58 devstack sudo[86938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:02:58 devstack sudo[86938]: pam_unix(sudo:session): session closed for user root
Jul 03 01:02:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-94b56a5f-56db-4d22-93cb-d36fd8ca64c7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.597s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:02:58 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-94b56a5f-56db-4d22-93cb-d36fd8ca64c7 None None] Driver post RPC initialization completed successfully.
Jul 03 01:03:01 devstack cinder-volume[86891]: DEBUG oslo_service.periodic_task [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running periodic task VolumeManager._thread_info {{(pid=86891) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 01:03:01 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] thread count: 6 {{(pid=86891) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 01:03:01 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] thread info: [<_MainThread(MainThread, started 136731296534656)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136731184953280)>, <Thread(Thread-3 (stat_writer), started daemon 136731184058816)>, <Thread(Rabbit-heartbeat, started daemon 136731184846080)>, <Thread(Thread-5 (_runner), started daemon 136731182936576)>, <Thread(Thread-7 (_runner), started daemon 136731182954944)>] {{(pid=86891) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 01:03:06 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:03:08 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:03:08 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:SELECT=2 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:03:56 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-1eebbadf-5fb7-4eab-9f3e-7086c3a120ab tempest-TaggedAttachmentsTest-1605372168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:03:56 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1eebbadf-5fb7-4eab-9f3e-7086c3a120ab tempest-TaggedAttachmentsTest-1605372168 None] Flow 'volume_create_manager' (13285db5-d319-4235-82c3-e3b783bd12c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:03:56 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1eebbadf-5fb7-4eab-9f3e-7086c3a120ab tempest-TaggedAttachmentsTest-1605372168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a13bc7c-9bc2-4fac-8958-968a7495789e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:03:56 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1eebbadf-5fb7-4eab-9f3e-7086c3a120ab tempest-TaggedAttachmentsTest-1605372168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a13bc7c-9bc2-4fac-8958-968a7495789e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:03:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1568550055',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=551b110b-7ad7-4e6a-a895-7e791760b443,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a0dc549f97d44889a39ec4967dacfa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:03:56Z,use_quota=True,user_id='28f8c17549654cf0bc7a295dd1668b8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:03:56 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1eebbadf-5fb7-4eab-9f3e-7086c3a120ab tempest-TaggedAttachmentsTest-1605372168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cff073c4-a331-4cd1-8d05-766f80060a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:03:56 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1eebbadf-5fb7-4eab-9f3e-7086c3a120ab tempest-TaggedAttachmentsTest-1605372168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cff073c4-a331-4cd1-8d05-766f80060a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:03:56 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1eebbadf-5fb7-4eab-9f3e-7086c3a120ab tempest-TaggedAttachmentsTest-1605372168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (222dc42e-7217-4cab-8a3c-08e11f2e6256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:03:56 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1eebbadf-5fb7-4eab-9f3e-7086c3a120ab tempest-TaggedAttachmentsTest-1605372168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (222dc42e-7217-4cab-8a3c-08e11f2e6256) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '551b110b-7ad7-4e6a-a895-7e791760b443', 'volume_name': 'volume-551b110b-7ad7-4e6a-a895-7e791760b443', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:03:56 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1eebbadf-5fb7-4eab-9f3e-7086c3a120ab tempest-TaggedAttachmentsTest-1605372168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5f5a77c-57d4-49dd-bbae-e31844da36ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:03:56 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1eebbadf-5fb7-4eab-9f3e-7086c3a120ab tempest-TaggedAttachmentsTest-1605372168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5f5a77c-57d4-49dd-bbae-e31844da36ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:03:56 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1eebbadf-5fb7-4eab-9f3e-7086c3a120ab tempest-TaggedAttachmentsTest-1605372168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c63bc427-7413-4194-9645-ba8b38ac4dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:03:56 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-1eebbadf-5fb7-4eab-9f3e-7086c3a120ab tempest-TaggedAttachmentsTest-1605372168 None] Volume 551b110b-7ad7-4e6a-a895-7e791760b443: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-551b110b-7ad7-4e6a-a895-7e791760b443', 'volume_size': 1}
Jul 03 01:03:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1eebbadf-5fb7-4eab-9f3e-7086c3a120ab tempest-TaggedAttachmentsTest-1605372168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:03:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1eebbadf-5fb7-4eab-9f3e-7086c3a120ab tempest-TaggedAttachmentsTest-1605372168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:03:56 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-1eebbadf-5fb7-4eab-9f3e-7086c3a120ab tempest-TaggedAttachmentsTest-1605372168 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:03:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1568550055',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=551b110b-7ad7-4e6a-a895-7e791760b443,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a0dc549f97d44889a39ec4967dacfa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:03:56Z,use_quota=True,user_id='28f8c17549654cf0bc7a295dd1668b8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:03:56 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-1eebbadf-5fb7-4eab-9f3e-7086c3a120ab tempest-TaggedAttachmentsTest-1605372168 None] Creating volume 551b110b-7ad7-4e6a-a895-7e791760b443 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:03:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1eebbadf-5fb7-4eab-9f3e-7086c3a120ab tempest-TaggedAttachmentsTest-1605372168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:03:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1eebbadf-5fb7-4eab-9f3e-7086c3a120ab tempest-TaggedAttachmentsTest-1605372168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:03:56 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-1eebbadf-5fb7-4eab-9f3e-7086c3a120ab tempest-TaggedAttachmentsTest-1605372168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:03:56 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-1eebbadf-5fb7-4eab-9f3e-7086c3a120ab tempest-TaggedAttachmentsTest-1605372168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:03:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1eebbadf-5fb7-4eab-9f3e-7086c3a120ab tempest-TaggedAttachmentsTest-1605372168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:03:56 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-1eebbadf-5fb7-4eab-9f3e-7086c3a120ab tempest-TaggedAttachmentsTest-1605372168 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:03:56 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-1eebbadf-5fb7-4eab-9f3e-7086c3a120ab tempest-TaggedAttachmentsTest-1605372168 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:03:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1eebbadf-5fb7-4eab-9f3e-7086c3a120ab tempest-TaggedAttachmentsTest-1605372168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-551b110b-7ad7-4e6a-a895-7e791760b443 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:03:56 devstack sudo[87257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-551b110b-7ad7-4e6a-a895-7e791760b443 1073741824
Jul 03 01:03:56 devstack sudo[87257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:03:57 devstack sudo[87257]: pam_unix(sudo:session): session closed for user root
Jul 03 01:03:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1eebbadf-5fb7-4eab-9f3e-7086c3a120ab tempest-TaggedAttachmentsTest-1605372168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-551b110b-7ad7-4e6a-a895-7e791760b443 1073741824" returned: 0 in 1.243s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:03:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1eebbadf-5fb7-4eab-9f3e-7086c3a120ab tempest-TaggedAttachmentsTest-1605372168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-551b110b-7ad7-4e6a-a895-7e791760b443 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:03:57 devstack sudo[87589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-551b110b-7ad7-4e6a-a895-7e791760b443
Jul 03 01:03:57 devstack sudo[87589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:03:58 devstack sudo[87589]: pam_unix(sudo:session): session closed for user root
Jul 03 01:03:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1eebbadf-5fb7-4eab-9f3e-7086c3a120ab tempest-TaggedAttachmentsTest-1605372168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-551b110b-7ad7-4e6a-a895-7e791760b443" returned: 0 in 1.118s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:03:58 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-1eebbadf-5fb7-4eab-9f3e-7086c3a120ab tempest-TaggedAttachmentsTest-1605372168 None] <== create_volume: return (2469ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:03:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1eebbadf-5fb7-4eab-9f3e-7086c3a120ab tempest-TaggedAttachmentsTest-1605372168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.474s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:03:58 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1eebbadf-5fb7-4eab-9f3e-7086c3a120ab tempest-TaggedAttachmentsTest-1605372168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c63bc427-7413-4194-9645-ba8b38ac4dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-551b110b-7ad7-4e6a-a895-7e791760b443', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:03:58 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1eebbadf-5fb7-4eab-9f3e-7086c3a120ab tempest-TaggedAttachmentsTest-1605372168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5d88c25-9dee-4edb-8d1e-7151dba9c122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:03:58 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-1eebbadf-5fb7-4eab-9f3e-7086c3a120ab tempest-TaggedAttachmentsTest-1605372168 None] Volume volume-551b110b-7ad7-4e6a-a895-7e791760b443 (551b110b-7ad7-4e6a-a895-7e791760b443): created successfully
Jul 03 01:03:58 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1eebbadf-5fb7-4eab-9f3e-7086c3a120ab tempest-TaggedAttachmentsTest-1605372168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5d88c25-9dee-4edb-8d1e-7151dba9c122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:03:58 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1eebbadf-5fb7-4eab-9f3e-7086c3a120ab tempest-TaggedAttachmentsTest-1605372168 None] Flow 'volume_create_manager' (13285db5-d319-4235-82c3-e3b783bd12c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:03:58 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-1eebbadf-5fb7-4eab-9f3e-7086c3a120ab tempest-TaggedAttachmentsTest-1605372168 None] Created volume successfully.
Jul 03 01:04:01 devstack cinder-volume[86891]: DEBUG oslo_service.periodic_task [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86891) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 01:04:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:04:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:04:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:04:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:04:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:04:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:04:01 devstack sudo[87723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:04:01 devstack sudo[87723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:04:02 devstack sudo[87723]: pam_unix(sudo:session): session closed for user root
Jul 03 01:04:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.914s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:04:02 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:04:02 devstack cinder-volume[86891]: DEBUG oslo_service.periodic_task [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running periodic task VolumeManager._thread_info {{(pid=86891) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 01:04:02 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] thread count: 6 {{(pid=86891) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 01:04:02 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] thread info: [<_MainThread(MainThread, started 136731296534656)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136731184953280)>, <Thread(Thread-3 (stat_writer), started daemon 136731184058816)>, <Thread(Rabbit-heartbeat, started daemon 136731184846080)>, <Thread(Thread-5 (_runner), started daemon 136731182936576)>, <Thread(Thread-7 (_runner), started daemon 136731182954944)>] {{(pid=86891) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 01:04:08 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:SELECT=2,cinder:UPDATE=5 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:04:08 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:SELECT=2,cinder:INSERT=1,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:04:31 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebbb16df-03ab-4fce-870f-d51d83cff536 tempest-ServerActionsTestOtherA-1545581072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:04:32 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ebbb16df-03ab-4fce-870f-d51d83cff536 tempest-ServerActionsTestOtherA-1545581072 None] Flow 'volume_create_manager' (7b02ac4c-28d8-4711-907d-d945a568c09d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:04:32 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ebbb16df-03ab-4fce-870f-d51d83cff536 tempest-ServerActionsTestOtherA-1545581072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (823c7fdf-a157-45a1-9b15-c0771bfcf405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:04:32 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ebbb16df-03ab-4fce-870f-d51d83cff536 tempest-ServerActionsTestOtherA-1545581072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (823c7fdf-a157-45a1-9b15-c0771bfcf405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:04:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-832315798',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0b3a101-3103-47df-a542-75640528e14a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='892396ed35994aabb77020ba0aa3537c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:04:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:04:32Z,use_quota=True,user_id='187783903b0846398ed09b22cb50ecb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:04:32 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ebbb16df-03ab-4fce-870f-d51d83cff536 tempest-ServerActionsTestOtherA-1545581072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da9a354d-dbc2-4c5b-8efa-23c00ee158c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:04:32 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ebbb16df-03ab-4fce-870f-d51d83cff536 tempest-ServerActionsTestOtherA-1545581072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da9a354d-dbc2-4c5b-8efa-23c00ee158c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:04:32 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ebbb16df-03ab-4fce-870f-d51d83cff536 tempest-ServerActionsTestOtherA-1545581072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65ff791e-34b6-49a3-8f2b-8b785167421a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:04:32 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ebbb16df-03ab-4fce-870f-d51d83cff536 tempest-ServerActionsTestOtherA-1545581072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65ff791e-34b6-49a3-8f2b-8b785167421a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0b3a101-3103-47df-a542-75640528e14a', 'volume_name': 'volume-b0b3a101-3103-47df-a542-75640528e14a', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:04:32 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ebbb16df-03ab-4fce-870f-d51d83cff536 tempest-ServerActionsTestOtherA-1545581072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc9253e1-d4fb-49d5-b911-d547aa451087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:04:32 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ebbb16df-03ab-4fce-870f-d51d83cff536 tempest-ServerActionsTestOtherA-1545581072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc9253e1-d4fb-49d5-b911-d547aa451087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:04:32 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ebbb16df-03ab-4fce-870f-d51d83cff536 tempest-ServerActionsTestOtherA-1545581072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (277b48cc-2514-4369-9b56-28794528ba78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:04:32 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-ebbb16df-03ab-4fce-870f-d51d83cff536 tempest-ServerActionsTestOtherA-1545581072 None] Volume b0b3a101-3103-47df-a542-75640528e14a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0b3a101-3103-47df-a542-75640528e14a', 'volume_size': 1}
Jul 03 01:04:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-ebbb16df-03ab-4fce-870f-d51d83cff536 tempest-ServerActionsTestOtherA-1545581072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:04:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-ebbb16df-03ab-4fce-870f-d51d83cff536 tempest-ServerActionsTestOtherA-1545581072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:04:32 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-ebbb16df-03ab-4fce-870f-d51d83cff536 tempest-ServerActionsTestOtherA-1545581072 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:04:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-832315798',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0b3a101-3103-47df-a542-75640528e14a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='892396ed35994aabb77020ba0aa3537c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:04:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:04:32Z,use_quota=True,user_id='187783903b0846398ed09b22cb50ecb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:04:32 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-ebbb16df-03ab-4fce-870f-d51d83cff536 tempest-ServerActionsTestOtherA-1545581072 None] Creating volume b0b3a101-3103-47df-a542-75640528e14a {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:04:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-ebbb16df-03ab-4fce-870f-d51d83cff536 tempest-ServerActionsTestOtherA-1545581072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:04:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-ebbb16df-03ab-4fce-870f-d51d83cff536 tempest-ServerActionsTestOtherA-1545581072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:04:32 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-ebbb16df-03ab-4fce-870f-d51d83cff536 tempest-ServerActionsTestOtherA-1545581072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:04:32 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-ebbb16df-03ab-4fce-870f-d51d83cff536 tempest-ServerActionsTestOtherA-1545581072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:04:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-ebbb16df-03ab-4fce-870f-d51d83cff536 tempest-ServerActionsTestOtherA-1545581072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:04:32 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-ebbb16df-03ab-4fce-870f-d51d83cff536 tempest-ServerActionsTestOtherA-1545581072 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:04:32 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-ebbb16df-03ab-4fce-870f-d51d83cff536 tempest-ServerActionsTestOtherA-1545581072 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:04:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-ebbb16df-03ab-4fce-870f-d51d83cff536 tempest-ServerActionsTestOtherA-1545581072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b0b3a101-3103-47df-a542-75640528e14a 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:04:32 devstack sudo[88022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b0b3a101-3103-47df-a542-75640528e14a 1073741824
Jul 03 01:04:32 devstack sudo[88022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:04:34 devstack sudo[88022]: pam_unix(sudo:session): session closed for user root
Jul 03 01:04:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-ebbb16df-03ab-4fce-870f-d51d83cff536 tempest-ServerActionsTestOtherA-1545581072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b0b3a101-3103-47df-a542-75640528e14a 1073741824" returned: 0 in 1.970s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:04:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-ebbb16df-03ab-4fce-870f-d51d83cff536 tempest-ServerActionsTestOtherA-1545581072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b0b3a101-3103-47df-a542-75640528e14a {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:04:34 devstack sudo[88033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b0b3a101-3103-47df-a542-75640528e14a
Jul 03 01:04:34 devstack sudo[88033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:04:35 devstack sudo[88033]: pam_unix(sudo:session): session closed for user root
Jul 03 01:04:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-ebbb16df-03ab-4fce-870f-d51d83cff536 tempest-ServerActionsTestOtherA-1545581072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b0b3a101-3103-47df-a542-75640528e14a" returned: 0 in 1.222s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:04:35 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-ebbb16df-03ab-4fce-870f-d51d83cff536 tempest-ServerActionsTestOtherA-1545581072 None] <== create_volume: return (3289ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:04:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-ebbb16df-03ab-4fce-870f-d51d83cff536 tempest-ServerActionsTestOtherA-1545581072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.294s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:04:35 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ebbb16df-03ab-4fce-870f-d51d83cff536 tempest-ServerActionsTestOtherA-1545581072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (277b48cc-2514-4369-9b56-28794528ba78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0b3a101-3103-47df-a542-75640528e14a', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:04:35 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ebbb16df-03ab-4fce-870f-d51d83cff536 tempest-ServerActionsTestOtherA-1545581072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84c0b434-0962-414e-a2a0-125919ff61c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:04:35 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-ebbb16df-03ab-4fce-870f-d51d83cff536 tempest-ServerActionsTestOtherA-1545581072 None] Volume volume-b0b3a101-3103-47df-a542-75640528e14a (b0b3a101-3103-47df-a542-75640528e14a): created successfully
Jul 03 01:04:35 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ebbb16df-03ab-4fce-870f-d51d83cff536 tempest-ServerActionsTestOtherA-1545581072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84c0b434-0962-414e-a2a0-125919ff61c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:04:35 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ebbb16df-03ab-4fce-870f-d51d83cff536 tempest-ServerActionsTestOtherA-1545581072 None] Flow 'volume_create_manager' (7b02ac4c-28d8-4711-907d-d945a568c09d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:04:35 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-ebbb16df-03ab-4fce-870f-d51d83cff536 tempest-ServerActionsTestOtherA-1545581072 None] Created volume successfully.
Jul 03 01:04:45 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:SELECT=1,cinder:UPDATE=2,cinder:INSERT=1 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:04:45 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:SELECT=3,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:04:50 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-085c93ca-cae1-428e-a576-df00e10523ea tempest-ServersNegativeTestJSON-740556278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:04:50 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-085c93ca-cae1-428e-a576-df00e10523ea tempest-ServersNegativeTestJSON-740556278 None] Flow 'volume_create_manager' (f9743edc-a486-48f6-a946-8cd11d0bdd74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:04:50 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-085c93ca-cae1-428e-a576-df00e10523ea tempest-ServersNegativeTestJSON-740556278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b5c8c2c-92b2-4959-b71e-8bb2d32a9a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:04:50 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-085c93ca-cae1-428e-a576-df00e10523ea tempest-ServersNegativeTestJSON-740556278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b5c8c2c-92b2-4959-b71e-8bb2d32a9a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-640977488',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6cdb3c4-7ca3-4255-bd8c-52d1730a972d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df4f9a4a42e44798a798fac41fbaea51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:04:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:04:51Z,use_quota=True,user_id='fe8be564e46045fd8a540468a1f90b23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:04:50 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-085c93ca-cae1-428e-a576-df00e10523ea tempest-ServersNegativeTestJSON-740556278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a65502f0-a4e6-4c38-b35f-763db302d2d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:04:50 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-085c93ca-cae1-428e-a576-df00e10523ea tempest-ServersNegativeTestJSON-740556278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a65502f0-a4e6-4c38-b35f-763db302d2d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:04:50 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-085c93ca-cae1-428e-a576-df00e10523ea tempest-ServersNegativeTestJSON-740556278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33d26c42-2f75-43d6-a9f7-2533f87a32b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:04:50 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-085c93ca-cae1-428e-a576-df00e10523ea tempest-ServersNegativeTestJSON-740556278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33d26c42-2f75-43d6-a9f7-2533f87a32b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6cdb3c4-7ca3-4255-bd8c-52d1730a972d', 'volume_name': 'volume-e6cdb3c4-7ca3-4255-bd8c-52d1730a972d', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:04:50 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-085c93ca-cae1-428e-a576-df00e10523ea tempest-ServersNegativeTestJSON-740556278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3138567f-25be-46f1-888d-e8125f59bcdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:04:50 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-085c93ca-cae1-428e-a576-df00e10523ea tempest-ServersNegativeTestJSON-740556278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3138567f-25be-46f1-888d-e8125f59bcdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:04:50 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-085c93ca-cae1-428e-a576-df00e10523ea tempest-ServersNegativeTestJSON-740556278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ebb4178-60da-42c8-aa49-a3ee2abd9c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:04:50 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-085c93ca-cae1-428e-a576-df00e10523ea tempest-ServersNegativeTestJSON-740556278 None] Volume e6cdb3c4-7ca3-4255-bd8c-52d1730a972d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6cdb3c4-7ca3-4255-bd8c-52d1730a972d', 'volume_size': 1}
Jul 03 01:04:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-085c93ca-cae1-428e-a576-df00e10523ea tempest-ServersNegativeTestJSON-740556278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:04:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-085c93ca-cae1-428e-a576-df00e10523ea tempest-ServersNegativeTestJSON-740556278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:04:50 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-085c93ca-cae1-428e-a576-df00e10523ea tempest-ServersNegativeTestJSON-740556278 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-640977488',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6cdb3c4-7ca3-4255-bd8c-52d1730a972d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df4f9a4a42e44798a798fac41fbaea51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:04:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:04:51Z,use_quota=True,user_id='fe8be564e46045fd8a540468a1f90b23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:04:50 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-085c93ca-cae1-428e-a576-df00e10523ea tempest-ServersNegativeTestJSON-740556278 None] Creating volume e6cdb3c4-7ca3-4255-bd8c-52d1730a972d {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:04:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-085c93ca-cae1-428e-a576-df00e10523ea tempest-ServersNegativeTestJSON-740556278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:04:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-085c93ca-cae1-428e-a576-df00e10523ea tempest-ServersNegativeTestJSON-740556278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:04:50 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-085c93ca-cae1-428e-a576-df00e10523ea tempest-ServersNegativeTestJSON-740556278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:04:50 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-085c93ca-cae1-428e-a576-df00e10523ea tempest-ServersNegativeTestJSON-740556278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:04:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-085c93ca-cae1-428e-a576-df00e10523ea tempest-ServersNegativeTestJSON-740556278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:04:50 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-085c93ca-cae1-428e-a576-df00e10523ea tempest-ServersNegativeTestJSON-740556278 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:04:50 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-085c93ca-cae1-428e-a576-df00e10523ea tempest-ServersNegativeTestJSON-740556278 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:04:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-085c93ca-cae1-428e-a576-df00e10523ea tempest-ServersNegativeTestJSON-740556278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e6cdb3c4-7ca3-4255-bd8c-52d1730a972d 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:04:50 devstack sudo[88129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e6cdb3c4-7ca3-4255-bd8c-52d1730a972d 1073741824
Jul 03 01:04:50 devstack sudo[88129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:04:51 devstack sudo[88129]: pam_unix(sudo:session): session closed for user root
Jul 03 01:04:51 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-085c93ca-cae1-428e-a576-df00e10523ea tempest-ServersNegativeTestJSON-740556278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e6cdb3c4-7ca3-4255-bd8c-52d1730a972d 1073741824" returned: 0 in 1.048s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:04:51 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-085c93ca-cae1-428e-a576-df00e10523ea tempest-ServersNegativeTestJSON-740556278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e6cdb3c4-7ca3-4255-bd8c-52d1730a972d {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:04:51 devstack sudo[88134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e6cdb3c4-7ca3-4255-bd8c-52d1730a972d
Jul 03 01:04:51 devstack sudo[88134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:04:52 devstack sudo[88134]: pam_unix(sudo:session): session closed for user root
Jul 03 01:04:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-085c93ca-cae1-428e-a576-df00e10523ea tempest-ServersNegativeTestJSON-740556278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e6cdb3c4-7ca3-4255-bd8c-52d1730a972d" returned: 0 in 0.819s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:04:52 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-085c93ca-cae1-428e-a576-df00e10523ea tempest-ServersNegativeTestJSON-740556278 None] <== create_volume: return (1917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:04:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-085c93ca-cae1-428e-a576-df00e10523ea tempest-ServersNegativeTestJSON-740556278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.920s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:04:52 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-085c93ca-cae1-428e-a576-df00e10523ea tempest-ServersNegativeTestJSON-740556278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ebb4178-60da-42c8-aa49-a3ee2abd9c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6cdb3c4-7ca3-4255-bd8c-52d1730a972d', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:04:52 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-085c93ca-cae1-428e-a576-df00e10523ea tempest-ServersNegativeTestJSON-740556278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20886fe9-de37-4dd2-8d0e-1d81a9654053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:04:52 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-085c93ca-cae1-428e-a576-df00e10523ea tempest-ServersNegativeTestJSON-740556278 None] Volume volume-e6cdb3c4-7ca3-4255-bd8c-52d1730a972d (e6cdb3c4-7ca3-4255-bd8c-52d1730a972d): created successfully
Jul 03 01:04:52 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-085c93ca-cae1-428e-a576-df00e10523ea tempest-ServersNegativeTestJSON-740556278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20886fe9-de37-4dd2-8d0e-1d81a9654053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:04:52 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-085c93ca-cae1-428e-a576-df00e10523ea tempest-ServersNegativeTestJSON-740556278 None] Flow 'volume_create_manager' (f9743edc-a486-48f6-a946-8cd11d0bdd74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:04:52 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-085c93ca-cae1-428e-a576-df00e10523ea tempest-ServersNegativeTestJSON-740556278 None] Created volume successfully.
Jul 03 01:04:55 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f181d47-349c-4ecc-88b3-fdab43a3c5e8 tempest-ServersNegativeTestJSON-740556278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:04:55 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-0f181d47-349c-4ecc-88b3-fdab43a3c5e8 tempest-ServersNegativeTestJSON-740556278 None] Flow 'volume_create_manager' (3568b47f-c4c7-4e53-a868-a2b5380ed70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:04:55 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-0f181d47-349c-4ecc-88b3-fdab43a3c5e8 tempest-ServersNegativeTestJSON-740556278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a013086b-43a4-4e2c-aae9-b5b4cc155452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:04:55 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-0f181d47-349c-4ecc-88b3-fdab43a3c5e8 tempest-ServersNegativeTestJSON-740556278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a013086b-43a4-4e2c-aae9-b5b4cc155452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:04:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1434554353',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a53833ba-4b72-4fd3-961a-cb88d22166ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df4f9a4a42e44798a798fac41fbaea51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:04:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:04:55Z,use_quota=True,user_id='fe8be564e46045fd8a540468a1f90b23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:04:55 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-0f181d47-349c-4ecc-88b3-fdab43a3c5e8 tempest-ServersNegativeTestJSON-740556278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55c33c43-78e6-4e54-a2da-e1cd1c99229d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:04:55 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-0f181d47-349c-4ecc-88b3-fdab43a3c5e8 tempest-ServersNegativeTestJSON-740556278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55c33c43-78e6-4e54-a2da-e1cd1c99229d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:04:55 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-0f181d47-349c-4ecc-88b3-fdab43a3c5e8 tempest-ServersNegativeTestJSON-740556278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebf86775-c404-445b-852a-9f745f8d64f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:04:55 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-0f181d47-349c-4ecc-88b3-fdab43a3c5e8 tempest-ServersNegativeTestJSON-740556278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebf86775-c404-445b-852a-9f745f8d64f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a53833ba-4b72-4fd3-961a-cb88d22166ac', 'volume_name': 'volume-a53833ba-4b72-4fd3-961a-cb88d22166ac', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:04:55 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-0f181d47-349c-4ecc-88b3-fdab43a3c5e8 tempest-ServersNegativeTestJSON-740556278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73071bbc-d869-444d-b7fe-c8b0708fde97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:04:55 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-0f181d47-349c-4ecc-88b3-fdab43a3c5e8 tempest-ServersNegativeTestJSON-740556278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73071bbc-d869-444d-b7fe-c8b0708fde97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:04:55 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-0f181d47-349c-4ecc-88b3-fdab43a3c5e8 tempest-ServersNegativeTestJSON-740556278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4207a4c-0612-4711-a248-be85cf5e546a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:04:55 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-0f181d47-349c-4ecc-88b3-fdab43a3c5e8 tempest-ServersNegativeTestJSON-740556278 None] Volume a53833ba-4b72-4fd3-961a-cb88d22166ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a53833ba-4b72-4fd3-961a-cb88d22166ac', 'volume_size': 1}
Jul 03 01:04:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-0f181d47-349c-4ecc-88b3-fdab43a3c5e8 tempest-ServersNegativeTestJSON-740556278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:04:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-0f181d47-349c-4ecc-88b3-fdab43a3c5e8 tempest-ServersNegativeTestJSON-740556278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:04:55 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-0f181d47-349c-4ecc-88b3-fdab43a3c5e8 tempest-ServersNegativeTestJSON-740556278 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:04:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1434554353',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a53833ba-4b72-4fd3-961a-cb88d22166ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df4f9a4a42e44798a798fac41fbaea51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:04:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:04:55Z,use_quota=True,user_id='fe8be564e46045fd8a540468a1f90b23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:04:55 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-0f181d47-349c-4ecc-88b3-fdab43a3c5e8 tempest-ServersNegativeTestJSON-740556278 None] Creating volume a53833ba-4b72-4fd3-961a-cb88d22166ac {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:04:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-0f181d47-349c-4ecc-88b3-fdab43a3c5e8 tempest-ServersNegativeTestJSON-740556278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:04:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-0f181d47-349c-4ecc-88b3-fdab43a3c5e8 tempest-ServersNegativeTestJSON-740556278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:04:55 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-0f181d47-349c-4ecc-88b3-fdab43a3c5e8 tempest-ServersNegativeTestJSON-740556278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:04:55 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-0f181d47-349c-4ecc-88b3-fdab43a3c5e8 tempest-ServersNegativeTestJSON-740556278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:04:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-0f181d47-349c-4ecc-88b3-fdab43a3c5e8 tempest-ServersNegativeTestJSON-740556278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:04:55 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-0f181d47-349c-4ecc-88b3-fdab43a3c5e8 tempest-ServersNegativeTestJSON-740556278 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:04:55 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-0f181d47-349c-4ecc-88b3-fdab43a3c5e8 tempest-ServersNegativeTestJSON-740556278 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:04:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0f181d47-349c-4ecc-88b3-fdab43a3c5e8 tempest-ServersNegativeTestJSON-740556278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a53833ba-4b72-4fd3-961a-cb88d22166ac 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:04:55 devstack sudo[88145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a53833ba-4b72-4fd3-961a-cb88d22166ac 1073741824
Jul 03 01:04:55 devstack sudo[88145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:04:56 devstack sudo[88145]: pam_unix(sudo:session): session closed for user root
Jul 03 01:04:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0f181d47-349c-4ecc-88b3-fdab43a3c5e8 tempest-ServersNegativeTestJSON-740556278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a53833ba-4b72-4fd3-961a-cb88d22166ac 1073741824" returned: 0 in 1.147s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:04:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0f181d47-349c-4ecc-88b3-fdab43a3c5e8 tempest-ServersNegativeTestJSON-740556278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a53833ba-4b72-4fd3-961a-cb88d22166ac {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:04:56 devstack sudo[88160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a53833ba-4b72-4fd3-961a-cb88d22166ac
Jul 03 01:04:56 devstack sudo[88160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:04:57 devstack sudo[88160]: pam_unix(sudo:session): session closed for user root
Jul 03 01:04:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0f181d47-349c-4ecc-88b3-fdab43a3c5e8 tempest-ServersNegativeTestJSON-740556278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a53833ba-4b72-4fd3-961a-cb88d22166ac" returned: 0 in 0.890s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:04:57 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-0f181d47-349c-4ecc-88b3-fdab43a3c5e8 tempest-ServersNegativeTestJSON-740556278 None] <== create_volume: return (2100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:04:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-0f181d47-349c-4ecc-88b3-fdab43a3c5e8 tempest-ServersNegativeTestJSON-740556278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.106s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:04:57 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-0f181d47-349c-4ecc-88b3-fdab43a3c5e8 tempest-ServersNegativeTestJSON-740556278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4207a4c-0612-4711-a248-be85cf5e546a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a53833ba-4b72-4fd3-961a-cb88d22166ac', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:04:57 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-0f181d47-349c-4ecc-88b3-fdab43a3c5e8 tempest-ServersNegativeTestJSON-740556278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a84b54c5-f636-49fd-b888-61e6df140070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:04:57 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-0f181d47-349c-4ecc-88b3-fdab43a3c5e8 tempest-ServersNegativeTestJSON-740556278 None] Volume volume-a53833ba-4b72-4fd3-961a-cb88d22166ac (a53833ba-4b72-4fd3-961a-cb88d22166ac): created successfully
Jul 03 01:04:57 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-0f181d47-349c-4ecc-88b3-fdab43a3c5e8 tempest-ServersNegativeTestJSON-740556278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a84b54c5-f636-49fd-b888-61e6df140070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:04:57 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-0f181d47-349c-4ecc-88b3-fdab43a3c5e8 tempest-ServersNegativeTestJSON-740556278 None] Flow 'volume_create_manager' (3568b47f-c4c7-4e53-a868-a2b5380ed70d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:04:57 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-0f181d47-349c-4ecc-88b3-fdab43a3c5e8 tempest-ServersNegativeTestJSON-740556278 None] Created volume successfully.
Jul 03 01:04:59 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-b7857ee5-34fc-4a7b-8914-e36a4a6d1378 tempest-ServersNegativeTestJSON-740556278 None] Acquiring lock "cinder-a53833ba-4b72-4fd3-961a-cb88d22166ac-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:05:00 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-b7857ee5-34fc-4a7b-8914-e36a4a6d1378 tempest-ServersNegativeTestJSON-740556278 None] Lock "cinder-a53833ba-4b72-4fd3-961a-cb88d22166ac-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:05:00 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-b7857ee5-34fc-4a7b-8914-e36a4a6d1378 tempest-ServersNegativeTestJSON-740556278 None] Acquiring lock "cinder-quobyte-a53833ba-4b72-4fd3-961a-cb88d22166ac" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:05:00 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-b7857ee5-34fc-4a7b-8914-e36a4a6d1378 tempest-ServersNegativeTestJSON-740556278 None] Lock "cinder-quobyte-a53833ba-4b72-4fd3-961a-cb88d22166ac" acquired by "delete_volume" :: waited 0.017s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:05:00 devstack cinder-volume[86891]: INFO oslo.privsep.daemon [None req-b7857ee5-34fc-4a7b-8914-e36a4a6d1378 tempest-ServersNegativeTestJSON-740556278 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp9v06dh0s/privsep.sock']
Jul 03 01:05:00 devstack sudo[88223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp9v06dh0s/privsep.sock
Jul 03 01:05:00 devstack sudo[88223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:05:00 devstack cinder-volume[86891]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
Jul 03 01:05:00 devstack cinder-volume[86891]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 03 01:05:00 devstack cinder-volume[86891]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Jul 03 01:05:00 devstack cinder-volume[86891]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 03 01:05:00 devstack cinder-volume[86891]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Jul 03 01:05:00 devstack cinder-volume[86891]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Jul 03 01:05:00 devstack cinder-volume[86891]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 03 01:05:00 devstack cinder-volume[86891]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 03 01:05:00 devstack cinder-volume[86891]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
Jul 03 01:05:01 devstack cinder-volume[86891]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning:
Jul 03 01:05:01 devstack cinder-volume[86891]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 03 01:05:01 devstack cinder-volume[86891]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Jul 03 01:05:01 devstack cinder-volume[86891]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 03 01:05:01 devstack cinder-volume[86891]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Jul 03 01:05:01 devstack cinder-volume[86891]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Jul 03 01:05:01 devstack cinder-volume[86891]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 03 01:05:01 devstack cinder-volume[86891]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 03 01:05:01 devstack cinder-volume[86891]: WARNING oslo.privsep.daemon [-] privsep log:   __import__(import_str)
Jul 03 01:05:01 devstack cinder-volume[86891]: DEBUG oslo_service.periodic_task [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86891) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 01:05:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:05:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:05:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:05:01 devstack sudo[88223]: pam_unix(sudo:session): session closed for user root
Jul 03 01:05:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:05:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:05:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:05:01 devstack cinder-volume[86891]: INFO oslo.privsep.daemon [None req-b7857ee5-34fc-4a7b-8914-e36a4a6d1378 tempest-ServersNegativeTestJSON-740556278 None] Spawned new privsep daemon via rootwrap
Jul 03 01:05:01 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [None req-b7857ee5-34fc-4a7b-8914-e36a4a6d1378 tempest-ServersNegativeTestJSON-740556278 None] Accepted privsep connection to /tmp/tmp9v06dh0s/privsep.sock {{(pid=86891) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Jul 03 01:05:01 devstack cinder-volume[86891]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 03 01:05:01 devstack cinder-volume[86891]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 03 01:05:01 devstack cinder-volume[86891]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Jul 03 01:05:01 devstack cinder-volume[86891]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88230
Jul 03 01:05:01 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[576433d4-dc0c-4512-aae0-0fd4709a88f8]: (2,) {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:05:01 devstack sudo[88231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:05:01 devstack sudo[88231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:05:02 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18aa345-beea-4713-b97d-b7939c7e3bfa]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:05:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b7857ee5-34fc-4a7b-8914-e36a4a6d1378 tempest-ServersNegativeTestJSON-740556278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a53833ba-4b72-4fd3-961a-cb88d22166ac {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:05:02 devstack sudo[88237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a53833ba-4b72-4fd3-961a-cb88d22166ac
Jul 03 01:05:02 devstack sudo[88237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:05:03 devstack sudo[88231]: pam_unix(sudo:session): session closed for user root
Jul 03 01:05:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 1.219s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:05:03 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:05:03 devstack sudo[88237]: pam_unix(sudo:session): session closed for user root
Jul 03 01:05:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b7857ee5-34fc-4a7b-8914-e36a4a6d1378 tempest-ServersNegativeTestJSON-740556278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a53833ba-4b72-4fd3-961a-cb88d22166ac" returned: 0 in 1.549s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:05:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b7857ee5-34fc-4a7b-8914-e36a4a6d1378 tempest-ServersNegativeTestJSON-740556278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a53833ba-4b72-4fd3-961a-cb88d22166ac {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:05:03 devstack sudo[88245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a53833ba-4b72-4fd3-961a-cb88d22166ac
Jul 03 01:05:03 devstack sudo[88245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:05:04 devstack sudo[88245]: pam_unix(sudo:session): session closed for user root
Jul 03 01:05:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b7857ee5-34fc-4a7b-8914-e36a4a6d1378 tempest-ServersNegativeTestJSON-740556278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a53833ba-4b72-4fd3-961a-cb88d22166ac" returned: 0 in 1.171s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:05:04 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-b7857ee5-34fc-4a7b-8914-e36a4a6d1378 tempest-ServersNegativeTestJSON-740556278 None] Lock "cinder-quobyte-a53833ba-4b72-4fd3-961a-cb88d22166ac" released by "delete_volume" :: held 4.647s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:05:04 devstack cinder-volume[86891]: WARNING cinder.quota [None req-b7857ee5-34fc-4a7b-8914-e36a4a6d1378 tempest-ServersNegativeTestJSON-740556278 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jul 03 01:05:04 devstack cinder-volume[86891]: WARNING cinder.quota [None req-b7857ee5-34fc-4a7b-8914-e36a4a6d1378 tempest-ServersNegativeTestJSON-740556278 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jul 03 01:05:04 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-b7857ee5-34fc-4a7b-8914-e36a4a6d1378 tempest-ServersNegativeTestJSON-740556278 None] Created reservations ['19f6a287-1a51-405f-9016-5dcdfa2f0d91', '854ca0e1-7ed2-4ad2-bf10-14c932ca48a7', 'abcdc9d8-5054-4878-ac8c-0fd09efd0bfd', '518344ce-6f94-4a78-8c73-dba69c68fa05'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:05:05 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b7857ee5-34fc-4a7b-8914-e36a4a6d1378 tempest-ServersNegativeTestJSON-740556278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:05:05 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b7857ee5-34fc-4a7b-8914-e36a4a6d1378 tempest-ServersNegativeTestJSON-740556278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:05:05 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-b7857ee5-34fc-4a7b-8914-e36a4a6d1378 tempest-ServersNegativeTestJSON-740556278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:05:05 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-b7857ee5-34fc-4a7b-8914-e36a4a6d1378 tempest-ServersNegativeTestJSON-740556278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:05:05 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b7857ee5-34fc-4a7b-8914-e36a4a6d1378 tempest-ServersNegativeTestJSON-740556278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:05:05 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b7857ee5-34fc-4a7b-8914-e36a4a6d1378 tempest-ServersNegativeTestJSON-740556278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:05:05 devstack sudo[88285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:05:05 devstack sudo[88285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:05:05 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-f5605ed9-d273-407c-96e1-0f68409510be tempest-ServersNegativeTestJSON-740556278 None] Acquiring lock "cinder-e6cdb3c4-7ca3-4255-bd8c-52d1730a972d-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:05:05 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-f5605ed9-d273-407c-96e1-0f68409510be tempest-ServersNegativeTestJSON-740556278 None] Lock "cinder-e6cdb3c4-7ca3-4255-bd8c-52d1730a972d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:05:05 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-f5605ed9-d273-407c-96e1-0f68409510be tempest-ServersNegativeTestJSON-740556278 None] Acquiring lock "cinder-quobyte-e6cdb3c4-7ca3-4255-bd8c-52d1730a972d" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:05:05 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-f5605ed9-d273-407c-96e1-0f68409510be tempest-ServersNegativeTestJSON-740556278 None] Lock "cinder-quobyte-e6cdb3c4-7ca3-4255-bd8c-52d1730a972d" acquired by "delete_volume" :: waited 0.051s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:05:06 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef405f28-d5fe-4852-93a9-07936f4259b9]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:05:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f5605ed9-d273-407c-96e1-0f68409510be tempest-ServersNegativeTestJSON-740556278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e6cdb3c4-7ca3-4255-bd8c-52d1730a972d {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:05:06 devstack sudo[88300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e6cdb3c4-7ca3-4255-bd8c-52d1730a972d
Jul 03 01:05:06 devstack sudo[88300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:05:06 devstack sudo[88285]: pam_unix(sudo:session): session closed for user root
Jul 03 01:05:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b7857ee5-34fc-4a7b-8914-e36a4a6d1378 tempest-ServersNegativeTestJSON-740556278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 1.320s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:05:06 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-b7857ee5-34fc-4a7b-8914-e36a4a6d1378 tempest-ServersNegativeTestJSON-740556278 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:05:06 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-b7857ee5-34fc-4a7b-8914-e36a4a6d1378 tempest-ServersNegativeTestJSON-740556278 None] Deleted volume successfully.
Jul 03 01:05:06 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-b7857ee5-34fc-4a7b-8914-e36a4a6d1378 tempest-ServersNegativeTestJSON-740556278 None] Lock "cinder-a53833ba-4b72-4fd3-961a-cb88d22166ac-delete_volume" released by "delete_volume" :: held 6.413s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:05:07 devstack sudo[88300]: pam_unix(sudo:session): session closed for user root
Jul 03 01:05:07 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f5605ed9-d273-407c-96e1-0f68409510be tempest-ServersNegativeTestJSON-740556278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e6cdb3c4-7ca3-4255-bd8c-52d1730a972d" returned: 0 in 1.034s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:05:07 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f5605ed9-d273-407c-96e1-0f68409510be tempest-ServersNegativeTestJSON-740556278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e6cdb3c4-7ca3-4255-bd8c-52d1730a972d {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:05:07 devstack sudo[88307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e6cdb3c4-7ca3-4255-bd8c-52d1730a972d
Jul 03 01:05:07 devstack sudo[88307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:05:07 devstack sudo[88307]: pam_unix(sudo:session): session closed for user root
Jul 03 01:05:07 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f5605ed9-d273-407c-96e1-0f68409510be tempest-ServersNegativeTestJSON-740556278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e6cdb3c4-7ca3-4255-bd8c-52d1730a972d" returned: 0 in 0.890s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:05:07 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-f5605ed9-d273-407c-96e1-0f68409510be tempest-ServersNegativeTestJSON-740556278 None] Lock "cinder-quobyte-e6cdb3c4-7ca3-4255-bd8c-52d1730a972d" released by "delete_volume" :: held 1.989s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:05:08 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-f5605ed9-d273-407c-96e1-0f68409510be tempest-ServersNegativeTestJSON-740556278 None] Created reservations ['cc45dd4a-ea9a-4ed5-accf-32cdc616dc74', '1365d2bd-cb89-4f11-beff-1beea529a3e9', '2862450d-546a-4a3d-a2ec-c0c3041efc5e', 'a824c52d-db71-4268-9913-c1e255dde422'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:05:08 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f5605ed9-d273-407c-96e1-0f68409510be tempest-ServersNegativeTestJSON-740556278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:05:08 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f5605ed9-d273-407c-96e1-0f68409510be tempest-ServersNegativeTestJSON-740556278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:05:08 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-f5605ed9-d273-407c-96e1-0f68409510be tempest-ServersNegativeTestJSON-740556278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:05:08 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-f5605ed9-d273-407c-96e1-0f68409510be tempest-ServersNegativeTestJSON-740556278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:05:08 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f5605ed9-d273-407c-96e1-0f68409510be tempest-ServersNegativeTestJSON-740556278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:05:08 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f5605ed9-d273-407c-96e1-0f68409510be tempest-ServersNegativeTestJSON-740556278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:05:08 devstack sudo[88330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:05:08 devstack sudo[88330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:05:09 devstack sudo[88330]: pam_unix(sudo:session): session closed for user root
Jul 03 01:05:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f5605ed9-d273-407c-96e1-0f68409510be tempest-ServersNegativeTestJSON-740556278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 1.061s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:05:09 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-f5605ed9-d273-407c-96e1-0f68409510be tempest-ServersNegativeTestJSON-740556278 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:05:09 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-f5605ed9-d273-407c-96e1-0f68409510be tempest-ServersNegativeTestJSON-740556278 None] Deleted volume successfully.
Jul 03 01:05:09 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-f5605ed9-d273-407c-96e1-0f68409510be tempest-ServersNegativeTestJSON-740556278 None] Lock "cinder-e6cdb3c4-7ca3-4255-bd8c-52d1730a972d-delete_volume" released by "delete_volume" :: held 3.449s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:05:14 devstack cinder-volume[86891]: WARNING py.warnings [req-85902fe3-b673-4156-ad73-3c36e475a606 req-38212996-7130-475a-bbd2-377388ee3d7b tempest-TaggedAttachmentsTest-1605372168 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1".  Apply join condition(s) between each element to resolve.
Jul 03 01:05:14 devstack cinder-volume[86891]:   .first()
Jul 03 01:05:14 devstack cinder-volume[86891]: 
Jul 03 01:05:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-85902fe3-b673-4156-ad73-3c36e475a606 req-38212996-7130-475a-bbd2-377388ee3d7b tempest-TaggedAttachmentsTest-1605372168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:05:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-85902fe3-b673-4156-ad73-3c36e475a606 req-38212996-7130-475a-bbd2-377388ee3d7b tempest-TaggedAttachmentsTest-1605372168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:05:14 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a80702-03ab-4f1b-8d08-5cc18d477c3d]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:05:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-85902fe3-b673-4156-ad73-3c36e475a606 req-38212996-7130-475a-bbd2-377388ee3d7b tempest-TaggedAttachmentsTest-1605372168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-551b110b-7ad7-4e6a-a895-7e791760b443 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:05:14 devstack sudo[88405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-551b110b-7ad7-4e6a-a895-7e791760b443
Jul 03 01:05:14 devstack sudo[88405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:05:15 devstack sudo[88405]: pam_unix(sudo:session): session closed for user root
Jul 03 01:05:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-85902fe3-b673-4156-ad73-3c36e475a606 req-38212996-7130-475a-bbd2-377388ee3d7b tempest-TaggedAttachmentsTest-1605372168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-551b110b-7ad7-4e6a-a895-7e791760b443" returned: 0 in 0.941s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:05:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-85902fe3-b673-4156-ad73-3c36e475a606 req-38212996-7130-475a-bbd2-377388ee3d7b tempest-TaggedAttachmentsTest-1605372168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.981s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:05:15 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [req-85902fe3-b673-4156-ad73-3c36e475a606 req-38212996-7130-475a-bbd2-377388ee3d7b tempest-TaggedAttachmentsTest-1605372168 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3', 'name': 'volume-551b110b-7ad7-4e6a-a895-7e791760b443', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8cc147f0-6b1f-4b8f-bddb-fb8268973ea0', 'enforce_multipath': True} {{(pid=86891) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 01:05:15 devstack cinder-volume[86891]: INFO cinder.volume.manager [req-85902fe3-b673-4156-ad73-3c36e475a606 req-38212996-7130-475a-bbd2-377388ee3d7b tempest-TaggedAttachmentsTest-1605372168 None] attachment_update completed successfully.
Jul 03 01:05:24 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce163ce2-f944-4b78-a325-9bd6393fc083 tempest-VolumesAdminNegativeTest-95387506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:05:24 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ce163ce2-f944-4b78-a325-9bd6393fc083 tempest-VolumesAdminNegativeTest-95387506 None] Flow 'volume_create_manager' (ee3c662f-6d26-4216-9e59-da143430b7e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:05:24 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ce163ce2-f944-4b78-a325-9bd6393fc083 tempest-VolumesAdminNegativeTest-95387506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb0973da-89cc-4c8d-b1a4-eda2f6e45170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:05:24 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ce163ce2-f944-4b78-a325-9bd6393fc083 tempest-VolumesAdminNegativeTest-95387506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb0973da-89cc-4c8d-b1a4-eda2f6e45170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-670028253',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6caf160a-664f-4168-b623-bb98d05b5f34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a6590327fde43b38b1e8df73eb2a461',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:05:25Z,use_quota=True,user_id='dcabd5d03b7b4b3cafc7a80c84c2419f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:05:24 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ce163ce2-f944-4b78-a325-9bd6393fc083 tempest-VolumesAdminNegativeTest-95387506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0c99009-2efa-4954-bfae-5cf856dd8daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:05:24 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ce163ce2-f944-4b78-a325-9bd6393fc083 tempest-VolumesAdminNegativeTest-95387506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0c99009-2efa-4954-bfae-5cf856dd8daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:05:24 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ce163ce2-f944-4b78-a325-9bd6393fc083 tempest-VolumesAdminNegativeTest-95387506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ed1b951-acd2-4711-9346-80c4ff643ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:05:24 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ce163ce2-f944-4b78-a325-9bd6393fc083 tempest-VolumesAdminNegativeTest-95387506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ed1b951-acd2-4711-9346-80c4ff643ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6caf160a-664f-4168-b623-bb98d05b5f34', 'volume_name': 'volume-6caf160a-664f-4168-b623-bb98d05b5f34', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:05:24 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ce163ce2-f944-4b78-a325-9bd6393fc083 tempest-VolumesAdminNegativeTest-95387506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07dadc33-acc9-4876-b11f-1d16b7aa097f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:05:24 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ce163ce2-f944-4b78-a325-9bd6393fc083 tempest-VolumesAdminNegativeTest-95387506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07dadc33-acc9-4876-b11f-1d16b7aa097f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:05:24 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ce163ce2-f944-4b78-a325-9bd6393fc083 tempest-VolumesAdminNegativeTest-95387506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4c54cd2-c1e8-46b4-a78a-8eac9c1206b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:05:24 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-ce163ce2-f944-4b78-a325-9bd6393fc083 tempest-VolumesAdminNegativeTest-95387506 None] Volume 6caf160a-664f-4168-b623-bb98d05b5f34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6caf160a-664f-4168-b623-bb98d05b5f34', 'volume_size': 1}
Jul 03 01:05:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-ce163ce2-f944-4b78-a325-9bd6393fc083 tempest-VolumesAdminNegativeTest-95387506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:05:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-ce163ce2-f944-4b78-a325-9bd6393fc083 tempest-VolumesAdminNegativeTest-95387506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:05:24 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-ce163ce2-f944-4b78-a325-9bd6393fc083 tempest-VolumesAdminNegativeTest-95387506 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-670028253',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6caf160a-664f-4168-b623-bb98d05b5f34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a6590327fde43b38b1e8df73eb2a461',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:05:25Z,use_quota=True,user_id='dcabd5d03b7b4b3cafc7a80c84c2419f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:05:24 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-ce163ce2-f944-4b78-a325-9bd6393fc083 tempest-VolumesAdminNegativeTest-95387506 None] Creating volume 6caf160a-664f-4168-b623-bb98d05b5f34 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:05:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-ce163ce2-f944-4b78-a325-9bd6393fc083 tempest-VolumesAdminNegativeTest-95387506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:05:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-ce163ce2-f944-4b78-a325-9bd6393fc083 tempest-VolumesAdminNegativeTest-95387506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:05:24 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-ce163ce2-f944-4b78-a325-9bd6393fc083 tempest-VolumesAdminNegativeTest-95387506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:05:24 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-ce163ce2-f944-4b78-a325-9bd6393fc083 tempest-VolumesAdminNegativeTest-95387506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:05:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-ce163ce2-f944-4b78-a325-9bd6393fc083 tempest-VolumesAdminNegativeTest-95387506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:05:24 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-ce163ce2-f944-4b78-a325-9bd6393fc083 tempest-VolumesAdminNegativeTest-95387506 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:05:24 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-ce163ce2-f944-4b78-a325-9bd6393fc083 tempest-VolumesAdminNegativeTest-95387506 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:05:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-ce163ce2-f944-4b78-a325-9bd6393fc083 tempest-VolumesAdminNegativeTest-95387506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-6caf160a-664f-4168-b623-bb98d05b5f34 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:05:25 devstack cinder-volume[86891]: INFO cinder.volume.manager [req-940175e2-8952-4fa8-a79b-632d0edd3ac5 req-83a3a496-a460-45fc-a778-55dbe4f120fa tempest-TaggedAttachmentsTest-1605372168 None] Terminate volume connection completed successfully.
Jul 03 01:05:25 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [req-940175e2-8952-4fa8-a79b-632d0edd3ac5 req-83a3a496-a460-45fc-a778-55dbe4f120fa tempest-TaggedAttachmentsTest-1605372168 None] Deleting attachment 8cc147f0-6b1f-4b8f-bddb-fb8268973ea0. {{(pid=86891) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 01:05:25 devstack sudo[88993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-6caf160a-664f-4168-b623-bb98d05b5f34 1073741824
Jul 03 01:05:25 devstack sudo[88993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:05:25 devstack sudo[88993]: pam_unix(sudo:session): session closed for user root
Jul 03 01:05:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-ce163ce2-f944-4b78-a325-9bd6393fc083 tempest-VolumesAdminNegativeTest-95387506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-6caf160a-664f-4168-b623-bb98d05b5f34 1073741824" returned: 0 in 0.970s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:05:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-ce163ce2-f944-4b78-a325-9bd6393fc083 tempest-VolumesAdminNegativeTest-95387506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-6caf160a-664f-4168-b623-bb98d05b5f34 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:05:26 devstack sudo[88999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-6caf160a-664f-4168-b623-bb98d05b5f34
Jul 03 01:05:26 devstack sudo[88999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:05:26 devstack sudo[88999]: pam_unix(sudo:session): session closed for user root
Jul 03 01:05:26 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-ce163ce2-f944-4b78-a325-9bd6393fc083 tempest-VolumesAdminNegativeTest-95387506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-6caf160a-664f-4168-b623-bb98d05b5f34" returned: 0 in 0.856s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:05:26 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-ce163ce2-f944-4b78-a325-9bd6393fc083 tempest-VolumesAdminNegativeTest-95387506 None] <== create_volume: return (1883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:05:26 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-ce163ce2-f944-4b78-a325-9bd6393fc083 tempest-VolumesAdminNegativeTest-95387506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.886s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:05:26 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ce163ce2-f944-4b78-a325-9bd6393fc083 tempest-VolumesAdminNegativeTest-95387506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4c54cd2-c1e8-46b4-a78a-8eac9c1206b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6caf160a-664f-4168-b623-bb98d05b5f34', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:05:26 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ce163ce2-f944-4b78-a325-9bd6393fc083 tempest-VolumesAdminNegativeTest-95387506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66a9ad9b-1c4c-4f1b-a35b-90477849b31a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:05:26 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-ce163ce2-f944-4b78-a325-9bd6393fc083 tempest-VolumesAdminNegativeTest-95387506 None] Volume volume-6caf160a-664f-4168-b623-bb98d05b5f34 (6caf160a-664f-4168-b623-bb98d05b5f34): created successfully
Jul 03 01:05:26 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ce163ce2-f944-4b78-a325-9bd6393fc083 tempest-VolumesAdminNegativeTest-95387506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66a9ad9b-1c4c-4f1b-a35b-90477849b31a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:05:26 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ce163ce2-f944-4b78-a325-9bd6393fc083 tempest-VolumesAdminNegativeTest-95387506 None] Flow 'volume_create_manager' (ee3c662f-6d26-4216-9e59-da143430b7e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:05:26 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-ce163ce2-f944-4b78-a325-9bd6393fc083 tempest-VolumesAdminNegativeTest-95387506 None] Created volume successfully.
Jul 03 01:05:28 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-840cdacd-1823-4636-880b-180d5d3516c4 tempest-VolumesAdminNegativeTest-95387506 None] Acquiring lock "cinder-6caf160a-664f-4168-b623-bb98d05b5f34-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:05:28 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-840cdacd-1823-4636-880b-180d5d3516c4 tempest-VolumesAdminNegativeTest-95387506 None] Lock "cinder-6caf160a-664f-4168-b623-bb98d05b5f34-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:05:28 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-840cdacd-1823-4636-880b-180d5d3516c4 tempest-VolumesAdminNegativeTest-95387506 None] Acquiring lock "cinder-quobyte-6caf160a-664f-4168-b623-bb98d05b5f34" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:05:28 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-840cdacd-1823-4636-880b-180d5d3516c4 tempest-VolumesAdminNegativeTest-95387506 None] Lock "cinder-quobyte-6caf160a-664f-4168-b623-bb98d05b5f34" acquired by "delete_volume" :: waited 0.029s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:05:28 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[f451ede9-bd08-49b7-9df6-34622503cd95]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:05:28 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-840cdacd-1823-4636-880b-180d5d3516c4 tempest-VolumesAdminNegativeTest-95387506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-6caf160a-664f-4168-b623-bb98d05b5f34 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:05:28 devstack sudo[89028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-6caf160a-664f-4168-b623-bb98d05b5f34
Jul 03 01:05:28 devstack sudo[89028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:05:30 devstack sudo[89028]: pam_unix(sudo:session): session closed for user root
Jul 03 01:05:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-840cdacd-1823-4636-880b-180d5d3516c4 tempest-VolumesAdminNegativeTest-95387506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-6caf160a-664f-4168-b623-bb98d05b5f34" returned: 0 in 1.457s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:05:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-840cdacd-1823-4636-880b-180d5d3516c4 tempest-VolumesAdminNegativeTest-95387506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-6caf160a-664f-4168-b623-bb98d05b5f34 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:05:30 devstack sudo[89038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-6caf160a-664f-4168-b623-bb98d05b5f34
Jul 03 01:05:30 devstack sudo[89038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:05:30 devstack sudo[89038]: pam_unix(sudo:session): session closed for user root
Jul 03 01:05:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-840cdacd-1823-4636-880b-180d5d3516c4 tempest-VolumesAdminNegativeTest-95387506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-6caf160a-664f-4168-b623-bb98d05b5f34" returned: 0 in 0.880s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:05:31 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-840cdacd-1823-4636-880b-180d5d3516c4 tempest-VolumesAdminNegativeTest-95387506 None] Lock "cinder-quobyte-6caf160a-664f-4168-b623-bb98d05b5f34" released by "delete_volume" :: held 2.392s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:05:31 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-840cdacd-1823-4636-880b-180d5d3516c4 tempest-VolumesAdminNegativeTest-95387506 None] Created reservations ['b434d601-ebbc-4c56-9636-1956e55d3ce7', 'dca82210-63c3-4f55-b0f8-cf247192c495', 'e06a0040-970c-4f37-ad8b-1d9ca244d907', 'c948cc15-7081-46e0-bb9d-894d499b4f89'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:05:31 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-840cdacd-1823-4636-880b-180d5d3516c4 tempest-VolumesAdminNegativeTest-95387506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:05:31 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-840cdacd-1823-4636-880b-180d5d3516c4 tempest-VolumesAdminNegativeTest-95387506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:05:31 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-840cdacd-1823-4636-880b-180d5d3516c4 tempest-VolumesAdminNegativeTest-95387506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:05:31 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-840cdacd-1823-4636-880b-180d5d3516c4 tempest-VolumesAdminNegativeTest-95387506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:05:31 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-840cdacd-1823-4636-880b-180d5d3516c4 tempest-VolumesAdminNegativeTest-95387506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.054s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:05:31 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-840cdacd-1823-4636-880b-180d5d3516c4 tempest-VolumesAdminNegativeTest-95387506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:05:31 devstack sudo[89042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:05:31 devstack sudo[89042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:05:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-c71359ef-78ed-43d6-977c-53ffc518a566 req-e8550c84-0996-4f00-955b-e7deba8fa05e tempest-ServerActionsTestOtherA-1545581072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:05:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-c71359ef-78ed-43d6-977c-53ffc518a566 req-e8550c84-0996-4f00-955b-e7deba8fa05e tempest-ServerActionsTestOtherA-1545581072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:05:32 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f6213c-93c1-4dae-aff5-cb17e8000fd4]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:05:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-c71359ef-78ed-43d6-977c-53ffc518a566 req-e8550c84-0996-4f00-955b-e7deba8fa05e tempest-ServerActionsTestOtherA-1545581072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b0b3a101-3103-47df-a542-75640528e14a {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:05:32 devstack sudo[89042]: pam_unix(sudo:session): session closed for user root
Jul 03 01:05:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-840cdacd-1823-4636-880b-180d5d3516c4 tempest-VolumesAdminNegativeTest-95387506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.935s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:05:32 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-840cdacd-1823-4636-880b-180d5d3516c4 tempest-VolumesAdminNegativeTest-95387506 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:05:32 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-840cdacd-1823-4636-880b-180d5d3516c4 tempest-VolumesAdminNegativeTest-95387506 None] Deleted volume successfully.
Jul 03 01:05:32 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-840cdacd-1823-4636-880b-180d5d3516c4 tempest-VolumesAdminNegativeTest-95387506 None] Lock "cinder-6caf160a-664f-4168-b623-bb98d05b5f34-delete_volume" released by "delete_volume" :: held 3.876s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:05:32 devstack sudo[89054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b0b3a101-3103-47df-a542-75640528e14a
Jul 03 01:05:32 devstack sudo[89054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:05:33 devstack sudo[89054]: pam_unix(sudo:session): session closed for user root
Jul 03 01:05:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-c71359ef-78ed-43d6-977c-53ffc518a566 req-e8550c84-0996-4f00-955b-e7deba8fa05e tempest-ServerActionsTestOtherA-1545581072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b0b3a101-3103-47df-a542-75640528e14a" returned: 0 in 1.180s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:05:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-c71359ef-78ed-43d6-977c-53ffc518a566 req-e8550c84-0996-4f00-955b-e7deba8fa05e tempest-ServerActionsTestOtherA-1545581072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.220s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:05:33 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [req-c71359ef-78ed-43d6-977c-53ffc518a566 req-e8550c84-0996-4f00-955b-e7deba8fa05e tempest-ServerActionsTestOtherA-1545581072 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3', 'name': 'volume-b0b3a101-3103-47df-a542-75640528e14a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '070f21a7-28aa-4fa6-8a91-246263d0f64d', 'enforce_multipath': True} {{(pid=86891) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 01:05:33 devstack cinder-volume[86891]: INFO cinder.volume.manager [req-c71359ef-78ed-43d6-977c-53ffc518a566 req-e8550c84-0996-4f00-955b-e7deba8fa05e tempest-ServerActionsTestOtherA-1545581072 None] attachment_update completed successfully.
Jul 03 01:05:42 devstack cinder-volume[86891]: INFO cinder.volume.manager [req-f3bc85c9-e5e3-4c27-913b-732668d74eed req-ca24374c-456b-40d6-b7ef-c962cd6e3210 tempest-ServerActionsTestOtherA-1545581072 None] Terminate volume connection completed successfully.
Jul 03 01:05:42 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [req-f3bc85c9-e5e3-4c27-913b-732668d74eed req-ca24374c-456b-40d6-b7ef-c962cd6e3210 tempest-ServerActionsTestOtherA-1545581072 None] Deleting attachment 070f21a7-28aa-4fa6-8a91-246263d0f64d. {{(pid=86891) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 01:05:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-f3bc85c9-e5e3-4c27-913b-732668d74eed req-caaff68f-e3a4-4a05-859a-322f5c4f7a6b tempest-ServerActionsTestOtherA-1545581072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:05:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-f3bc85c9-e5e3-4c27-913b-732668d74eed req-caaff68f-e3a4-4a05-859a-322f5c4f7a6b tempest-ServerActionsTestOtherA-1545581072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:05:44 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d728be-5bb3-4dd5-adaf-c007ee9a866f]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:05:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-f3bc85c9-e5e3-4c27-913b-732668d74eed req-caaff68f-e3a4-4a05-859a-322f5c4f7a6b tempest-ServerActionsTestOtherA-1545581072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b0b3a101-3103-47df-a542-75640528e14a {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:05:44 devstack sudo[89613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b0b3a101-3103-47df-a542-75640528e14a
Jul 03 01:05:44 devstack sudo[89613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:05:45 devstack sudo[89613]: pam_unix(sudo:session): session closed for user root
Jul 03 01:05:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-f3bc85c9-e5e3-4c27-913b-732668d74eed req-caaff68f-e3a4-4a05-859a-322f5c4f7a6b tempest-ServerActionsTestOtherA-1545581072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b0b3a101-3103-47df-a542-75640528e14a" returned: 0 in 1.006s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:05:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-f3bc85c9-e5e3-4c27-913b-732668d74eed req-caaff68f-e3a4-4a05-859a-322f5c4f7a6b tempest-ServerActionsTestOtherA-1545581072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.030s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:05:45 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:SELECT=40,cinder:UPDATE=35,cinder:DELETE=5,cinder:INSERT=10 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:05:45 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:SELECT=33,cinder:INSERT=5,cinder:UPDATE=38,cinder:DELETE=1 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:05:45 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [req-f3bc85c9-e5e3-4c27-913b-732668d74eed req-caaff68f-e3a4-4a05-859a-322f5c4f7a6b tempest-ServerActionsTestOtherA-1545581072 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3', 'name': 'volume-b0b3a101-3103-47df-a542-75640528e14a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c13f8f05-9a97-4dc9-9e9c-f647d582f31d', 'enforce_multipath': True} {{(pid=86891) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 01:05:46 devstack cinder-volume[86891]: INFO cinder.volume.manager [req-f3bc85c9-e5e3-4c27-913b-732668d74eed req-caaff68f-e3a4-4a05-859a-322f5c4f7a6b tempest-ServerActionsTestOtherA-1545581072 None] attachment_update completed successfully.
Jul 03 01:05:47 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-afcaf5a6-c6ca-4e2f-80f9-1e09eedd73a0 tempest-TaggedAttachmentsTest-1605372168 None] Acquiring lock "cinder-551b110b-7ad7-4e6a-a895-7e791760b443-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:05:47 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-afcaf5a6-c6ca-4e2f-80f9-1e09eedd73a0 tempest-TaggedAttachmentsTest-1605372168 None] Lock "cinder-551b110b-7ad7-4e6a-a895-7e791760b443-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:05:47 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-afcaf5a6-c6ca-4e2f-80f9-1e09eedd73a0 tempest-TaggedAttachmentsTest-1605372168 None] Acquiring lock "cinder-quobyte-551b110b-7ad7-4e6a-a895-7e791760b443" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:05:47 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-afcaf5a6-c6ca-4e2f-80f9-1e09eedd73a0 tempest-TaggedAttachmentsTest-1605372168 None] Lock "cinder-quobyte-551b110b-7ad7-4e6a-a895-7e791760b443" acquired by "delete_volume" :: waited 0.020s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:05:47 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[b861f501-c79f-4be6-9a9e-e1e4f746ed50]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:05:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-afcaf5a6-c6ca-4e2f-80f9-1e09eedd73a0 tempest-TaggedAttachmentsTest-1605372168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-551b110b-7ad7-4e6a-a895-7e791760b443 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:05:47 devstack sudo[89628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-551b110b-7ad7-4e6a-a895-7e791760b443
Jul 03 01:05:47 devstack sudo[89628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:05:48 devstack sudo[89628]: pam_unix(sudo:session): session closed for user root
Jul 03 01:05:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-afcaf5a6-c6ca-4e2f-80f9-1e09eedd73a0 tempest-TaggedAttachmentsTest-1605372168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-551b110b-7ad7-4e6a-a895-7e791760b443" returned: 0 in 1.243s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:05:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-afcaf5a6-c6ca-4e2f-80f9-1e09eedd73a0 tempest-TaggedAttachmentsTest-1605372168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-551b110b-7ad7-4e6a-a895-7e791760b443 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:05:48 devstack sudo[89649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-551b110b-7ad7-4e6a-a895-7e791760b443
Jul 03 01:05:48 devstack sudo[89649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:05:49 devstack sudo[89649]: pam_unix(sudo:session): session closed for user root
Jul 03 01:05:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-afcaf5a6-c6ca-4e2f-80f9-1e09eedd73a0 tempest-TaggedAttachmentsTest-1605372168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-551b110b-7ad7-4e6a-a895-7e791760b443" returned: 0 in 0.810s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:05:49 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-afcaf5a6-c6ca-4e2f-80f9-1e09eedd73a0 tempest-TaggedAttachmentsTest-1605372168 None] Lock "cinder-quobyte-551b110b-7ad7-4e6a-a895-7e791760b443" released by "delete_volume" :: held 2.121s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:05:49 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-afcaf5a6-c6ca-4e2f-80f9-1e09eedd73a0 tempest-TaggedAttachmentsTest-1605372168 None] Created reservations ['55875390-c4aa-4a99-9260-7f8e46d41e56', '6e0b4414-3d9c-4915-b905-685551f1e633', '52cb968e-7e0b-4526-833e-c9afe9315c97', 'b477bf4d-e3b6-4b31-8acd-1e21b18c8f3e'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:05:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-afcaf5a6-c6ca-4e2f-80f9-1e09eedd73a0 tempest-TaggedAttachmentsTest-1605372168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:05:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-afcaf5a6-c6ca-4e2f-80f9-1e09eedd73a0 tempest-TaggedAttachmentsTest-1605372168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:05:49 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-afcaf5a6-c6ca-4e2f-80f9-1e09eedd73a0 tempest-TaggedAttachmentsTest-1605372168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:05:49 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-afcaf5a6-c6ca-4e2f-80f9-1e09eedd73a0 tempest-TaggedAttachmentsTest-1605372168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:05:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-afcaf5a6-c6ca-4e2f-80f9-1e09eedd73a0 tempest-TaggedAttachmentsTest-1605372168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:05:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-afcaf5a6-c6ca-4e2f-80f9-1e09eedd73a0 tempest-TaggedAttachmentsTest-1605372168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:05:49 devstack sudo[89731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:05:49 devstack sudo[89731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:05:50 devstack sudo[89731]: pam_unix(sudo:session): session closed for user root
Jul 03 01:05:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-afcaf5a6-c6ca-4e2f-80f9-1e09eedd73a0 tempest-TaggedAttachmentsTest-1605372168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.858s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:05:50 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-afcaf5a6-c6ca-4e2f-80f9-1e09eedd73a0 tempest-TaggedAttachmentsTest-1605372168 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:05:50 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-afcaf5a6-c6ca-4e2f-80f9-1e09eedd73a0 tempest-TaggedAttachmentsTest-1605372168 None] Deleted volume successfully.
Jul 03 01:05:50 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-afcaf5a6-c6ca-4e2f-80f9-1e09eedd73a0 tempest-TaggedAttachmentsTest-1605372168 None] Lock "cinder-551b110b-7ad7-4e6a-a895-7e791760b443-delete_volume" released by "delete_volume" :: held 3.343s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:05:59 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:SELECT=7,cinder:UPDATE=11,cinder:INSERT=2 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:06:00 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:SELECT=10,cinder:UPDATE=8,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:06:01 devstack cinder-volume[86891]: DEBUG oslo_service.periodic_task [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86891) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 01:06:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:06:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:06:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:06:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:06:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:06:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:06:02 devstack sudo[90184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:06:02 devstack sudo[90184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:06:03 devstack sudo[90184]: pam_unix(sudo:session): session closed for user root
Jul 03 01:06:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 1.716s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:06:03 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:06:03 devstack cinder-volume[86891]: DEBUG oslo_service.periodic_task [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running periodic task VolumeManager._thread_info {{(pid=86891) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 01:06:03 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] thread count: 8 {{(pid=86891) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 01:06:03 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] thread info: [<_MainThread(MainThread, started 136731296534656)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136731184953280)>, <Thread(Thread-3 (stat_writer), started daemon 136731184058816)>, <Thread(Rabbit-heartbeat, started daemon 136731184846080)>, <Thread(Thread-5 (_runner), started daemon 136731182936576)>, <Thread(Thread-7 (_runner), started daemon 136731182954944)>, <Thread(fd_logger, started daemon 136731181916416)>, <Thread(privsep_reader, started daemon 136731180942208)>] {{(pid=86891) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 01:06:25 devstack cinder-volume[86891]: INFO cinder.volume.manager [req-e181fff8-e42c-4990-87fb-a41a979345a8 req-a2cbdb18-a973-420c-868d-7e04a8fd0214 tempest-ServerActionsTestOtherA-1545581072 None] Terminate volume connection completed successfully.
Jul 03 01:06:25 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [req-e181fff8-e42c-4990-87fb-a41a979345a8 req-a2cbdb18-a973-420c-868d-7e04a8fd0214 tempest-ServerActionsTestOtherA-1545581072 None] Deleting attachment c13f8f05-9a97-4dc9-9e9c-f647d582f31d. {{(pid=86891) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 01:06:27 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-b644dbc2-ccc7-4410-925d-6f5fe9d7cced tempest-AttachVolumeTestJSON-670724779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:06:27 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b644dbc2-ccc7-4410-925d-6f5fe9d7cced tempest-AttachVolumeTestJSON-670724779 None] Flow 'volume_create_manager' (13f00a1f-8fc4-4257-898d-f88adb03089d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:06:27 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b644dbc2-ccc7-4410-925d-6f5fe9d7cced tempest-AttachVolumeTestJSON-670724779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (784e6ffd-699b-48c3-bb0b-2002c44bbaa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:06:27 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b644dbc2-ccc7-4410-925d-6f5fe9d7cced tempest-AttachVolumeTestJSON-670724779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (784e6ffd-699b-48c3-bb0b-2002c44bbaa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:06:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-593718828',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac793674-2d51-4fb1-ad04-f71736426f39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61b4846e43014cf4a821bb29f9c5a6f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:06:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:06:27Z,use_quota=True,user_id='7509a11726914eeab94b9bb92af3be37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:06:27 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b644dbc2-ccc7-4410-925d-6f5fe9d7cced tempest-AttachVolumeTestJSON-670724779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80bcafed-28a2-4a1c-8175-0a8869d5a1e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:06:27 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b644dbc2-ccc7-4410-925d-6f5fe9d7cced tempest-AttachVolumeTestJSON-670724779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80bcafed-28a2-4a1c-8175-0a8869d5a1e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:06:27 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b644dbc2-ccc7-4410-925d-6f5fe9d7cced tempest-AttachVolumeTestJSON-670724779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16d46770-4b0c-4c4c-bfd1-3e52fc0bfd4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:06:27 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b644dbc2-ccc7-4410-925d-6f5fe9d7cced tempest-AttachVolumeTestJSON-670724779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16d46770-4b0c-4c4c-bfd1-3e52fc0bfd4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac793674-2d51-4fb1-ad04-f71736426f39', 'volume_name': 'volume-ac793674-2d51-4fb1-ad04-f71736426f39', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:06:27 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b644dbc2-ccc7-4410-925d-6f5fe9d7cced tempest-AttachVolumeTestJSON-670724779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afe2c7db-aef4-45c9-a7ee-57ef88fef6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:06:27 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b644dbc2-ccc7-4410-925d-6f5fe9d7cced tempest-AttachVolumeTestJSON-670724779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afe2c7db-aef4-45c9-a7ee-57ef88fef6fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:06:27 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b644dbc2-ccc7-4410-925d-6f5fe9d7cced tempest-AttachVolumeTestJSON-670724779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfa0bfb7-7b4d-498d-9806-a71960bdc96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:06:27 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-b644dbc2-ccc7-4410-925d-6f5fe9d7cced tempest-AttachVolumeTestJSON-670724779 None] Volume ac793674-2d51-4fb1-ad04-f71736426f39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac793674-2d51-4fb1-ad04-f71736426f39', 'volume_size': 1}
Jul 03 01:06:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b644dbc2-ccc7-4410-925d-6f5fe9d7cced tempest-AttachVolumeTestJSON-670724779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:06:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b644dbc2-ccc7-4410-925d-6f5fe9d7cced tempest-AttachVolumeTestJSON-670724779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:06:27 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-b644dbc2-ccc7-4410-925d-6f5fe9d7cced tempest-AttachVolumeTestJSON-670724779 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:06:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-593718828',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac793674-2d51-4fb1-ad04-f71736426f39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61b4846e43014cf4a821bb29f9c5a6f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:06:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:06:27Z,use_quota=True,user_id='7509a11726914eeab94b9bb92af3be37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:06:27 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-b644dbc2-ccc7-4410-925d-6f5fe9d7cced tempest-AttachVolumeTestJSON-670724779 None] Creating volume ac793674-2d51-4fb1-ad04-f71736426f39 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:06:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b644dbc2-ccc7-4410-925d-6f5fe9d7cced tempest-AttachVolumeTestJSON-670724779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:06:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b644dbc2-ccc7-4410-925d-6f5fe9d7cced tempest-AttachVolumeTestJSON-670724779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:06:27 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-b644dbc2-ccc7-4410-925d-6f5fe9d7cced tempest-AttachVolumeTestJSON-670724779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:06:27 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-b644dbc2-ccc7-4410-925d-6f5fe9d7cced tempest-AttachVolumeTestJSON-670724779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:06:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b644dbc2-ccc7-4410-925d-6f5fe9d7cced tempest-AttachVolumeTestJSON-670724779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:06:27 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-b644dbc2-ccc7-4410-925d-6f5fe9d7cced tempest-AttachVolumeTestJSON-670724779 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:06:27 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-b644dbc2-ccc7-4410-925d-6f5fe9d7cced tempest-AttachVolumeTestJSON-670724779 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:06:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b644dbc2-ccc7-4410-925d-6f5fe9d7cced tempest-AttachVolumeTestJSON-670724779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ac793674-2d51-4fb1-ad04-f71736426f39 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:06:27 devstack sudo[90376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ac793674-2d51-4fb1-ad04-f71736426f39 1073741824
Jul 03 01:06:27 devstack sudo[90376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:06:28 devstack sudo[90376]: pam_unix(sudo:session): session closed for user root
Jul 03 01:06:28 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b644dbc2-ccc7-4410-925d-6f5fe9d7cced tempest-AttachVolumeTestJSON-670724779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ac793674-2d51-4fb1-ad04-f71736426f39 1073741824" returned: 0 in 1.071s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:06:28 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b644dbc2-ccc7-4410-925d-6f5fe9d7cced tempest-AttachVolumeTestJSON-670724779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ac793674-2d51-4fb1-ad04-f71736426f39 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:06:28 devstack sudo[90384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ac793674-2d51-4fb1-ad04-f71736426f39
Jul 03 01:06:28 devstack sudo[90384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:06:29 devstack sudo[90384]: pam_unix(sudo:session): session closed for user root
Jul 03 01:06:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b644dbc2-ccc7-4410-925d-6f5fe9d7cced tempest-AttachVolumeTestJSON-670724779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ac793674-2d51-4fb1-ad04-f71736426f39" returned: 0 in 1.012s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:06:29 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-b644dbc2-ccc7-4410-925d-6f5fe9d7cced tempest-AttachVolumeTestJSON-670724779 None] <== create_volume: return (2144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:06:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b644dbc2-ccc7-4410-925d-6f5fe9d7cced tempest-AttachVolumeTestJSON-670724779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.146s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:06:29 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b644dbc2-ccc7-4410-925d-6f5fe9d7cced tempest-AttachVolumeTestJSON-670724779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfa0bfb7-7b4d-498d-9806-a71960bdc96b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac793674-2d51-4fb1-ad04-f71736426f39', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:06:29 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b644dbc2-ccc7-4410-925d-6f5fe9d7cced tempest-AttachVolumeTestJSON-670724779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7374164-d7a8-4e7e-80e1-80f988627a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:06:29 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-b644dbc2-ccc7-4410-925d-6f5fe9d7cced tempest-AttachVolumeTestJSON-670724779 None] Volume volume-ac793674-2d51-4fb1-ad04-f71736426f39 (ac793674-2d51-4fb1-ad04-f71736426f39): created successfully
Jul 03 01:06:29 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b644dbc2-ccc7-4410-925d-6f5fe9d7cced tempest-AttachVolumeTestJSON-670724779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7374164-d7a8-4e7e-80e1-80f988627a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:06:29 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b644dbc2-ccc7-4410-925d-6f5fe9d7cced tempest-AttachVolumeTestJSON-670724779 None] Flow 'volume_create_manager' (13f00a1f-8fc4-4257-898d-f88adb03089d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:06:29 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-b644dbc2-ccc7-4410-925d-6f5fe9d7cced tempest-AttachVolumeTestJSON-670724779 None] Created volume successfully.
Jul 03 01:06:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-452ad088-2b46-4d6e-8244-0da96f6869cc req-572ba568-eb37-4dfd-8423-f4970103d64e tempest-AttachVolumeTestJSON-670724779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:06:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-452ad088-2b46-4d6e-8244-0da96f6869cc req-572ba568-eb37-4dfd-8423-f4970103d64e tempest-AttachVolumeTestJSON-670724779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:06:33 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea4ba09-10be-4919-8d0a-d79d13761be6]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:06:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-452ad088-2b46-4d6e-8244-0da96f6869cc req-572ba568-eb37-4dfd-8423-f4970103d64e tempest-AttachVolumeTestJSON-670724779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ac793674-2d51-4fb1-ad04-f71736426f39 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:06:34 devstack sudo[90479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ac793674-2d51-4fb1-ad04-f71736426f39
Jul 03 01:06:34 devstack sudo[90479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:06:34 devstack sudo[90479]: pam_unix(sudo:session): session closed for user root
Jul 03 01:06:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-452ad088-2b46-4d6e-8244-0da96f6869cc req-572ba568-eb37-4dfd-8423-f4970103d64e tempest-AttachVolumeTestJSON-670724779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ac793674-2d51-4fb1-ad04-f71736426f39" returned: 0 in 1.136s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:06:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-452ad088-2b46-4d6e-8244-0da96f6869cc req-572ba568-eb37-4dfd-8423-f4970103d64e tempest-AttachVolumeTestJSON-670724779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.165s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:06:35 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [req-452ad088-2b46-4d6e-8244-0da96f6869cc req-572ba568-eb37-4dfd-8423-f4970103d64e tempest-AttachVolumeTestJSON-670724779 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3', 'name': 'volume-ac793674-2d51-4fb1-ad04-f71736426f39', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f3108263-86e8-47cc-b636-842d894cfc5e', 'enforce_multipath': True} {{(pid=86891) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 01:06:35 devstack cinder-volume[86891]: INFO cinder.volume.manager [req-452ad088-2b46-4d6e-8244-0da96f6869cc req-572ba568-eb37-4dfd-8423-f4970103d64e tempest-AttachVolumeTestJSON-670724779 None] attachment_update completed successfully.
Jul 03 01:06:36 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e07101e7-441a-416c-be66-167ba1aef277 tempest-ServerActionsTestOtherA-1545581072 None] Acquiring lock "cinder-b0b3a101-3103-47df-a542-75640528e14a-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:06:36 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e07101e7-441a-416c-be66-167ba1aef277 tempest-ServerActionsTestOtherA-1545581072 None] Lock "cinder-b0b3a101-3103-47df-a542-75640528e14a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:06:36 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e07101e7-441a-416c-be66-167ba1aef277 tempest-ServerActionsTestOtherA-1545581072 None] Acquiring lock "cinder-quobyte-b0b3a101-3103-47df-a542-75640528e14a" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:06:36 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e07101e7-441a-416c-be66-167ba1aef277 tempest-ServerActionsTestOtherA-1545581072 None] Lock "cinder-quobyte-b0b3a101-3103-47df-a542-75640528e14a" acquired by "delete_volume" :: waited 0.036s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:06:36 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[74cba092-27fe-4de9-8269-5b81e05d14c6]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:06:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e07101e7-441a-416c-be66-167ba1aef277 tempest-ServerActionsTestOtherA-1545581072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b0b3a101-3103-47df-a542-75640528e14a {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:06:36 devstack sudo[90899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b0b3a101-3103-47df-a542-75640528e14a
Jul 03 01:06:36 devstack sudo[90899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:06:37 devstack sudo[90899]: pam_unix(sudo:session): session closed for user root
Jul 03 01:06:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e07101e7-441a-416c-be66-167ba1aef277 tempest-ServerActionsTestOtherA-1545581072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b0b3a101-3103-47df-a542-75640528e14a" returned: 0 in 1.390s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:06:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e07101e7-441a-416c-be66-167ba1aef277 tempest-ServerActionsTestOtherA-1545581072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b0b3a101-3103-47df-a542-75640528e14a {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:06:37 devstack sudo[90987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b0b3a101-3103-47df-a542-75640528e14a
Jul 03 01:06:37 devstack sudo[90987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:06:39 devstack sudo[90987]: pam_unix(sudo:session): session closed for user root
Jul 03 01:06:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e07101e7-441a-416c-be66-167ba1aef277 tempest-ServerActionsTestOtherA-1545581072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b0b3a101-3103-47df-a542-75640528e14a" returned: 0 in 1.714s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:06:39 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e07101e7-441a-416c-be66-167ba1aef277 tempest-ServerActionsTestOtherA-1545581072 None] Lock "cinder-quobyte-b0b3a101-3103-47df-a542-75640528e14a" released by "delete_volume" :: held 3.179s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:06:39 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-e07101e7-441a-416c-be66-167ba1aef277 tempest-ServerActionsTestOtherA-1545581072 None] Created reservations ['cf8f4403-d232-4a5c-98e3-d9acdd8c39ad', '673ae4b4-08f2-4ced-afce-0cfe73c6fa27', '08b3d8e0-e4e3-4e1b-8bd4-04c53e079296', '5bf19fad-b283-4c83-8fb8-2b1bbf86343d'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:06:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e07101e7-441a-416c-be66-167ba1aef277 tempest-ServerActionsTestOtherA-1545581072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:06:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e07101e7-441a-416c-be66-167ba1aef277 tempest-ServerActionsTestOtherA-1545581072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:06:40 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-e07101e7-441a-416c-be66-167ba1aef277 tempest-ServerActionsTestOtherA-1545581072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:06:40 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-e07101e7-441a-416c-be66-167ba1aef277 tempest-ServerActionsTestOtherA-1545581072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:06:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e07101e7-441a-416c-be66-167ba1aef277 tempest-ServerActionsTestOtherA-1545581072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:06:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e07101e7-441a-416c-be66-167ba1aef277 tempest-ServerActionsTestOtherA-1545581072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:06:40 devstack sudo[91065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:06:40 devstack sudo[91065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:06:41 devstack sudo[91065]: pam_unix(sudo:session): session closed for user root
Jul 03 01:06:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e07101e7-441a-416c-be66-167ba1aef277 tempest-ServerActionsTestOtherA-1545581072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 1.897s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:06:41 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-e07101e7-441a-416c-be66-167ba1aef277 tempest-ServerActionsTestOtherA-1545581072 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:06:41 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-e07101e7-441a-416c-be66-167ba1aef277 tempest-ServerActionsTestOtherA-1545581072 None] Deleted volume successfully.
Jul 03 01:06:42 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e07101e7-441a-416c-be66-167ba1aef277 tempest-ServerActionsTestOtherA-1545581072 None] Lock "cinder-b0b3a101-3103-47df-a542-75640528e14a-delete_volume" released by "delete_volume" :: held 5.679s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:06:44 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0b572e1-2d15-454f-a62c-6a8f1faf9b58 tempest-DeleteServersTestJSON-261006987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:06:44 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a0b572e1-2d15-454f-a62c-6a8f1faf9b58 tempest-DeleteServersTestJSON-261006987 None] Flow 'volume_create_manager' (3aa6c127-126c-465f-b4c0-9bb33d1e76e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:06:44 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a0b572e1-2d15-454f-a62c-6a8f1faf9b58 tempest-DeleteServersTestJSON-261006987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b69d2bbe-f1e0-483a-bda0-8b71dc2bab7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:06:44 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a0b572e1-2d15-454f-a62c-6a8f1faf9b58 tempest-DeleteServersTestJSON-261006987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b69d2bbe-f1e0-483a-bda0-8b71dc2bab7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:06:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2063762902',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4aceca8-7d8f-4ed3-b569-e6f06f99195e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e69385cda19e41b093f63b6620d80021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:06:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:06:44Z,use_quota=True,user_id='99112609cb1945a383b1b32e4118a1f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:06:44 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a0b572e1-2d15-454f-a62c-6a8f1faf9b58 tempest-DeleteServersTestJSON-261006987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11295d1e-55c2-4d08-ab07-ff1c0bea412a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:06:44 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a0b572e1-2d15-454f-a62c-6a8f1faf9b58 tempest-DeleteServersTestJSON-261006987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11295d1e-55c2-4d08-ab07-ff1c0bea412a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:06:44 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a0b572e1-2d15-454f-a62c-6a8f1faf9b58 tempest-DeleteServersTestJSON-261006987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c9acc08-cdbf-43f1-bfeb-b7b3f7182d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:06:44 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a0b572e1-2d15-454f-a62c-6a8f1faf9b58 tempest-DeleteServersTestJSON-261006987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c9acc08-cdbf-43f1-bfeb-b7b3f7182d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4aceca8-7d8f-4ed3-b569-e6f06f99195e', 'volume_name': 'volume-a4aceca8-7d8f-4ed3-b569-e6f06f99195e', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:06:44 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a0b572e1-2d15-454f-a62c-6a8f1faf9b58 tempest-DeleteServersTestJSON-261006987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffc4fd9d-7a8c-4d6c-a0db-cfde2b55eac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:06:44 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a0b572e1-2d15-454f-a62c-6a8f1faf9b58 tempest-DeleteServersTestJSON-261006987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffc4fd9d-7a8c-4d6c-a0db-cfde2b55eac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:06:44 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a0b572e1-2d15-454f-a62c-6a8f1faf9b58 tempest-DeleteServersTestJSON-261006987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (280cbc74-a622-46e4-9ce9-35d66a06fd43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:06:44 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-a0b572e1-2d15-454f-a62c-6a8f1faf9b58 tempest-DeleteServersTestJSON-261006987 None] Volume a4aceca8-7d8f-4ed3-b569-e6f06f99195e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4aceca8-7d8f-4ed3-b569-e6f06f99195e', 'volume_size': 1}
Jul 03 01:06:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a0b572e1-2d15-454f-a62c-6a8f1faf9b58 tempest-DeleteServersTestJSON-261006987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:06:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a0b572e1-2d15-454f-a62c-6a8f1faf9b58 tempest-DeleteServersTestJSON-261006987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:06:44 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-a0b572e1-2d15-454f-a62c-6a8f1faf9b58 tempest-DeleteServersTestJSON-261006987 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:06:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2063762902',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4aceca8-7d8f-4ed3-b569-e6f06f99195e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e69385cda19e41b093f63b6620d80021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:06:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:06:44Z,use_quota=True,user_id='99112609cb1945a383b1b32e4118a1f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:06:44 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-a0b572e1-2d15-454f-a62c-6a8f1faf9b58 tempest-DeleteServersTestJSON-261006987 None] Creating volume a4aceca8-7d8f-4ed3-b569-e6f06f99195e {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:06:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a0b572e1-2d15-454f-a62c-6a8f1faf9b58 tempest-DeleteServersTestJSON-261006987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:06:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a0b572e1-2d15-454f-a62c-6a8f1faf9b58 tempest-DeleteServersTestJSON-261006987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:06:44 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-a0b572e1-2d15-454f-a62c-6a8f1faf9b58 tempest-DeleteServersTestJSON-261006987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:06:44 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-a0b572e1-2d15-454f-a62c-6a8f1faf9b58 tempest-DeleteServersTestJSON-261006987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:06:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a0b572e1-2d15-454f-a62c-6a8f1faf9b58 tempest-DeleteServersTestJSON-261006987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:06:44 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-a0b572e1-2d15-454f-a62c-6a8f1faf9b58 tempest-DeleteServersTestJSON-261006987 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:06:44 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-a0b572e1-2d15-454f-a62c-6a8f1faf9b58 tempest-DeleteServersTestJSON-261006987 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:06:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a0b572e1-2d15-454f-a62c-6a8f1faf9b58 tempest-DeleteServersTestJSON-261006987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a4aceca8-7d8f-4ed3-b569-e6f06f99195e 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:06:44 devstack sudo[91207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a4aceca8-7d8f-4ed3-b569-e6f06f99195e 1073741824
Jul 03 01:06:44 devstack sudo[91207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:06:47 devstack sudo[91207]: pam_unix(sudo:session): session closed for user root
Jul 03 01:06:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a0b572e1-2d15-454f-a62c-6a8f1faf9b58 tempest-DeleteServersTestJSON-261006987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a4aceca8-7d8f-4ed3-b569-e6f06f99195e 1073741824" returned: 0 in 2.650s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:06:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a0b572e1-2d15-454f-a62c-6a8f1faf9b58 tempest-DeleteServersTestJSON-261006987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a4aceca8-7d8f-4ed3-b569-e6f06f99195e {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:06:47 devstack sudo[91223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a4aceca8-7d8f-4ed3-b569-e6f06f99195e
Jul 03 01:06:47 devstack sudo[91223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:06:49 devstack sudo[91223]: pam_unix(sudo:session): session closed for user root
Jul 03 01:06:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a0b572e1-2d15-454f-a62c-6a8f1faf9b58 tempest-DeleteServersTestJSON-261006987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a4aceca8-7d8f-4ed3-b569-e6f06f99195e" returned: 0 in 1.906s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:06:49 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-a0b572e1-2d15-454f-a62c-6a8f1faf9b58 tempest-DeleteServersTestJSON-261006987 None] <== create_volume: return (4747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:06:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a0b572e1-2d15-454f-a62c-6a8f1faf9b58 tempest-DeleteServersTestJSON-261006987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.752s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:06:49 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a0b572e1-2d15-454f-a62c-6a8f1faf9b58 tempest-DeleteServersTestJSON-261006987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (280cbc74-a622-46e4-9ce9-35d66a06fd43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4aceca8-7d8f-4ed3-b569-e6f06f99195e', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:06:49 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a0b572e1-2d15-454f-a62c-6a8f1faf9b58 tempest-DeleteServersTestJSON-261006987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bb223c5-a177-4e0d-9cdc-efe0dc9f3be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:06:49 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-a0b572e1-2d15-454f-a62c-6a8f1faf9b58 tempest-DeleteServersTestJSON-261006987 None] Volume volume-a4aceca8-7d8f-4ed3-b569-e6f06f99195e (a4aceca8-7d8f-4ed3-b569-e6f06f99195e): created successfully
Jul 03 01:06:49 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a0b572e1-2d15-454f-a62c-6a8f1faf9b58 tempest-DeleteServersTestJSON-261006987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bb223c5-a177-4e0d-9cdc-efe0dc9f3be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:06:49 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a0b572e1-2d15-454f-a62c-6a8f1faf9b58 tempest-DeleteServersTestJSON-261006987 None] Flow 'volume_create_manager' (3aa6c127-126c-465f-b4c0-9bb33d1e76e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:06:49 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-a0b572e1-2d15-454f-a62c-6a8f1faf9b58 tempest-DeleteServersTestJSON-261006987 None] Created volume successfully.
Jul 03 01:06:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-31c7669f-6ecc-4aee-bf96-dada6ac9ad3b req-10ca9853-d7a3-4b7e-8259-aa805c75f4d8 tempest-DeleteServersTestJSON-261006987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:06:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-31c7669f-6ecc-4aee-bf96-dada6ac9ad3b req-10ca9853-d7a3-4b7e-8259-aa805c75f4d8 tempest-DeleteServersTestJSON-261006987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:06:53 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b3e3d6-3d69-431f-a3c3-4bdd1ffd1c62]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:06:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-31c7669f-6ecc-4aee-bf96-dada6ac9ad3b req-10ca9853-d7a3-4b7e-8259-aa805c75f4d8 tempest-DeleteServersTestJSON-261006987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a4aceca8-7d8f-4ed3-b569-e6f06f99195e {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:06:54 devstack sudo[91294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a4aceca8-7d8f-4ed3-b569-e6f06f99195e
Jul 03 01:06:54 devstack sudo[91294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:06:55 devstack sudo[91294]: pam_unix(sudo:session): session closed for user root
Jul 03 01:06:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-31c7669f-6ecc-4aee-bf96-dada6ac9ad3b req-10ca9853-d7a3-4b7e-8259-aa805c75f4d8 tempest-DeleteServersTestJSON-261006987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a4aceca8-7d8f-4ed3-b569-e6f06f99195e" returned: 0 in 1.231s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:06:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-31c7669f-6ecc-4aee-bf96-dada6ac9ad3b req-10ca9853-d7a3-4b7e-8259-aa805c75f4d8 tempest-DeleteServersTestJSON-261006987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.328s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:06:55 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [req-31c7669f-6ecc-4aee-bf96-dada6ac9ad3b req-10ca9853-d7a3-4b7e-8259-aa805c75f4d8 tempest-DeleteServersTestJSON-261006987 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3', 'name': 'volume-a4aceca8-7d8f-4ed3-b569-e6f06f99195e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0459336f-e0a5-4a79-8f86-a187882891e3', 'enforce_multipath': True} {{(pid=86891) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 01:06:55 devstack cinder-volume[86891]: INFO cinder.volume.manager [req-31c7669f-6ecc-4aee-bf96-dada6ac9ad3b req-10ca9853-d7a3-4b7e-8259-aa805c75f4d8 tempest-DeleteServersTestJSON-261006987 None] attachment_update completed successfully.
Jul 03 01:07:01 devstack cinder-volume[86891]: DEBUG oslo_service.periodic_task [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86891) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 01:07:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:07:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:07:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:07:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:07:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:07:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:07:02 devstack sudo[91957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:07:02 devstack sudo[91957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:07:04 devstack sudo[91957]: pam_unix(sudo:session): session closed for user root
Jul 03 01:07:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 2.279s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:07:04 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:07:04 devstack cinder-volume[86891]: DEBUG oslo_service.periodic_task [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running periodic task VolumeManager._thread_info {{(pid=86891) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 01:07:04 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] thread count: 8 {{(pid=86891) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 01:07:04 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] thread info: [<_MainThread(MainThread, started 136731296534656)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136731184953280)>, <Thread(Thread-3 (stat_writer), started daemon 136731184058816)>, <Thread(Rabbit-heartbeat, started daemon 136731184846080)>, <Thread(Thread-5 (_runner), started daemon 136731182936576)>, <Thread(Thread-7 (_runner), started daemon 136731182954944)>, <Thread(fd_logger, started daemon 136731181916416)>, <Thread(privsep_reader, started daemon 136731180942208)>] {{(pid=86891) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 01:07:05 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d2bd1a0-b172-4ccd-bf1d-393d65f578f8 tempest-ServerRescueNegativeTestJSON-2055190216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:07:05 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-2d2bd1a0-b172-4ccd-bf1d-393d65f578f8 tempest-ServerRescueNegativeTestJSON-2055190216 None] Flow 'volume_create_manager' (dfbe0c16-9478-46ca-8d0c-ab067244f6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:07:05 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-2d2bd1a0-b172-4ccd-bf1d-393d65f578f8 tempest-ServerRescueNegativeTestJSON-2055190216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4026731f-7343-44b8-b26a-2dabf5dd847d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:07:06 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-2d2bd1a0-b172-4ccd-bf1d-393d65f578f8 tempest-ServerRescueNegativeTestJSON-2055190216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4026731f-7343-44b8-b26a-2dabf5dd847d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:07:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-261275761',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9e8ce5d-90cc-4e5f-8230-72304b0bf9aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ac26e7fa64345eea6c378715d5b5afc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:07:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:07:06Z,use_quota=True,user_id='3bb8240c65e6472aaec6d01d692b60c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:07:06 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-2d2bd1a0-b172-4ccd-bf1d-393d65f578f8 tempest-ServerRescueNegativeTestJSON-2055190216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4518890b-280f-45dd-a803-340b5e8270d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:07:06 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-2d2bd1a0-b172-4ccd-bf1d-393d65f578f8 tempest-ServerRescueNegativeTestJSON-2055190216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4518890b-280f-45dd-a803-340b5e8270d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:07:06 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-2d2bd1a0-b172-4ccd-bf1d-393d65f578f8 tempest-ServerRescueNegativeTestJSON-2055190216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cfa3729-34f3-47ba-bea0-3b80946f640c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:07:06 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-2d2bd1a0-b172-4ccd-bf1d-393d65f578f8 tempest-ServerRescueNegativeTestJSON-2055190216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cfa3729-34f3-47ba-bea0-3b80946f640c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9e8ce5d-90cc-4e5f-8230-72304b0bf9aa', 'volume_name': 'volume-e9e8ce5d-90cc-4e5f-8230-72304b0bf9aa', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:07:06 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-2d2bd1a0-b172-4ccd-bf1d-393d65f578f8 tempest-ServerRescueNegativeTestJSON-2055190216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b94267dc-0a74-4a45-b4e2-2cb4fe7a225d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:07:06 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-2d2bd1a0-b172-4ccd-bf1d-393d65f578f8 tempest-ServerRescueNegativeTestJSON-2055190216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b94267dc-0a74-4a45-b4e2-2cb4fe7a225d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:07:06 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-2d2bd1a0-b172-4ccd-bf1d-393d65f578f8 tempest-ServerRescueNegativeTestJSON-2055190216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (add9c39d-e3d2-45be-9e24-8db0dcadeb9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:07:06 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-2d2bd1a0-b172-4ccd-bf1d-393d65f578f8 tempest-ServerRescueNegativeTestJSON-2055190216 None] Volume e9e8ce5d-90cc-4e5f-8230-72304b0bf9aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9e8ce5d-90cc-4e5f-8230-72304b0bf9aa', 'volume_size': 1}
Jul 03 01:07:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-2d2bd1a0-b172-4ccd-bf1d-393d65f578f8 tempest-ServerRescueNegativeTestJSON-2055190216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:07:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-2d2bd1a0-b172-4ccd-bf1d-393d65f578f8 tempest-ServerRescueNegativeTestJSON-2055190216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:07:06 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-2d2bd1a0-b172-4ccd-bf1d-393d65f578f8 tempest-ServerRescueNegativeTestJSON-2055190216 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:07:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-261275761',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9e8ce5d-90cc-4e5f-8230-72304b0bf9aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ac26e7fa64345eea6c378715d5b5afc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:07:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:07:06Z,use_quota=True,user_id='3bb8240c65e6472aaec6d01d692b60c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:07:06 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-2d2bd1a0-b172-4ccd-bf1d-393d65f578f8 tempest-ServerRescueNegativeTestJSON-2055190216 None] Creating volume e9e8ce5d-90cc-4e5f-8230-72304b0bf9aa {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:07:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-2d2bd1a0-b172-4ccd-bf1d-393d65f578f8 tempest-ServerRescueNegativeTestJSON-2055190216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:07:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-2d2bd1a0-b172-4ccd-bf1d-393d65f578f8 tempest-ServerRescueNegativeTestJSON-2055190216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:07:06 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-2d2bd1a0-b172-4ccd-bf1d-393d65f578f8 tempest-ServerRescueNegativeTestJSON-2055190216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:07:06 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-2d2bd1a0-b172-4ccd-bf1d-393d65f578f8 tempest-ServerRescueNegativeTestJSON-2055190216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:07:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-2d2bd1a0-b172-4ccd-bf1d-393d65f578f8 tempest-ServerRescueNegativeTestJSON-2055190216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:07:06 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-2d2bd1a0-b172-4ccd-bf1d-393d65f578f8 tempest-ServerRescueNegativeTestJSON-2055190216 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:07:06 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-2d2bd1a0-b172-4ccd-bf1d-393d65f578f8 tempest-ServerRescueNegativeTestJSON-2055190216 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:07:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-2d2bd1a0-b172-4ccd-bf1d-393d65f578f8 tempest-ServerRescueNegativeTestJSON-2055190216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e9e8ce5d-90cc-4e5f-8230-72304b0bf9aa 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:07:06 devstack sudo[92031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e9e8ce5d-90cc-4e5f-8230-72304b0bf9aa 1073741824
Jul 03 01:07:06 devstack sudo[92031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:07:07 devstack cinder-volume[86891]: INFO cinder.volume.manager [req-2df41c75-bf04-4810-ad9b-3911eecc61c1 req-4b65e79e-591b-43a7-80b7-5420c68cd616 tempest-DeleteServersTestJSON-261006987 None] Terminate volume connection completed successfully.
Jul 03 01:07:07 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [req-2df41c75-bf04-4810-ad9b-3911eecc61c1 req-4b65e79e-591b-43a7-80b7-5420c68cd616 tempest-DeleteServersTestJSON-261006987 None] Deleting attachment 0459336f-e0a5-4a79-8f86-a187882891e3. {{(pid=86891) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 01:07:07 devstack sudo[92031]: pam_unix(sudo:session): session closed for user root
Jul 03 01:07:07 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-2d2bd1a0-b172-4ccd-bf1d-393d65f578f8 tempest-ServerRescueNegativeTestJSON-2055190216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e9e8ce5d-90cc-4e5f-8230-72304b0bf9aa 1073741824" returned: 0 in 1.150s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:07:07 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-2d2bd1a0-b172-4ccd-bf1d-393d65f578f8 tempest-ServerRescueNegativeTestJSON-2055190216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e9e8ce5d-90cc-4e5f-8230-72304b0bf9aa {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:07:07 devstack sudo[92037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e9e8ce5d-90cc-4e5f-8230-72304b0bf9aa
Jul 03 01:07:07 devstack sudo[92037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:07:08 devstack sudo[92037]: pam_unix(sudo:session): session closed for user root
Jul 03 01:07:08 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-2d2bd1a0-b172-4ccd-bf1d-393d65f578f8 tempest-ServerRescueNegativeTestJSON-2055190216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e9e8ce5d-90cc-4e5f-8230-72304b0bf9aa" returned: 0 in 1.265s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:07:08 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-2d2bd1a0-b172-4ccd-bf1d-393d65f578f8 tempest-ServerRescueNegativeTestJSON-2055190216 None] <== create_volume: return (2519ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:07:08 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-2d2bd1a0-b172-4ccd-bf1d-393d65f578f8 tempest-ServerRescueNegativeTestJSON-2055190216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.538s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:07:08 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-2d2bd1a0-b172-4ccd-bf1d-393d65f578f8 tempest-ServerRescueNegativeTestJSON-2055190216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (add9c39d-e3d2-45be-9e24-8db0dcadeb9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9e8ce5d-90cc-4e5f-8230-72304b0bf9aa', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:07:08 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-2d2bd1a0-b172-4ccd-bf1d-393d65f578f8 tempest-ServerRescueNegativeTestJSON-2055190216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d653c090-5ca0-4375-80cc-59f6d708ecf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:07:08 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-2d2bd1a0-b172-4ccd-bf1d-393d65f578f8 tempest-ServerRescueNegativeTestJSON-2055190216 None] Volume volume-e9e8ce5d-90cc-4e5f-8230-72304b0bf9aa (e9e8ce5d-90cc-4e5f-8230-72304b0bf9aa): created successfully
Jul 03 01:07:08 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-2d2bd1a0-b172-4ccd-bf1d-393d65f578f8 tempest-ServerRescueNegativeTestJSON-2055190216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d653c090-5ca0-4375-80cc-59f6d708ecf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:07:08 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-2d2bd1a0-b172-4ccd-bf1d-393d65f578f8 tempest-ServerRescueNegativeTestJSON-2055190216 None] Flow 'volume_create_manager' (dfbe0c16-9478-46ca-8d0c-ab067244f6f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:07:08 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-2d2bd1a0-b172-4ccd-bf1d-393d65f578f8 tempest-ServerRescueNegativeTestJSON-2055190216 None] Created volume successfully.
Jul 03 01:07:11 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-fa62c0e7-39d6-4fb4-8593-50feeabd2d04 tempest-DeleteServersTestJSON-261006987 None] Acquiring lock "cinder-a4aceca8-7d8f-4ed3-b569-e6f06f99195e-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:07:11 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-fa62c0e7-39d6-4fb4-8593-50feeabd2d04 tempest-DeleteServersTestJSON-261006987 None] Lock "cinder-a4aceca8-7d8f-4ed3-b569-e6f06f99195e-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:07:11 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-fa62c0e7-39d6-4fb4-8593-50feeabd2d04 tempest-DeleteServersTestJSON-261006987 None] Acquiring lock "cinder-quobyte-a4aceca8-7d8f-4ed3-b569-e6f06f99195e" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:07:11 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-fa62c0e7-39d6-4fb4-8593-50feeabd2d04 tempest-DeleteServersTestJSON-261006987 None] Lock "cinder-quobyte-a4aceca8-7d8f-4ed3-b569-e6f06f99195e" acquired by "delete_volume" :: waited 0.028s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:07:11 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6cf2b6-4c3b-4fc0-a25f-76fb272f6e9f]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:07:11 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-fa62c0e7-39d6-4fb4-8593-50feeabd2d04 tempest-DeleteServersTestJSON-261006987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a4aceca8-7d8f-4ed3-b569-e6f06f99195e {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:07:12 devstack sudo[92045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a4aceca8-7d8f-4ed3-b569-e6f06f99195e
Jul 03 01:07:12 devstack sudo[92045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:07:13 devstack sudo[92045]: pam_unix(sudo:session): session closed for user root
Jul 03 01:07:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-fa62c0e7-39d6-4fb4-8593-50feeabd2d04 tempest-DeleteServersTestJSON-261006987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a4aceca8-7d8f-4ed3-b569-e6f06f99195e" returned: 0 in 1.340s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:07:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-fa62c0e7-39d6-4fb4-8593-50feeabd2d04 tempest-DeleteServersTestJSON-261006987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a4aceca8-7d8f-4ed3-b569-e6f06f99195e {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:07:13 devstack sudo[92050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a4aceca8-7d8f-4ed3-b569-e6f06f99195e
Jul 03 01:07:13 devstack sudo[92050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:07:14 devstack sudo[92050]: pam_unix(sudo:session): session closed for user root
Jul 03 01:07:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-fa62c0e7-39d6-4fb4-8593-50feeabd2d04 tempest-DeleteServersTestJSON-261006987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a4aceca8-7d8f-4ed3-b569-e6f06f99195e" returned: 0 in 1.292s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:07:14 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-fa62c0e7-39d6-4fb4-8593-50feeabd2d04 tempest-DeleteServersTestJSON-261006987 None] Lock "cinder-quobyte-a4aceca8-7d8f-4ed3-b569-e6f06f99195e" released by "delete_volume" :: held 2.726s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:07:14 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-fa62c0e7-39d6-4fb4-8593-50feeabd2d04 tempest-DeleteServersTestJSON-261006987 None] Created reservations ['930fb6fa-07b7-4303-96d0-05b86fd4184e', '7d8cc1e1-b81e-4ed3-ac66-86807b70a054', '2c6fc014-aefe-45ff-bbc2-71307822147c', '060fe381-ebc4-494c-8fcd-0f22e619a88a'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:07:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-fa62c0e7-39d6-4fb4-8593-50feeabd2d04 tempest-DeleteServersTestJSON-261006987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:07:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-fa62c0e7-39d6-4fb4-8593-50feeabd2d04 tempest-DeleteServersTestJSON-261006987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:07:14 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-fa62c0e7-39d6-4fb4-8593-50feeabd2d04 tempest-DeleteServersTestJSON-261006987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:07:14 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-fa62c0e7-39d6-4fb4-8593-50feeabd2d04 tempest-DeleteServersTestJSON-261006987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:07:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-fa62c0e7-39d6-4fb4-8593-50feeabd2d04 tempest-DeleteServersTestJSON-261006987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:07:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-fa62c0e7-39d6-4fb4-8593-50feeabd2d04 tempest-DeleteServersTestJSON-261006987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:07:14 devstack sudo[92087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:07:14 devstack sudo[92087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:07:16 devstack sudo[92087]: pam_unix(sudo:session): session closed for user root
Jul 03 01:07:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-fa62c0e7-39d6-4fb4-8593-50feeabd2d04 tempest-DeleteServersTestJSON-261006987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 1.215s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:07:16 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-fa62c0e7-39d6-4fb4-8593-50feeabd2d04 tempest-DeleteServersTestJSON-261006987 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:07:16 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-fa62c0e7-39d6-4fb4-8593-50feeabd2d04 tempest-DeleteServersTestJSON-261006987 None] Deleted volume successfully.
Jul 03 01:07:16 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-fa62c0e7-39d6-4fb4-8593-50feeabd2d04 tempest-DeleteServersTestJSON-261006987 None] Lock "cinder-a4aceca8-7d8f-4ed3-b569-e6f06f99195e-delete_volume" released by "delete_volume" :: held 4.441s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:07:24 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:SELECT=29,cinder:UPDATE=30,cinder:DELETE=3,cinder:INSERT=4 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:07:26 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:SELECT=30,cinder:UPDATE=27,cinder:INSERT=7,cinder:DELETE=2 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:07:28 devstack cinder-volume[86891]: INFO cinder.volume.manager [req-0aeac4c1-c6b2-456f-afaa-ae0bb442386a req-4af9ecc4-dbc0-4a2f-b231-529f886cb1ca tempest-AttachVolumeTestJSON-670724779 None] Terminate volume connection completed successfully.
Jul 03 01:07:28 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [req-0aeac4c1-c6b2-456f-afaa-ae0bb442386a req-4af9ecc4-dbc0-4a2f-b231-529f886cb1ca tempest-AttachVolumeTestJSON-670724779 None] Deleting attachment f3108263-86e8-47cc-b636-842d894cfc5e. {{(pid=86891) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 01:07:29 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-26ac90d6-6545-45a3-9422-330a5f125541 tempest-VolumesTestJSON-1641805777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:07:29 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-26ac90d6-6545-45a3-9422-330a5f125541 tempest-VolumesTestJSON-1641805777 None] Flow 'volume_create_manager' (9078b729-a216-44f4-97fa-2923f8983022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:07:29 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-26ac90d6-6545-45a3-9422-330a5f125541 tempest-VolumesTestJSON-1641805777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76c027de-9b5a-47bd-9519-889055a9a6ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:07:29 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-128f9859-9d3f-4249-a294-e95dddc0d426 tempest-ServerRescueNegativeTestJSON-2055190216 None] Acquiring lock "cinder-e9e8ce5d-90cc-4e5f-8230-72304b0bf9aa-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:07:30 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-26ac90d6-6545-45a3-9422-330a5f125541 tempest-VolumesTestJSON-1641805777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76c027de-9b5a-47bd-9519-889055a9a6ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:07:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-618634066',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be270535-acf7-46f4-8920-cfae9ca90a65,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8ef3a7e4f81f48d1966ede6a328ec676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:07:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:07:30Z,use_quota=True,user_id='35d263406e4242d39a6cda0874d2c900',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:07:30 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-26ac90d6-6545-45a3-9422-330a5f125541 tempest-VolumesTestJSON-1641805777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50229ed9-0496-4f89-b113-9c596bdbd4a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:07:30 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-26ac90d6-6545-45a3-9422-330a5f125541 tempest-VolumesTestJSON-1641805777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50229ed9-0496-4f89-b113-9c596bdbd4a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:07:30 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-26ac90d6-6545-45a3-9422-330a5f125541 tempest-VolumesTestJSON-1641805777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aafd684d-37f1-434b-8702-2194bb804318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:07:30 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-26ac90d6-6545-45a3-9422-330a5f125541 tempest-VolumesTestJSON-1641805777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aafd684d-37f1-434b-8702-2194bb804318) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be270535-acf7-46f4-8920-cfae9ca90a65', 'volume_name': 'volume-be270535-acf7-46f4-8920-cfae9ca90a65', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:07:30 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-26ac90d6-6545-45a3-9422-330a5f125541 tempest-VolumesTestJSON-1641805777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adffb25f-fdeb-4505-b954-b0672da3f6ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:07:30 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-26ac90d6-6545-45a3-9422-330a5f125541 tempest-VolumesTestJSON-1641805777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adffb25f-fdeb-4505-b954-b0672da3f6ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:07:30 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-26ac90d6-6545-45a3-9422-330a5f125541 tempest-VolumesTestJSON-1641805777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3df13e72-0844-4c91-b232-0a49c5994fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:07:30 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-26ac90d6-6545-45a3-9422-330a5f125541 tempest-VolumesTestJSON-1641805777 None] Volume be270535-acf7-46f4-8920-cfae9ca90a65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be270535-acf7-46f4-8920-cfae9ca90a65', 'volume_size': 1}
Jul 03 01:07:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-26ac90d6-6545-45a3-9422-330a5f125541 tempest-VolumesTestJSON-1641805777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:07:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-26ac90d6-6545-45a3-9422-330a5f125541 tempest-VolumesTestJSON-1641805777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:07:30 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-26ac90d6-6545-45a3-9422-330a5f125541 tempest-VolumesTestJSON-1641805777 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:07:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-618634066',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be270535-acf7-46f4-8920-cfae9ca90a65,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8ef3a7e4f81f48d1966ede6a328ec676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:07:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:07:30Z,use_quota=True,user_id='35d263406e4242d39a6cda0874d2c900',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:07:30 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-26ac90d6-6545-45a3-9422-330a5f125541 tempest-VolumesTestJSON-1641805777 None] Creating volume be270535-acf7-46f4-8920-cfae9ca90a65 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:07:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-26ac90d6-6545-45a3-9422-330a5f125541 tempest-VolumesTestJSON-1641805777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:07:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-26ac90d6-6545-45a3-9422-330a5f125541 tempest-VolumesTestJSON-1641805777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:07:30 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-26ac90d6-6545-45a3-9422-330a5f125541 tempest-VolumesTestJSON-1641805777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:07:30 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-26ac90d6-6545-45a3-9422-330a5f125541 tempest-VolumesTestJSON-1641805777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:07:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-26ac90d6-6545-45a3-9422-330a5f125541 tempest-VolumesTestJSON-1641805777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:07:30 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-26ac90d6-6545-45a3-9422-330a5f125541 tempest-VolumesTestJSON-1641805777 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:07:30 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-26ac90d6-6545-45a3-9422-330a5f125541 tempest-VolumesTestJSON-1641805777 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:07:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-26ac90d6-6545-45a3-9422-330a5f125541 tempest-VolumesTestJSON-1641805777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-be270535-acf7-46f4-8920-cfae9ca90a65 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:07:30 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-128f9859-9d3f-4249-a294-e95dddc0d426 tempest-ServerRescueNegativeTestJSON-2055190216 None] Lock "cinder-e9e8ce5d-90cc-4e5f-8230-72304b0bf9aa-delete_volume" acquired by "delete_volume" :: waited 0.113s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:07:30 devstack sudo[92329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-be270535-acf7-46f4-8920-cfae9ca90a65 1073741824
Jul 03 01:07:30 devstack sudo[92329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:07:30 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-128f9859-9d3f-4249-a294-e95dddc0d426 tempest-ServerRescueNegativeTestJSON-2055190216 None] Acquiring lock "cinder-quobyte-e9e8ce5d-90cc-4e5f-8230-72304b0bf9aa" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:07:30 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-128f9859-9d3f-4249-a294-e95dddc0d426 tempest-ServerRescueNegativeTestJSON-2055190216 None] Lock "cinder-quobyte-e9e8ce5d-90cc-4e5f-8230-72304b0bf9aa" acquired by "delete_volume" :: waited 0.035s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:07:30 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[e12b3837-298a-48e4-b7e0-a0f3e1499c0f]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:07:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-128f9859-9d3f-4249-a294-e95dddc0d426 tempest-ServerRescueNegativeTestJSON-2055190216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e9e8ce5d-90cc-4e5f-8230-72304b0bf9aa {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:07:30 devstack sudo[92331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e9e8ce5d-90cc-4e5f-8230-72304b0bf9aa
Jul 03 01:07:30 devstack sudo[92331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:07:31 devstack sudo[92329]: pam_unix(sudo:session): session closed for user root
Jul 03 01:07:31 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-26ac90d6-6545-45a3-9422-330a5f125541 tempest-VolumesTestJSON-1641805777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-be270535-acf7-46f4-8920-cfae9ca90a65 1073741824" returned: 0 in 1.647s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:07:31 devstack sudo[92331]: pam_unix(sudo:session): session closed for user root
Jul 03 01:07:31 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-128f9859-9d3f-4249-a294-e95dddc0d426 tempest-ServerRescueNegativeTestJSON-2055190216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e9e8ce5d-90cc-4e5f-8230-72304b0bf9aa" returned: 0 in 1.480s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:07:31 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-128f9859-9d3f-4249-a294-e95dddc0d426 tempest-ServerRescueNegativeTestJSON-2055190216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e9e8ce5d-90cc-4e5f-8230-72304b0bf9aa {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:07:31 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-26ac90d6-6545-45a3-9422-330a5f125541 tempest-VolumesTestJSON-1641805777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-be270535-acf7-46f4-8920-cfae9ca90a65 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:07:31 devstack sudo[92377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e9e8ce5d-90cc-4e5f-8230-72304b0bf9aa
Jul 03 01:07:31 devstack sudo[92377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:07:31 devstack sudo[92379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-be270535-acf7-46f4-8920-cfae9ca90a65
Jul 03 01:07:31 devstack sudo[92379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:07:32 devstack sudo[92379]: pam_unix(sudo:session): session closed for user root
Jul 03 01:07:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-26ac90d6-6545-45a3-9422-330a5f125541 tempest-VolumesTestJSON-1641805777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-be270535-acf7-46f4-8920-cfae9ca90a65" returned: 0 in 1.052s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:07:32 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-26ac90d6-6545-45a3-9422-330a5f125541 tempest-VolumesTestJSON-1641805777 None] <== create_volume: return (2810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:07:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-26ac90d6-6545-45a3-9422-330a5f125541 tempest-VolumesTestJSON-1641805777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.817s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:07:32 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-26ac90d6-6545-45a3-9422-330a5f125541 tempest-VolumesTestJSON-1641805777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3df13e72-0844-4c91-b232-0a49c5994fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be270535-acf7-46f4-8920-cfae9ca90a65', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:07:32 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-26ac90d6-6545-45a3-9422-330a5f125541 tempest-VolumesTestJSON-1641805777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7842967-a760-4b96-b0ea-bda861ee6859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:07:32 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-26ac90d6-6545-45a3-9422-330a5f125541 tempest-VolumesTestJSON-1641805777 None] Volume volume-be270535-acf7-46f4-8920-cfae9ca90a65 (be270535-acf7-46f4-8920-cfae9ca90a65): created successfully
Jul 03 01:07:32 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-26ac90d6-6545-45a3-9422-330a5f125541 tempest-VolumesTestJSON-1641805777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7842967-a760-4b96-b0ea-bda861ee6859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:07:32 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-26ac90d6-6545-45a3-9422-330a5f125541 tempest-VolumesTestJSON-1641805777 None] Flow 'volume_create_manager' (9078b729-a216-44f4-97fa-2923f8983022) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:07:33 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-26ac90d6-6545-45a3-9422-330a5f125541 tempest-VolumesTestJSON-1641805777 None] Created volume successfully.
Jul 03 01:07:33 devstack sudo[92377]: pam_unix(sudo:session): session closed for user root
Jul 03 01:07:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-128f9859-9d3f-4249-a294-e95dddc0d426 tempest-ServerRescueNegativeTestJSON-2055190216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e9e8ce5d-90cc-4e5f-8230-72304b0bf9aa" returned: 0 in 1.343s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:07:33 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-128f9859-9d3f-4249-a294-e95dddc0d426 tempest-ServerRescueNegativeTestJSON-2055190216 None] Lock "cinder-quobyte-e9e8ce5d-90cc-4e5f-8230-72304b0bf9aa" released by "delete_volume" :: held 2.895s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:07:33 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-128f9859-9d3f-4249-a294-e95dddc0d426 tempest-ServerRescueNegativeTestJSON-2055190216 None] Created reservations ['c09e405a-3a18-42d0-80f9-b0ea46659b69', '70d3ad49-fd33-4b89-b315-97cedcab9a1b', '06966b3b-8e17-452f-bab3-ca68acadc565', '8d2a3128-ecf1-4a08-9f06-9382bf821afe'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:07:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-128f9859-9d3f-4249-a294-e95dddc0d426 tempest-ServerRescueNegativeTestJSON-2055190216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:07:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-128f9859-9d3f-4249-a294-e95dddc0d426 tempest-ServerRescueNegativeTestJSON-2055190216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:07:33 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-128f9859-9d3f-4249-a294-e95dddc0d426 tempest-ServerRescueNegativeTestJSON-2055190216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:07:33 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-128f9859-9d3f-4249-a294-e95dddc0d426 tempest-ServerRescueNegativeTestJSON-2055190216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:07:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-128f9859-9d3f-4249-a294-e95dddc0d426 tempest-ServerRescueNegativeTestJSON-2055190216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:07:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-128f9859-9d3f-4249-a294-e95dddc0d426 tempest-ServerRescueNegativeTestJSON-2055190216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:07:33 devstack sudo[92386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:07:33 devstack sudo[92386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:07:34 devstack sudo[92386]: pam_unix(sudo:session): session closed for user root
Jul 03 01:07:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-128f9859-9d3f-4249-a294-e95dddc0d426 tempest-ServerRescueNegativeTestJSON-2055190216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 1.160s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:07:34 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-128f9859-9d3f-4249-a294-e95dddc0d426 tempest-ServerRescueNegativeTestJSON-2055190216 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:07:34 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-128f9859-9d3f-4249-a294-e95dddc0d426 tempest-ServerRescueNegativeTestJSON-2055190216 None] Deleted volume successfully.
Jul 03 01:07:34 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-128f9859-9d3f-4249-a294-e95dddc0d426 tempest-ServerRescueNegativeTestJSON-2055190216 None] Lock "cinder-e9e8ce5d-90cc-4e5f-8230-72304b0bf9aa-delete_volume" released by "delete_volume" :: held 4.503s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:07:34 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ce21521-7c7d-40a4-8382-7a9d99ec6916 tempest-VolumesTestJSON-1641805777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:07:34 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7ce21521-7c7d-40a4-8382-7a9d99ec6916 tempest-VolumesTestJSON-1641805777 None] Flow 'volume_create_manager' (9a18be83-28e7-4f94-9bb7-d7007866cbf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:07:34 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7ce21521-7c7d-40a4-8382-7a9d99ec6916 tempest-VolumesTestJSON-1641805777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03207ce1-c906-481a-ad16-1fb862964f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:07:34 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7ce21521-7c7d-40a4-8382-7a9d99ec6916 tempest-VolumesTestJSON-1641805777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03207ce1-c906-481a-ad16-1fb862964f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:07:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-779164797',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93464ac5-f4cf-402d-ab25-a8d231ccb1b2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8ef3a7e4f81f48d1966ede6a328ec676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:07:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:07:35Z,use_quota=True,user_id='35d263406e4242d39a6cda0874d2c900',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:07:34 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7ce21521-7c7d-40a4-8382-7a9d99ec6916 tempest-VolumesTestJSON-1641805777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (172c7d23-fe9a-4038-98db-558ab9e69979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:07:34 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7ce21521-7c7d-40a4-8382-7a9d99ec6916 tempest-VolumesTestJSON-1641805777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (172c7d23-fe9a-4038-98db-558ab9e69979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:07:34 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7ce21521-7c7d-40a4-8382-7a9d99ec6916 tempest-VolumesTestJSON-1641805777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7c3cf44-b4ce-428b-a4ce-d5afb00d964b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:07:34 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7ce21521-7c7d-40a4-8382-7a9d99ec6916 tempest-VolumesTestJSON-1641805777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7c3cf44-b4ce-428b-a4ce-d5afb00d964b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93464ac5-f4cf-402d-ab25-a8d231ccb1b2', 'volume_name': 'volume-93464ac5-f4cf-402d-ab25-a8d231ccb1b2', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:07:34 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7ce21521-7c7d-40a4-8382-7a9d99ec6916 tempest-VolumesTestJSON-1641805777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab714637-a859-4def-898c-0c7b114d79eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:07:34 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7ce21521-7c7d-40a4-8382-7a9d99ec6916 tempest-VolumesTestJSON-1641805777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab714637-a859-4def-898c-0c7b114d79eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:07:34 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7ce21521-7c7d-40a4-8382-7a9d99ec6916 tempest-VolumesTestJSON-1641805777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ad9fae1-d1f7-4a91-aafb-0dd8b071877e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:07:34 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-7ce21521-7c7d-40a4-8382-7a9d99ec6916 tempest-VolumesTestJSON-1641805777 None] Volume 93464ac5-f4cf-402d-ab25-a8d231ccb1b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93464ac5-f4cf-402d-ab25-a8d231ccb1b2', 'volume_size': 1}
Jul 03 01:07:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-7ce21521-7c7d-40a4-8382-7a9d99ec6916 tempest-VolumesTestJSON-1641805777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:07:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-7ce21521-7c7d-40a4-8382-7a9d99ec6916 tempest-VolumesTestJSON-1641805777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:07:34 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-7ce21521-7c7d-40a4-8382-7a9d99ec6916 tempest-VolumesTestJSON-1641805777 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:07:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-779164797',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93464ac5-f4cf-402d-ab25-a8d231ccb1b2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8ef3a7e4f81f48d1966ede6a328ec676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:07:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:07:35Z,use_quota=True,user_id='35d263406e4242d39a6cda0874d2c900',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:07:34 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-7ce21521-7c7d-40a4-8382-7a9d99ec6916 tempest-VolumesTestJSON-1641805777 None] Creating volume 93464ac5-f4cf-402d-ab25-a8d231ccb1b2 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:07:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-7ce21521-7c7d-40a4-8382-7a9d99ec6916 tempest-VolumesTestJSON-1641805777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:07:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-7ce21521-7c7d-40a4-8382-7a9d99ec6916 tempest-VolumesTestJSON-1641805777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:07:34 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-7ce21521-7c7d-40a4-8382-7a9d99ec6916 tempest-VolumesTestJSON-1641805777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:07:34 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-7ce21521-7c7d-40a4-8382-7a9d99ec6916 tempest-VolumesTestJSON-1641805777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:07:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-7ce21521-7c7d-40a4-8382-7a9d99ec6916 tempest-VolumesTestJSON-1641805777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:07:34 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-7ce21521-7c7d-40a4-8382-7a9d99ec6916 tempest-VolumesTestJSON-1641805777 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:07:34 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-7ce21521-7c7d-40a4-8382-7a9d99ec6916 tempest-VolumesTestJSON-1641805777 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:07:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-7ce21521-7c7d-40a4-8382-7a9d99ec6916 tempest-VolumesTestJSON-1641805777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-93464ac5-f4cf-402d-ab25-a8d231ccb1b2 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:07:34 devstack sudo[92394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-93464ac5-f4cf-402d-ab25-a8d231ccb1b2 1073741824
Jul 03 01:07:34 devstack sudo[92394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:07:36 devstack sudo[92394]: pam_unix(sudo:session): session closed for user root
Jul 03 01:07:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-7ce21521-7c7d-40a4-8382-7a9d99ec6916 tempest-VolumesTestJSON-1641805777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-93464ac5-f4cf-402d-ab25-a8d231ccb1b2 1073741824" returned: 0 in 1.356s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:07:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-7ce21521-7c7d-40a4-8382-7a9d99ec6916 tempest-VolumesTestJSON-1641805777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-93464ac5-f4cf-402d-ab25-a8d231ccb1b2 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:07:36 devstack sudo[92439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-93464ac5-f4cf-402d-ab25-a8d231ccb1b2
Jul 03 01:07:36 devstack sudo[92439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:07:37 devstack sudo[92439]: pam_unix(sudo:session): session closed for user root
Jul 03 01:07:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-7ce21521-7c7d-40a4-8382-7a9d99ec6916 tempest-VolumesTestJSON-1641805777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-93464ac5-f4cf-402d-ab25-a8d231ccb1b2" returned: 0 in 1.221s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:07:37 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-7ce21521-7c7d-40a4-8382-7a9d99ec6916 tempest-VolumesTestJSON-1641805777 None] <== create_volume: return (2645ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:07:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-7ce21521-7c7d-40a4-8382-7a9d99ec6916 tempest-VolumesTestJSON-1641805777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.648s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:07:37 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7ce21521-7c7d-40a4-8382-7a9d99ec6916 tempest-VolumesTestJSON-1641805777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ad9fae1-d1f7-4a91-aafb-0dd8b071877e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93464ac5-f4cf-402d-ab25-a8d231ccb1b2', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:07:37 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7ce21521-7c7d-40a4-8382-7a9d99ec6916 tempest-VolumesTestJSON-1641805777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9801579-4de5-4b50-81d1-67592e742fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:07:37 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-7ce21521-7c7d-40a4-8382-7a9d99ec6916 tempest-VolumesTestJSON-1641805777 None] Volume volume-93464ac5-f4cf-402d-ab25-a8d231ccb1b2 (93464ac5-f4cf-402d-ab25-a8d231ccb1b2): created successfully
Jul 03 01:07:37 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7ce21521-7c7d-40a4-8382-7a9d99ec6916 tempest-VolumesTestJSON-1641805777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9801579-4de5-4b50-81d1-67592e742fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:07:37 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7ce21521-7c7d-40a4-8382-7a9d99ec6916 tempest-VolumesTestJSON-1641805777 None] Flow 'volume_create_manager' (9a18be83-28e7-4f94-9bb7-d7007866cbf0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:07:37 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-7ce21521-7c7d-40a4-8382-7a9d99ec6916 tempest-VolumesTestJSON-1641805777 None] Created volume successfully.
Jul 03 01:07:38 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d3bbd26-995d-4c26-b8c4-376b23a3b063 tempest-VolumesTestJSON-1641805777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:07:38 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3d3bbd26-995d-4c26-b8c4-376b23a3b063 tempest-VolumesTestJSON-1641805777 None] Flow 'volume_create_manager' (9b3ee97c-a194-459f-a6af-0a980c57710b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:07:38 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3d3bbd26-995d-4c26-b8c4-376b23a3b063 tempest-VolumesTestJSON-1641805777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cde29c4-0f03-4303-9f42-6c77ad901b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:07:38 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3d3bbd26-995d-4c26-b8c4-376b23a3b063 tempest-VolumesTestJSON-1641805777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cde29c4-0f03-4303-9f42-6c77ad901b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:07:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1538526378',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b476f50d-9dad-44ef-aaf4-17ebbd4b0ed0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8ef3a7e4f81f48d1966ede6a328ec676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:07:39Z,use_quota=True,user_id='35d263406e4242d39a6cda0874d2c900',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:07:38 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3d3bbd26-995d-4c26-b8c4-376b23a3b063 tempest-VolumesTestJSON-1641805777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98e43584-557b-4e4a-bbdb-a145c7cea536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:07:38 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3d3bbd26-995d-4c26-b8c4-376b23a3b063 tempest-VolumesTestJSON-1641805777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98e43584-557b-4e4a-bbdb-a145c7cea536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:07:38 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3d3bbd26-995d-4c26-b8c4-376b23a3b063 tempest-VolumesTestJSON-1641805777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1796f618-0a4e-45d3-8e54-b7b58df23124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:07:38 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3d3bbd26-995d-4c26-b8c4-376b23a3b063 tempest-VolumesTestJSON-1641805777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1796f618-0a4e-45d3-8e54-b7b58df23124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b476f50d-9dad-44ef-aaf4-17ebbd4b0ed0', 'volume_name': 'volume-b476f50d-9dad-44ef-aaf4-17ebbd4b0ed0', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:07:38 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3d3bbd26-995d-4c26-b8c4-376b23a3b063 tempest-VolumesTestJSON-1641805777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb7e1e2d-1323-44b6-b080-4447e6436957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:07:38 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3d3bbd26-995d-4c26-b8c4-376b23a3b063 tempest-VolumesTestJSON-1641805777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb7e1e2d-1323-44b6-b080-4447e6436957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:07:38 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3d3bbd26-995d-4c26-b8c4-376b23a3b063 tempest-VolumesTestJSON-1641805777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (469fe29e-a78d-4728-a994-45df29944b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:07:38 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-3d3bbd26-995d-4c26-b8c4-376b23a3b063 tempest-VolumesTestJSON-1641805777 None] Volume b476f50d-9dad-44ef-aaf4-17ebbd4b0ed0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b476f50d-9dad-44ef-aaf4-17ebbd4b0ed0', 'volume_size': 1}
Jul 03 01:07:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-3d3bbd26-995d-4c26-b8c4-376b23a3b063 tempest-VolumesTestJSON-1641805777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:07:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-3d3bbd26-995d-4c26-b8c4-376b23a3b063 tempest-VolumesTestJSON-1641805777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:07:38 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-3d3bbd26-995d-4c26-b8c4-376b23a3b063 tempest-VolumesTestJSON-1641805777 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:07:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1538526378',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b476f50d-9dad-44ef-aaf4-17ebbd4b0ed0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8ef3a7e4f81f48d1966ede6a328ec676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:07:39Z,use_quota=True,user_id='35d263406e4242d39a6cda0874d2c900',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:07:38 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-3d3bbd26-995d-4c26-b8c4-376b23a3b063 tempest-VolumesTestJSON-1641805777 None] Creating volume b476f50d-9dad-44ef-aaf4-17ebbd4b0ed0 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:07:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-3d3bbd26-995d-4c26-b8c4-376b23a3b063 tempest-VolumesTestJSON-1641805777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:07:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-3d3bbd26-995d-4c26-b8c4-376b23a3b063 tempest-VolumesTestJSON-1641805777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:07:38 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-3d3bbd26-995d-4c26-b8c4-376b23a3b063 tempest-VolumesTestJSON-1641805777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:07:38 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-3d3bbd26-995d-4c26-b8c4-376b23a3b063 tempest-VolumesTestJSON-1641805777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:07:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-3d3bbd26-995d-4c26-b8c4-376b23a3b063 tempest-VolumesTestJSON-1641805777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:07:39 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-3d3bbd26-995d-4c26-b8c4-376b23a3b063 tempest-VolumesTestJSON-1641805777 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:07:39 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-3d3bbd26-995d-4c26-b8c4-376b23a3b063 tempest-VolumesTestJSON-1641805777 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:07:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-3d3bbd26-995d-4c26-b8c4-376b23a3b063 tempest-VolumesTestJSON-1641805777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b476f50d-9dad-44ef-aaf4-17ebbd4b0ed0 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:07:39 devstack sudo[92464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b476f50d-9dad-44ef-aaf4-17ebbd4b0ed0 1073741824
Jul 03 01:07:39 devstack sudo[92464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:07:40 devstack sudo[92464]: pam_unix(sudo:session): session closed for user root
Jul 03 01:07:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-3d3bbd26-995d-4c26-b8c4-376b23a3b063 tempest-VolumesTestJSON-1641805777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b476f50d-9dad-44ef-aaf4-17ebbd4b0ed0 1073741824" returned: 0 in 1.282s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:07:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-3d3bbd26-995d-4c26-b8c4-376b23a3b063 tempest-VolumesTestJSON-1641805777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b476f50d-9dad-44ef-aaf4-17ebbd4b0ed0 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:07:40 devstack sudo[92485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b476f50d-9dad-44ef-aaf4-17ebbd4b0ed0
Jul 03 01:07:40 devstack sudo[92485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:07:41 devstack sudo[92485]: pam_unix(sudo:session): session closed for user root
Jul 03 01:07:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-3d3bbd26-995d-4c26-b8c4-376b23a3b063 tempest-VolumesTestJSON-1641805777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b476f50d-9dad-44ef-aaf4-17ebbd4b0ed0" returned: 0 in 0.808s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:07:41 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-3d3bbd26-995d-4c26-b8c4-376b23a3b063 tempest-VolumesTestJSON-1641805777 None] <== create_volume: return (2169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:07:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-3d3bbd26-995d-4c26-b8c4-376b23a3b063 tempest-VolumesTestJSON-1641805777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.171s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:07:41 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3d3bbd26-995d-4c26-b8c4-376b23a3b063 tempest-VolumesTestJSON-1641805777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (469fe29e-a78d-4728-a994-45df29944b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b476f50d-9dad-44ef-aaf4-17ebbd4b0ed0', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:07:41 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3d3bbd26-995d-4c26-b8c4-376b23a3b063 tempest-VolumesTestJSON-1641805777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25ca2adb-5fca-4eb9-a61d-6bc24d3f2990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:07:41 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-3d3bbd26-995d-4c26-b8c4-376b23a3b063 tempest-VolumesTestJSON-1641805777 None] Volume volume-b476f50d-9dad-44ef-aaf4-17ebbd4b0ed0 (b476f50d-9dad-44ef-aaf4-17ebbd4b0ed0): created successfully
Jul 03 01:07:41 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3d3bbd26-995d-4c26-b8c4-376b23a3b063 tempest-VolumesTestJSON-1641805777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25ca2adb-5fca-4eb9-a61d-6bc24d3f2990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:07:41 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3d3bbd26-995d-4c26-b8c4-376b23a3b063 tempest-VolumesTestJSON-1641805777 None] Flow 'volume_create_manager' (9b3ee97c-a194-459f-a6af-0a980c57710b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:07:41 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-3d3bbd26-995d-4c26-b8c4-376b23a3b063 tempest-VolumesTestJSON-1641805777 None] Created volume successfully.
Jul 03 01:07:43 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-c2812738-c37c-48a8-a0ea-32e9b39683ee tempest-VolumesTestJSON-1641805777 None] Acquiring lock "cinder-b476f50d-9dad-44ef-aaf4-17ebbd4b0ed0-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:07:43 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-c2812738-c37c-48a8-a0ea-32e9b39683ee tempest-VolumesTestJSON-1641805777 None] Lock "cinder-b476f50d-9dad-44ef-aaf4-17ebbd4b0ed0-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:07:43 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-c2812738-c37c-48a8-a0ea-32e9b39683ee tempest-VolumesTestJSON-1641805777 None] Acquiring lock "cinder-quobyte-b476f50d-9dad-44ef-aaf4-17ebbd4b0ed0" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:07:43 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-c2812738-c37c-48a8-a0ea-32e9b39683ee tempest-VolumesTestJSON-1641805777 None] Lock "cinder-quobyte-b476f50d-9dad-44ef-aaf4-17ebbd4b0ed0" acquired by "delete_volume" :: waited 0.022s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:07:43 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[df0c6f88-c103-489b-b02f-298dc16fc2b0]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:07:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c2812738-c37c-48a8-a0ea-32e9b39683ee tempest-VolumesTestJSON-1641805777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b476f50d-9dad-44ef-aaf4-17ebbd4b0ed0 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:07:43 devstack sudo[92584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b476f50d-9dad-44ef-aaf4-17ebbd4b0ed0
Jul 03 01:07:43 devstack sudo[92584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:07:45 devstack sudo[92584]: pam_unix(sudo:session): session closed for user root
Jul 03 01:07:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c2812738-c37c-48a8-a0ea-32e9b39683ee tempest-VolumesTestJSON-1641805777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b476f50d-9dad-44ef-aaf4-17ebbd4b0ed0" returned: 0 in 1.580s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:07:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c2812738-c37c-48a8-a0ea-32e9b39683ee tempest-VolumesTestJSON-1641805777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b476f50d-9dad-44ef-aaf4-17ebbd4b0ed0 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:07:45 devstack sudo[92627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b476f50d-9dad-44ef-aaf4-17ebbd4b0ed0
Jul 03 01:07:45 devstack sudo[92627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:07:45 devstack sudo[92627]: pam_unix(sudo:session): session closed for user root
Jul 03 01:07:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c2812738-c37c-48a8-a0ea-32e9b39683ee tempest-VolumesTestJSON-1641805777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b476f50d-9dad-44ef-aaf4-17ebbd4b0ed0" returned: 0 in 0.858s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:07:45 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-c2812738-c37c-48a8-a0ea-32e9b39683ee tempest-VolumesTestJSON-1641805777 None] Lock "cinder-quobyte-b476f50d-9dad-44ef-aaf4-17ebbd4b0ed0" released by "delete_volume" :: held 2.501s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:07:45 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-c2812738-c37c-48a8-a0ea-32e9b39683ee tempest-VolumesTestJSON-1641805777 None] Created reservations ['afd9e191-a46a-4f78-a6d5-616c5d5b291b', '5f05a48f-9dac-42a0-b237-76d28894abbd', '0dbfd50b-a482-4690-b7cd-e83de73bd580', '93209dc1-d256-4c68-92e2-8db0b9eaec47'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:07:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-c2812738-c37c-48a8-a0ea-32e9b39683ee tempest-VolumesTestJSON-1641805777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:07:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-c2812738-c37c-48a8-a0ea-32e9b39683ee tempest-VolumesTestJSON-1641805777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:07:46 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-c2812738-c37c-48a8-a0ea-32e9b39683ee tempest-VolumesTestJSON-1641805777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:07:46 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-c2812738-c37c-48a8-a0ea-32e9b39683ee tempest-VolumesTestJSON-1641805777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:07:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-c2812738-c37c-48a8-a0ea-32e9b39683ee tempest-VolumesTestJSON-1641805777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.059s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:07:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c2812738-c37c-48a8-a0ea-32e9b39683ee tempest-VolumesTestJSON-1641805777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:07:46 devstack sudo[92653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:07:46 devstack sudo[92653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:07:46 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8c9f6563-48b0-4723-a9db-470b312b302a tempest-VolumesTestJSON-1641805777 None] Acquiring lock "cinder-93464ac5-f4cf-402d-ab25-a8d231ccb1b2-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:07:46 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8c9f6563-48b0-4723-a9db-470b312b302a tempest-VolumesTestJSON-1641805777 None] Lock "cinder-93464ac5-f4cf-402d-ab25-a8d231ccb1b2-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:07:47 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8c9f6563-48b0-4723-a9db-470b312b302a tempest-VolumesTestJSON-1641805777 None] Acquiring lock "cinder-quobyte-93464ac5-f4cf-402d-ab25-a8d231ccb1b2" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:07:47 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8c9f6563-48b0-4723-a9db-470b312b302a tempest-VolumesTestJSON-1641805777 None] Lock "cinder-quobyte-93464ac5-f4cf-402d-ab25-a8d231ccb1b2" acquired by "delete_volume" :: waited 0.040s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:07:47 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[0abcf41f-98b7-4c54-9a1c-f9b2c472f177]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:07:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8c9f6563-48b0-4723-a9db-470b312b302a tempest-VolumesTestJSON-1641805777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-93464ac5-f4cf-402d-ab25-a8d231ccb1b2 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:07:47 devstack sudo[92684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-93464ac5-f4cf-402d-ab25-a8d231ccb1b2
Jul 03 01:07:47 devstack sudo[92684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:07:48 devstack sudo[92653]: pam_unix(sudo:session): session closed for user root
Jul 03 01:07:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c2812738-c37c-48a8-a0ea-32e9b39683ee tempest-VolumesTestJSON-1641805777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 2.075s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:07:48 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-c2812738-c37c-48a8-a0ea-32e9b39683ee tempest-VolumesTestJSON-1641805777 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:07:48 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-c2812738-c37c-48a8-a0ea-32e9b39683ee tempest-VolumesTestJSON-1641805777 None] Deleted volume successfully.
Jul 03 01:07:48 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-c2812738-c37c-48a8-a0ea-32e9b39683ee tempest-VolumesTestJSON-1641805777 None] Lock "cinder-b476f50d-9dad-44ef-aaf4-17ebbd4b0ed0-delete_volume" released by "delete_volume" :: held 5.166s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:07:48 devstack sudo[92684]: pam_unix(sudo:session): session closed for user root
Jul 03 01:07:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8c9f6563-48b0-4723-a9db-470b312b302a tempest-VolumesTestJSON-1641805777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-93464ac5-f4cf-402d-ab25-a8d231ccb1b2" returned: 0 in 1.444s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:07:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8c9f6563-48b0-4723-a9db-470b312b302a tempest-VolumesTestJSON-1641805777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-93464ac5-f4cf-402d-ab25-a8d231ccb1b2 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:07:48 devstack sudo[92701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-93464ac5-f4cf-402d-ab25-a8d231ccb1b2
Jul 03 01:07:48 devstack sudo[92701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:07:49 devstack sudo[92701]: pam_unix(sudo:session): session closed for user root
Jul 03 01:07:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8c9f6563-48b0-4723-a9db-470b312b302a tempest-VolumesTestJSON-1641805777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-93464ac5-f4cf-402d-ab25-a8d231ccb1b2" returned: 0 in 0.890s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:07:49 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8c9f6563-48b0-4723-a9db-470b312b302a tempest-VolumesTestJSON-1641805777 None] Lock "cinder-quobyte-93464ac5-f4cf-402d-ab25-a8d231ccb1b2" released by "delete_volume" :: held 2.479s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:07:49 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-8c9f6563-48b0-4723-a9db-470b312b302a tempest-VolumesTestJSON-1641805777 None] Created reservations ['f769ad05-2fc7-42f4-8111-5900533c9933', '77c4b515-e6db-4a6e-b7dc-91c832dc19bc', '315432c5-10bd-40ce-adab-5f690515bbc7', '35b9b553-47ed-408f-9512-a0f90041ad7d'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:07:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-8c9f6563-48b0-4723-a9db-470b312b302a tempest-VolumesTestJSON-1641805777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:07:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-8c9f6563-48b0-4723-a9db-470b312b302a tempest-VolumesTestJSON-1641805777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:07:49 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-8c9f6563-48b0-4723-a9db-470b312b302a tempest-VolumesTestJSON-1641805777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:07:49 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-8c9f6563-48b0-4723-a9db-470b312b302a tempest-VolumesTestJSON-1641805777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:07:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-8c9f6563-48b0-4723-a9db-470b312b302a tempest-VolumesTestJSON-1641805777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:07:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8c9f6563-48b0-4723-a9db-470b312b302a tempest-VolumesTestJSON-1641805777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:07:49 devstack sudo[92704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:07:49 devstack sudo[92704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:07:50 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8c8ee1db-091b-4f4c-8035-9b66fc44ad02 tempest-VolumesTestJSON-1641805777 None] Acquiring lock "cinder-be270535-acf7-46f4-8920-cfae9ca90a65-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:07:50 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8c8ee1db-091b-4f4c-8035-9b66fc44ad02 tempest-VolumesTestJSON-1641805777 None] Lock "cinder-be270535-acf7-46f4-8920-cfae9ca90a65-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:07:50 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8c8ee1db-091b-4f4c-8035-9b66fc44ad02 tempest-VolumesTestJSON-1641805777 None] Acquiring lock "cinder-quobyte-be270535-acf7-46f4-8920-cfae9ca90a65" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:07:50 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8c8ee1db-091b-4f4c-8035-9b66fc44ad02 tempest-VolumesTestJSON-1641805777 None] Lock "cinder-quobyte-be270535-acf7-46f4-8920-cfae9ca90a65" acquired by "delete_volume" :: waited 0.041s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:07:51 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72e528d-dcba-412b-9c5f-3d2b018e5c01]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:07:51 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8c8ee1db-091b-4f4c-8035-9b66fc44ad02 tempest-VolumesTestJSON-1641805777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-be270535-acf7-46f4-8920-cfae9ca90a65 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:07:51 devstack sudo[92704]: pam_unix(sudo:session): session closed for user root
Jul 03 01:07:51 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8c9f6563-48b0-4723-a9db-470b312b302a tempest-VolumesTestJSON-1641805777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 1.354s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:07:51 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-8c9f6563-48b0-4723-a9db-470b312b302a tempest-VolumesTestJSON-1641805777 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:07:51 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-8c9f6563-48b0-4723-a9db-470b312b302a tempest-VolumesTestJSON-1641805777 None] Deleted volume successfully.
Jul 03 01:07:51 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8c9f6563-48b0-4723-a9db-470b312b302a tempest-VolumesTestJSON-1641805777 None] Lock "cinder-93464ac5-f4cf-402d-ab25-a8d231ccb1b2-delete_volume" released by "delete_volume" :: held 4.368s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:07:51 devstack sudo[92707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-be270535-acf7-46f4-8920-cfae9ca90a65
Jul 03 01:07:51 devstack sudo[92707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:07:52 devstack sudo[92707]: pam_unix(sudo:session): session closed for user root
Jul 03 01:07:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8c8ee1db-091b-4f4c-8035-9b66fc44ad02 tempest-VolumesTestJSON-1641805777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-be270535-acf7-46f4-8920-cfae9ca90a65" returned: 0 in 1.871s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:07:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8c8ee1db-091b-4f4c-8035-9b66fc44ad02 tempest-VolumesTestJSON-1641805777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-be270535-acf7-46f4-8920-cfae9ca90a65 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:07:52 devstack sudo[92713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-be270535-acf7-46f4-8920-cfae9ca90a65
Jul 03 01:07:52 devstack sudo[92713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:07:54 devstack sudo[92713]: pam_unix(sudo:session): session closed for user root
Jul 03 01:07:54 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8c8ee1db-091b-4f4c-8035-9b66fc44ad02 tempest-VolumesTestJSON-1641805777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-be270535-acf7-46f4-8920-cfae9ca90a65" returned: 0 in 1.407s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:07:54 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8c8ee1db-091b-4f4c-8035-9b66fc44ad02 tempest-VolumesTestJSON-1641805777 None] Lock "cinder-quobyte-be270535-acf7-46f4-8920-cfae9ca90a65" released by "delete_volume" :: held 3.388s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:07:54 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-8c8ee1db-091b-4f4c-8035-9b66fc44ad02 tempest-VolumesTestJSON-1641805777 None] Created reservations ['be58d1eb-8744-4df2-9bd5-119923b08d18', '5145b451-da10-46ad-ae57-6c3a5ac5014f', '1d0c6cce-de61-4b2d-b7e8-4dffaaf3d60f', 'd44dd02b-a223-4d01-842a-7e53deb524a9'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:07:54 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-8c8ee1db-091b-4f4c-8035-9b66fc44ad02 tempest-VolumesTestJSON-1641805777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:07:54 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-8c8ee1db-091b-4f4c-8035-9b66fc44ad02 tempest-VolumesTestJSON-1641805777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:07:54 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-8c8ee1db-091b-4f4c-8035-9b66fc44ad02 tempest-VolumesTestJSON-1641805777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:07:54 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-8c8ee1db-091b-4f4c-8035-9b66fc44ad02 tempest-VolumesTestJSON-1641805777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:07:54 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-8c8ee1db-091b-4f4c-8035-9b66fc44ad02 tempest-VolumesTestJSON-1641805777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:07:54 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8c8ee1db-091b-4f4c-8035-9b66fc44ad02 tempest-VolumesTestJSON-1641805777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:07:54 devstack sudo[92718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:07:54 devstack sudo[92718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:07:55 devstack sudo[92718]: pam_unix(sudo:session): session closed for user root
Jul 03 01:07:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8c8ee1db-091b-4f4c-8035-9b66fc44ad02 tempest-VolumesTestJSON-1641805777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 1.085s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:07:55 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-8c8ee1db-091b-4f4c-8035-9b66fc44ad02 tempest-VolumesTestJSON-1641805777 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:07:55 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-8c8ee1db-091b-4f4c-8035-9b66fc44ad02 tempest-VolumesTestJSON-1641805777 None] Deleted volume successfully.
Jul 03 01:07:55 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8c8ee1db-091b-4f4c-8035-9b66fc44ad02 tempest-VolumesTestJSON-1641805777 None] Lock "cinder-be270535-acf7-46f4-8920-cfae9ca90a65-delete_volume" released by "delete_volume" :: held 5.087s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:08:01 devstack cinder-volume[86891]: DEBUG oslo_service.periodic_task [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86891) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 01:08:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:08:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:08:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:08:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:08:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:08:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:08:01 devstack sudo[92748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:08:01 devstack sudo[92748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:08:02 devstack sudo[92748]: pam_unix(sudo:session): session closed for user root
Jul 03 01:08:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.980s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:08:02 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:08:02 devstack cinder-volume[86891]: DEBUG oslo_service.periodic_task [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running periodic task VolumeManager._thread_info {{(pid=86891) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 01:08:02 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] thread count: 8 {{(pid=86891) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 01:08:02 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] thread info: [<_MainThread(MainThread, started 136731296534656)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136731184953280)>, <Thread(Thread-3 (stat_writer), started daemon 136731184058816)>, <Thread(Rabbit-heartbeat, started daemon 136731184846080)>, <Thread(Thread-5 (_runner), started daemon 136731182936576)>, <Thread(Thread-7 (_runner), started daemon 136731182954944)>, <Thread(fd_logger, started daemon 136731181916416)>, <Thread(privsep_reader, started daemon 136731180942208)>] {{(pid=86891) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 01:08:04 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:SELECT=23,cinder:UPDATE=41,cinder:INSERT=8,cinder:DELETE=4 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:08:05 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:SELECT=31,cinder:UPDATE=41,cinder:INSERT=11,cinder:DELETE=3 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:08:06 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-07221cc1-a401-433f-a4c8-b03b4f68667f tempest-BackendsCapabilitiesAdminTestsJSON-1931118849 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.75777053833, 'free_capacity_gb': 1775.75777053833, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86891) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jul 03 01:08:07 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-aa05dfe5-7fee-4240-897b-349bfc6ca636 tempest-BackendsCapabilitiesAdminTestsJSON-1931118849 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.75777053833, 'free_capacity_gb': 1775.75777053833, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86891) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jul 03 01:08:13 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9e7c94e-c746-454d-a15c-65f3659d058d tempest-AttachVolumeNegativeTest-1781307442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:08:13 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b9e7c94e-c746-454d-a15c-65f3659d058d tempest-AttachVolumeNegativeTest-1781307442 None] Flow 'volume_create_manager' (d0a96081-0f1a-4841-88d7-3dfb45f02033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:08:13 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b9e7c94e-c746-454d-a15c-65f3659d058d tempest-AttachVolumeNegativeTest-1781307442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fc48b0a-7775-4f9b-8af0-46010a0aa645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:08:13 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b9e7c94e-c746-454d-a15c-65f3659d058d tempest-AttachVolumeNegativeTest-1781307442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fc48b0a-7775-4f9b-8af0-46010a0aa645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:08:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-835977676',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76978973-d64e-40a3-9168-b3b62ca3031b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3348d2c85ae7402095c009310a1f3caa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:08:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:08:14Z,use_quota=True,user_id='aa6ba53dbdc145fba5e7c650aea77566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:08:13 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b9e7c94e-c746-454d-a15c-65f3659d058d tempest-AttachVolumeNegativeTest-1781307442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1afa9c2-8638-49c6-b288-1754410e0a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:08:13 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b9e7c94e-c746-454d-a15c-65f3659d058d tempest-AttachVolumeNegativeTest-1781307442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1afa9c2-8638-49c6-b288-1754410e0a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:08:13 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b9e7c94e-c746-454d-a15c-65f3659d058d tempest-AttachVolumeNegativeTest-1781307442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d67e7d12-b1d5-454a-ae97-712ef5d9bd97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:08:13 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b9e7c94e-c746-454d-a15c-65f3659d058d tempest-AttachVolumeNegativeTest-1781307442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d67e7d12-b1d5-454a-ae97-712ef5d9bd97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76978973-d64e-40a3-9168-b3b62ca3031b', 'volume_name': 'volume-76978973-d64e-40a3-9168-b3b62ca3031b', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:08:13 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b9e7c94e-c746-454d-a15c-65f3659d058d tempest-AttachVolumeNegativeTest-1781307442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcebb44b-16e9-4699-8c86-8e4b6afef02d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:08:13 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b9e7c94e-c746-454d-a15c-65f3659d058d tempest-AttachVolumeNegativeTest-1781307442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcebb44b-16e9-4699-8c86-8e4b6afef02d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:08:13 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b9e7c94e-c746-454d-a15c-65f3659d058d tempest-AttachVolumeNegativeTest-1781307442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (733de69e-4c45-444c-ac3d-c1dae1110a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:08:13 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-b9e7c94e-c746-454d-a15c-65f3659d058d tempest-AttachVolumeNegativeTest-1781307442 None] Volume 76978973-d64e-40a3-9168-b3b62ca3031b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76978973-d64e-40a3-9168-b3b62ca3031b', 'volume_size': 1}
Jul 03 01:08:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b9e7c94e-c746-454d-a15c-65f3659d058d tempest-AttachVolumeNegativeTest-1781307442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:08:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b9e7c94e-c746-454d-a15c-65f3659d058d tempest-AttachVolumeNegativeTest-1781307442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:08:13 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-b9e7c94e-c746-454d-a15c-65f3659d058d tempest-AttachVolumeNegativeTest-1781307442 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:08:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-835977676',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76978973-d64e-40a3-9168-b3b62ca3031b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3348d2c85ae7402095c009310a1f3caa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:08:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:08:14Z,use_quota=True,user_id='aa6ba53dbdc145fba5e7c650aea77566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:08:13 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-b9e7c94e-c746-454d-a15c-65f3659d058d tempest-AttachVolumeNegativeTest-1781307442 None] Creating volume 76978973-d64e-40a3-9168-b3b62ca3031b {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:08:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b9e7c94e-c746-454d-a15c-65f3659d058d tempest-AttachVolumeNegativeTest-1781307442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:08:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b9e7c94e-c746-454d-a15c-65f3659d058d tempest-AttachVolumeNegativeTest-1781307442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:08:13 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-b9e7c94e-c746-454d-a15c-65f3659d058d tempest-AttachVolumeNegativeTest-1781307442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:08:13 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-b9e7c94e-c746-454d-a15c-65f3659d058d tempest-AttachVolumeNegativeTest-1781307442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:08:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b9e7c94e-c746-454d-a15c-65f3659d058d tempest-AttachVolumeNegativeTest-1781307442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:08:13 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-b9e7c94e-c746-454d-a15c-65f3659d058d tempest-AttachVolumeNegativeTest-1781307442 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:08:13 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-b9e7c94e-c746-454d-a15c-65f3659d058d tempest-AttachVolumeNegativeTest-1781307442 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:08:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b9e7c94e-c746-454d-a15c-65f3659d058d tempest-AttachVolumeNegativeTest-1781307442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-76978973-d64e-40a3-9168-b3b62ca3031b 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:08:13 devstack sudo[92822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-76978973-d64e-40a3-9168-b3b62ca3031b 1073741824
Jul 03 01:08:13 devstack sudo[92822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:08:15 devstack sudo[92822]: pam_unix(sudo:session): session closed for user root
Jul 03 01:08:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b9e7c94e-c746-454d-a15c-65f3659d058d tempest-AttachVolumeNegativeTest-1781307442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-76978973-d64e-40a3-9168-b3b62ca3031b 1073741824" returned: 0 in 1.200s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:08:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b9e7c94e-c746-454d-a15c-65f3659d058d tempest-AttachVolumeNegativeTest-1781307442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-76978973-d64e-40a3-9168-b3b62ca3031b {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:08:15 devstack sudo[92828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-76978973-d64e-40a3-9168-b3b62ca3031b
Jul 03 01:08:15 devstack sudo[92828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:08:15 devstack sudo[92828]: pam_unix(sudo:session): session closed for user root
Jul 03 01:08:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b9e7c94e-c746-454d-a15c-65f3659d058d tempest-AttachVolumeNegativeTest-1781307442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-76978973-d64e-40a3-9168-b3b62ca3031b" returned: 0 in 0.813s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:08:15 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-b9e7c94e-c746-454d-a15c-65f3659d058d tempest-AttachVolumeNegativeTest-1781307442 None] <== create_volume: return (2060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:08:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b9e7c94e-c746-454d-a15c-65f3659d058d tempest-AttachVolumeNegativeTest-1781307442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.063s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:08:15 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b9e7c94e-c746-454d-a15c-65f3659d058d tempest-AttachVolumeNegativeTest-1781307442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (733de69e-4c45-444c-ac3d-c1dae1110a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76978973-d64e-40a3-9168-b3b62ca3031b', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:08:15 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b9e7c94e-c746-454d-a15c-65f3659d058d tempest-AttachVolumeNegativeTest-1781307442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33ee1d81-5490-43e2-953e-3c79ecfe3921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:08:15 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-b9e7c94e-c746-454d-a15c-65f3659d058d tempest-AttachVolumeNegativeTest-1781307442 None] Volume volume-76978973-d64e-40a3-9168-b3b62ca3031b (76978973-d64e-40a3-9168-b3b62ca3031b): created successfully
Jul 03 01:08:15 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b9e7c94e-c746-454d-a15c-65f3659d058d tempest-AttachVolumeNegativeTest-1781307442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33ee1d81-5490-43e2-953e-3c79ecfe3921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:08:15 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b9e7c94e-c746-454d-a15c-65f3659d058d tempest-AttachVolumeNegativeTest-1781307442 None] Flow 'volume_create_manager' (d0a96081-0f1a-4841-88d7-3dfb45f02033) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:08:16 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-b9e7c94e-c746-454d-a15c-65f3659d058d tempest-AttachVolumeNegativeTest-1781307442 None] Created volume successfully.
Jul 03 01:08:19 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-a9326abe-25a4-45ed-8323-213677673733 req-ac8fd587-010f-4014-a013-6a6a850798bb tempest-AttachVolumeNegativeTest-1781307442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:08:19 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-a9326abe-25a4-45ed-8323-213677673733 req-ac8fd587-010f-4014-a013-6a6a850798bb tempest-AttachVolumeNegativeTest-1781307442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:08:19 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d9eb29-0f94-42ce-b070-83c5ec020d55]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:08:19 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-a9326abe-25a4-45ed-8323-213677673733 req-ac8fd587-010f-4014-a013-6a6a850798bb tempest-AttachVolumeNegativeTest-1781307442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-76978973-d64e-40a3-9168-b3b62ca3031b {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:08:20 devstack sudo[92851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-76978973-d64e-40a3-9168-b3b62ca3031b
Jul 03 01:08:20 devstack sudo[92851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:08:21 devstack sudo[92851]: pam_unix(sudo:session): session closed for user root
Jul 03 01:08:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-a9326abe-25a4-45ed-8323-213677673733 req-ac8fd587-010f-4014-a013-6a6a850798bb tempest-AttachVolumeNegativeTest-1781307442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-76978973-d64e-40a3-9168-b3b62ca3031b" returned: 0 in 1.096s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:08:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-a9326abe-25a4-45ed-8323-213677673733 req-ac8fd587-010f-4014-a013-6a6a850798bb tempest-AttachVolumeNegativeTest-1781307442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.125s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:08:21 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [req-a9326abe-25a4-45ed-8323-213677673733 req-ac8fd587-010f-4014-a013-6a6a850798bb tempest-AttachVolumeNegativeTest-1781307442 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3', 'name': 'volume-76978973-d64e-40a3-9168-b3b62ca3031b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e57a23c5-c65e-4be3-986b-b99cafafda01', 'enforce_multipath': True} {{(pid=86891) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 01:08:21 devstack cinder-volume[86891]: INFO cinder.volume.manager [req-a9326abe-25a4-45ed-8323-213677673733 req-ac8fd587-010f-4014-a013-6a6a850798bb tempest-AttachVolumeNegativeTest-1781307442 None] attachment_update completed successfully.
Jul 03 01:08:27 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-e611f1de-3441-479c-9629-c712513d7126 tempest-GroupsV314Test-623800646 None] Group tempest-GroupsV314Test-Group-1489095587: creating
Jul 03 01:08:27 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-e611f1de-3441-479c-9629-c712513d7126 tempest-GroupsV314Test-623800646 None] Group tempest-GroupsV314Test-Group-1489095587: created successfully
Jul 03 01:08:27 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-e611f1de-3441-479c-9629-c712513d7126 tempest-GroupsV314Test-623800646 None] Create group completed successfully.
Jul 03 01:08:29 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-835da2d0-c437-461d-b893-18709307b04b tempest-GroupsV314Test-623800646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:08:29 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-835da2d0-c437-461d-b893-18709307b04b tempest-GroupsV314Test-623800646 None] Flow 'volume_create_manager' (d150fc08-d75a-460e-a616-784e180d11c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:08:29 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-835da2d0-c437-461d-b893-18709307b04b tempest-GroupsV314Test-623800646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c81f716-6767-4c3c-8958-7b6754f72a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:08:29 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-835da2d0-c437-461d-b893-18709307b04b tempest-GroupsV314Test-623800646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c81f716-6767-4c3c-8958-7b6754f72a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:08:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1208992370',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1c7ab2b2-7b54-4935-97d0-3b5effc5ebe8,host='devstack@QuobyteHD#QuobyteHD',id=02f574e0-00ea-4702-8a1f-c71d3a846946,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='423e0df45ad24c5cae27c7756f88322e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:08:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:08:29Z,use_quota=True,user_id='0fd118339a70418e8c99b524d141895b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a2c6350e-f644-44fd-af9a-e44461786d8a),volume_type_id=a2c6350e-f644-44fd-af9a-e44461786d8a)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:08:29 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-835da2d0-c437-461d-b893-18709307b04b tempest-GroupsV314Test-623800646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (041db923-73fc-4d12-bc20-0688484e5c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:08:29 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-835da2d0-c437-461d-b893-18709307b04b tempest-GroupsV314Test-623800646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (041db923-73fc-4d12-bc20-0688484e5c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:08:29 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-835da2d0-c437-461d-b893-18709307b04b tempest-GroupsV314Test-623800646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (869c1a65-a73f-419e-8273-8c24e6777a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:08:29 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-835da2d0-c437-461d-b893-18709307b04b tempest-GroupsV314Test-623800646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (869c1a65-a73f-419e-8273-8c24e6777a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02f574e0-00ea-4702-8a1f-c71d3a846946', 'volume_name': 'volume-02f574e0-00ea-4702-8a1f-c71d3a846946', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:08:29 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-835da2d0-c437-461d-b893-18709307b04b tempest-GroupsV314Test-623800646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4df8f7e3-7867-4071-95f6-fa0969a9de6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:08:29 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-835da2d0-c437-461d-b893-18709307b04b tempest-GroupsV314Test-623800646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4df8f7e3-7867-4071-95f6-fa0969a9de6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:08:29 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-835da2d0-c437-461d-b893-18709307b04b tempest-GroupsV314Test-623800646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eed7720e-d411-4230-8cd4-b44cfbe4e195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:08:29 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-835da2d0-c437-461d-b893-18709307b04b tempest-GroupsV314Test-623800646 None] Volume 02f574e0-00ea-4702-8a1f-c71d3a846946: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02f574e0-00ea-4702-8a1f-c71d3a846946', 'volume_size': 1}
Jul 03 01:08:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-835da2d0-c437-461d-b893-18709307b04b tempest-GroupsV314Test-623800646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:08:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-835da2d0-c437-461d-b893-18709307b04b tempest-GroupsV314Test-623800646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:08:29 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-835da2d0-c437-461d-b893-18709307b04b tempest-GroupsV314Test-623800646 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=1c7ab2b2-7b54-4935-97d0-3b5effc5ebe8,created_at=2026-07-02T23:08:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1208992370',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1c7ab2b2-7b54-4935-97d0-3b5effc5ebe8,host='devstack@QuobyteHD#QuobyteHD',id=02f574e0-00ea-4702-8a1f-c71d3a846946,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='423e0df45ad24c5cae27c7756f88322e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:08:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:08:29Z,use_quota=True,user_id='0fd118339a70418e8c99b524d141895b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a2c6350e-f644-44fd-af9a-e44461786d8a),volume_type_id=a2c6350e-f644-44fd-af9a-e44461786d8a)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:08:29 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-835da2d0-c437-461d-b893-18709307b04b tempest-GroupsV314Test-623800646 None] Creating volume 02f574e0-00ea-4702-8a1f-c71d3a846946 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:08:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-835da2d0-c437-461d-b893-18709307b04b tempest-GroupsV314Test-623800646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:08:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-835da2d0-c437-461d-b893-18709307b04b tempest-GroupsV314Test-623800646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:08:29 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-835da2d0-c437-461d-b893-18709307b04b tempest-GroupsV314Test-623800646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:08:29 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-835da2d0-c437-461d-b893-18709307b04b tempest-GroupsV314Test-623800646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:08:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-835da2d0-c437-461d-b893-18709307b04b tempest-GroupsV314Test-623800646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:08:29 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-835da2d0-c437-461d-b893-18709307b04b tempest-GroupsV314Test-623800646 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:08:29 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-835da2d0-c437-461d-b893-18709307b04b tempest-GroupsV314Test-623800646 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:08:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-835da2d0-c437-461d-b893-18709307b04b tempest-GroupsV314Test-623800646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-02f574e0-00ea-4702-8a1f-c71d3a846946 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:08:29 devstack sudo[93315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-02f574e0-00ea-4702-8a1f-c71d3a846946 1073741824
Jul 03 01:08:29 devstack sudo[93315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:08:30 devstack sudo[93315]: pam_unix(sudo:session): session closed for user root
Jul 03 01:08:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-835da2d0-c437-461d-b893-18709307b04b tempest-GroupsV314Test-623800646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-02f574e0-00ea-4702-8a1f-c71d3a846946 1073741824" returned: 0 in 0.966s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:08:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-835da2d0-c437-461d-b893-18709307b04b tempest-GroupsV314Test-623800646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-02f574e0-00ea-4702-8a1f-c71d3a846946 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:08:30 devstack sudo[93324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-02f574e0-00ea-4702-8a1f-c71d3a846946
Jul 03 01:08:30 devstack sudo[93324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:08:31 devstack sudo[93324]: pam_unix(sudo:session): session closed for user root
Jul 03 01:08:31 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-835da2d0-c437-461d-b893-18709307b04b tempest-GroupsV314Test-623800646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-02f574e0-00ea-4702-8a1f-c71d3a846946" returned: 0 in 0.695s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:08:31 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-835da2d0-c437-461d-b893-18709307b04b tempest-GroupsV314Test-623800646 None] <== create_volume: return (1710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:08:31 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-835da2d0-c437-461d-b893-18709307b04b tempest-GroupsV314Test-623800646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.712s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:08:31 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-835da2d0-c437-461d-b893-18709307b04b tempest-GroupsV314Test-623800646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eed7720e-d411-4230-8cd4-b44cfbe4e195) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02f574e0-00ea-4702-8a1f-c71d3a846946', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:08:31 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-835da2d0-c437-461d-b893-18709307b04b tempest-GroupsV314Test-623800646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (393ee98f-7452-4f7d-bc9d-e9f7b09959de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:08:31 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-835da2d0-c437-461d-b893-18709307b04b tempest-GroupsV314Test-623800646 None] Volume volume-02f574e0-00ea-4702-8a1f-c71d3a846946 (02f574e0-00ea-4702-8a1f-c71d3a846946): created successfully
Jul 03 01:08:31 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-835da2d0-c437-461d-b893-18709307b04b tempest-GroupsV314Test-623800646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (393ee98f-7452-4f7d-bc9d-e9f7b09959de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:08:31 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-835da2d0-c437-461d-b893-18709307b04b tempest-GroupsV314Test-623800646 None] Flow 'volume_create_manager' (d150fc08-d75a-460e-a616-784e180d11c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:08:31 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-835da2d0-c437-461d-b893-18709307b04b tempest-GroupsV314Test-623800646 None] Created volume successfully.
Jul 03 01:08:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-0e006db3-6554-4cbb-acac-439c10685df9 tempest-GroupsV314Test-623800646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:08:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-0e006db3-6554-4cbb-acac-439c10685df9 tempest-GroupsV314Test-623800646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:08:33 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-0e006db3-6554-4cbb-acac-439c10685df9 tempest-GroupsV314Test-623800646 None] Cloning volume 02f574e0-00ea-4702-8a1f-c71d3a846946 to volume 6fd27b46-5492-4092-8651-98546b88ca6e
Jul 03 01:08:33 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-0e006db3-6554-4cbb-acac-439c10685df9 tempest-GroupsV314Test-623800646 None] Creating offline snapshot e3efed8f-56a7-45f4-bcc8-51c45e1b0eec of volume 02f574e0-00ea-4702-8a1f-c71d3a846946 {{(pid=86891) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 01:08:33 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c8bd1c-69a7-4328-b2e9-84e2445f364e]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:08:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0e006db3-6554-4cbb-acac-439c10685df9 tempest-GroupsV314Test-623800646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-02f574e0-00ea-4702-8a1f-c71d3a846946 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:08:33 devstack sudo[93418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-02f574e0-00ea-4702-8a1f-c71d3a846946
Jul 03 01:08:33 devstack sudo[93418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:08:35 devstack sudo[93418]: pam_unix(sudo:session): session closed for user root
Jul 03 01:08:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0e006db3-6554-4cbb-acac-439c10685df9 tempest-GroupsV314Test-623800646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-02f574e0-00ea-4702-8a1f-c71d3a846946" returned: 0 in 1.900s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:08:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0e006db3-6554-4cbb-acac-439c10685df9 tempest-GroupsV314Test-623800646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-02f574e0-00ea-4702-8a1f-c71d3a846946,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-02f574e0-00ea-4702-8a1f-c71d3a846946.e3efed8f-56a7-45f4-bcc8-51c45e1b0eec 1G {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:08:35 devstack sudo[93493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-02f574e0-00ea-4702-8a1f-c71d3a846946,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-02f574e0-00ea-4702-8a1f-c71d3a846946.e3efed8f-56a7-45f4-bcc8-51c45e1b0eec 1G
Jul 03 01:08:35 devstack sudo[93493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:08:37 devstack sudo[93493]: pam_unix(sudo:session): session closed for user root
Jul 03 01:08:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0e006db3-6554-4cbb-acac-439c10685df9 tempest-GroupsV314Test-623800646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-02f574e0-00ea-4702-8a1f-c71d3a846946,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-02f574e0-00ea-4702-8a1f-c71d3a846946.e3efed8f-56a7-45f4-bcc8-51c45e1b0eec 1G" returned: 0 in 2.246s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:08:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0e006db3-6554-4cbb-acac-439c10685df9 tempest-GroupsV314Test-623800646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02f574e0-00ea-4702-8a1f-c71d3a846946 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-02f574e0-00ea-4702-8a1f-c71d3a846946.e3efed8f-56a7-45f4-bcc8-51c45e1b0eec {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:08:37 devstack sudo[93503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02f574e0-00ea-4702-8a1f-c71d3a846946 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-02f574e0-00ea-4702-8a1f-c71d3a846946.e3efed8f-56a7-45f4-bcc8-51c45e1b0eec
Jul 03 01:08:37 devstack sudo[93503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:08:39 devstack sudo[93503]: pam_unix(sudo:session): session closed for user root
Jul 03 01:08:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0e006db3-6554-4cbb-acac-439c10685df9 tempest-GroupsV314Test-623800646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02f574e0-00ea-4702-8a1f-c71d3a846946 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-02f574e0-00ea-4702-8a1f-c71d3a846946.e3efed8f-56a7-45f4-bcc8-51c45e1b0eec" returned: 0 in 2.106s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:08:39 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-0e006db3-6554-4cbb-acac-439c10685df9 tempest-GroupsV314Test-623800646 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-02f574e0-00ea-4702-8a1f-c71d3a846946.e3efed8f-56a7-45f4-bcc8-51c45e1b0eec is being set with open permissions: ugo+rw: NotImplementedError
Jul 03 01:08:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0e006db3-6554-4cbb-acac-439c10685df9 tempest-GroupsV314Test-623800646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-02f574e0-00ea-4702-8a1f-c71d3a846946.e3efed8f-56a7-45f4-bcc8-51c45e1b0eec {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:08:39 devstack sudo[93531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-02f574e0-00ea-4702-8a1f-c71d3a846946.e3efed8f-56a7-45f4-bcc8-51c45e1b0eec
Jul 03 01:08:39 devstack sudo[93531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:08:41 devstack sudo[93531]: pam_unix(sudo:session): session closed for user root
Jul 03 01:08:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0e006db3-6554-4cbb-acac-439c10685df9 tempest-GroupsV314Test-623800646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-02f574e0-00ea-4702-8a1f-c71d3a846946.e3efed8f-56a7-45f4-bcc8-51c45e1b0eec" returned: 0 in 1.497s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:08:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0e006db3-6554-4cbb-acac-439c10685df9 tempest-GroupsV314Test-623800646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-02f574e0-00ea-4702-8a1f-c71d3a846946.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:08:41 devstack sudo[93537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-02f574e0-00ea-4702-8a1f-c71d3a846946.info
Jul 03 01:08:41 devstack sudo[93537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:08:42 devstack sudo[93537]: pam_unix(sudo:session): session closed for user root
Jul 03 01:08:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0e006db3-6554-4cbb-acac-439c10685df9 tempest-GroupsV314Test-623800646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-02f574e0-00ea-4702-8a1f-c71d3a846946.info" returned: 0 in 0.937s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:08:42 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-0e006db3-6554-4cbb-acac-439c10685df9 tempest-GroupsV314Test-623800646 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-02f574e0-00ea-4702-8a1f-c71d3a846946.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 03 01:08:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0e006db3-6554-4cbb-acac-439c10685df9 tempest-GroupsV314Test-623800646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-02f574e0-00ea-4702-8a1f-c71d3a846946.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:08:42 devstack sudo[93564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-02f574e0-00ea-4702-8a1f-c71d3a846946.info
Jul 03 01:08:42 devstack sudo[93564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:08:43 devstack sudo[93564]: pam_unix(sudo:session): session closed for user root
Jul 03 01:08:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0e006db3-6554-4cbb-acac-439c10685df9 tempest-GroupsV314Test-623800646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-02f574e0-00ea-4702-8a1f-c71d3a846946.info" returned: 0 in 1.283s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:08:43 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-0e006db3-6554-4cbb-acac-439c10685df9 tempest-GroupsV314Test-623800646 None] Acquiring lock "cinder-quobyte-6fd27b46-5492-4092-8651-98546b88ca6e" by "_copy_volume_from_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:08:43 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-0e006db3-6554-4cbb-acac-439c10685df9 tempest-GroupsV314Test-623800646 None] Lock "cinder-quobyte-6fd27b46-5492-4092-8651-98546b88ca6e" acquired by "_copy_volume_from_snapshot" :: waited 0.051s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:08:43 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-0e006db3-6554-4cbb-acac-439c10685df9 tempest-GroupsV314Test-623800646 None] snapshot: e3efed8f-56a7-45f4-bcc8-51c45e1b0eec, volume: 6fd27b46-5492-4092-8651-98546b88ca6e,  {{(pid=86891) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 03 01:08:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-0e006db3-6554-4cbb-acac-439c10685df9 tempest-GroupsV314Test-623800646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:08:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-0e006db3-6554-4cbb-acac-439c10685df9 tempest-GroupsV314Test-623800646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:08:43 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-0e006db3-6554-4cbb-acac-439c10685df9 tempest-GroupsV314Test-623800646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:08:43 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-0e006db3-6554-4cbb-acac-439c10685df9 tempest-GroupsV314Test-623800646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:08:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-0e006db3-6554-4cbb-acac-439c10685df9 tempest-GroupsV314Test-623800646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:08:43 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8b50c7-ee6b-474c-91a3-29f9a1c8b306]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:08:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0e006db3-6554-4cbb-acac-439c10685df9 tempest-GroupsV314Test-623800646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-02f574e0-00ea-4702-8a1f-c71d3a846946.e3efed8f-56a7-45f4-bcc8-51c45e1b0eec {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:08:44 devstack sudo[93568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-02f574e0-00ea-4702-8a1f-c71d3a846946.e3efed8f-56a7-45f4-bcc8-51c45e1b0eec
Jul 03 01:08:44 devstack sudo[93568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:08:44 devstack sudo[93568]: pam_unix(sudo:session): session closed for user root
Jul 03 01:08:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0e006db3-6554-4cbb-acac-439c10685df9 tempest-GroupsV314Test-623800646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-02f574e0-00ea-4702-8a1f-c71d3a846946.e3efed8f-56a7-45f4-bcc8-51c45e1b0eec" returned: 0 in 1.063s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:08:44 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-0e006db3-6554-4cbb-acac-439c10685df9 tempest-GroupsV314Test-623800646 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02f574e0-00ea-4702-8a1f-c71d3a846946(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:08:44 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-0e006db3-6554-4cbb-acac-439c10685df9 tempest-GroupsV314Test-623800646 None] will copy from snapshot at /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-02f574e0-00ea-4702-8a1f-c71d3a846946 {{(pid=86891) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 03 01:08:44 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-0e006db3-6554-4cbb-acac-439c10685df9 tempest-GroupsV314Test-623800646 None] Creating direct copy from snapshot {{(pid=86891) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 03 01:08:44 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[1acd253e-9236-4afd-b65a-ad11a48d85bc]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:08:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0e006db3-6554-4cbb-acac-439c10685df9 tempest-GroupsV314Test-623800646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-02f574e0-00ea-4702-8a1f-c71d3a846946 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:08:45 devstack sudo[93577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-02f574e0-00ea-4702-8a1f-c71d3a846946
Jul 03 01:08:45 devstack sudo[93577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:08:45 devstack sudo[93577]: pam_unix(sudo:session): session closed for user root
Jul 03 01:08:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0e006db3-6554-4cbb-acac-439c10685df9 tempest-GroupsV314Test-623800646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-02f574e0-00ea-4702-8a1f-c71d3a846946" returned: 0 in 0.923s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:08:45 devstack cinder-volume[86891]: DEBUG cinder.utils [None req-0e006db3-6554-4cbb-acac-439c10685df9 tempest-GroupsV314Test-623800646 None] Path /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-6fd27b46-5492-4092-8651-98546b88ca6e not found in is_blk_device check {{(pid=86891) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 03 01:08:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0e006db3-6554-4cbb-acac-439c10685df9 tempest-GroupsV314Test-623800646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-02f574e0-00ea-4702-8a1f-c71d3a846946 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-6fd27b46-5492-4092-8651-98546b88ca6e {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:08:45 devstack sudo[93583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-02f574e0-00ea-4702-8a1f-c71d3a846946 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-6fd27b46-5492-4092-8651-98546b88ca6e
Jul 03 01:08:45 devstack sudo[93583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:08:51 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:UPDATE=12,cinder:SELECT=14,cinder:DELETE=1,cinder:INSERT=2 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:08:51 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:SELECT=19,cinder:UPDATE=6,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:08:54 devstack sudo[93583]: pam_unix(sudo:session): session closed for user root
Jul 03 01:08:54 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0e006db3-6554-4cbb-acac-439c10685df9 tempest-GroupsV314Test-623800646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-02f574e0-00ea-4702-8a1f-c71d3a846946 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-6fd27b46-5492-4092-8651-98546b88ca6e" returned: 0 in 8.615s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:08:54 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28c7289-ad4e-447d-b1d9-5b8b14f4dcd9]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:08:54 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0e006db3-6554-4cbb-acac-439c10685df9 tempest-GroupsV314Test-623800646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-02f574e0-00ea-4702-8a1f-c71d3a846946 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:08:54 devstack sudo[93706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-02f574e0-00ea-4702-8a1f-c71d3a846946
Jul 03 01:08:54 devstack sudo[93706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:08:55 devstack sudo[93706]: pam_unix(sudo:session): session closed for user root
Jul 03 01:08:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0e006db3-6554-4cbb-acac-439c10685df9 tempest-GroupsV314Test-623800646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-02f574e0-00ea-4702-8a1f-c71d3a846946" returned: 0 in 1.004s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:08:55 devstack cinder-volume[86891]: DEBUG cinder.image.image_utils [None req-0e006db3-6554-4cbb-acac-439c10685df9 tempest-GroupsV314Test-623800646 None] Image conversion details: src /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-02f574e0-00ea-4702-8a1f-c71d3a846946, size 1024.00 MB, duration 8.62 sec, destination /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-6fd27b46-5492-4092-8651-98546b88ca6e {{(pid=86891) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 03 01:08:55 devstack cinder-volume[86891]: INFO cinder.image.image_utils [None req-0e006db3-6554-4cbb-acac-439c10685df9 tempest-GroupsV314Test-623800646 None] Converted 1024.00 MB image at 118.85 MB/s
Jul 03 01:08:55 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-0e006db3-6554-4cbb-acac-439c10685df9 tempest-GroupsV314Test-623800646 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-6fd27b46-5492-4092-8651-98546b88ca6e is being set with open permissions: ugo+rw: NotImplementedError
Jul 03 01:08:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0e006db3-6554-4cbb-acac-439c10685df9 tempest-GroupsV314Test-623800646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-6fd27b46-5492-4092-8651-98546b88ca6e {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:08:55 devstack sudo[93713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-6fd27b46-5492-4092-8651-98546b88ca6e
Jul 03 01:08:55 devstack sudo[93713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:08:56 devstack sudo[93713]: pam_unix(sudo:session): session closed for user root
Jul 03 01:08:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0e006db3-6554-4cbb-acac-439c10685df9 tempest-GroupsV314Test-623800646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-6fd27b46-5492-4092-8651-98546b88ca6e" returned: 0 in 0.665s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:08:56 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-0e006db3-6554-4cbb-acac-439c10685df9 tempest-GroupsV314Test-623800646 None] Lock "cinder-quobyte-6fd27b46-5492-4092-8651-98546b88ca6e" released by "_copy_volume_from_snapshot" :: held 12.449s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:08:56 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-0e006db3-6554-4cbb-acac-439c10685df9 tempest-GroupsV314Test-623800646 None] Acquiring lock "cinder-quobyte-e3efed8f-56a7-45f4-bcc8-51c45e1b0eec" by "_delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:08:56 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-0e006db3-6554-4cbb-acac-439c10685df9 tempest-GroupsV314Test-623800646 None] Lock "cinder-quobyte-e3efed8f-56a7-45f4-bcc8-51c45e1b0eec" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:08:56 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-0e006db3-6554-4cbb-acac-439c10685df9 tempest-GroupsV314Test-623800646 None] Deleting offline snapshot e3efed8f-56a7-45f4-bcc8-51c45e1b0eec of volume 02f574e0-00ea-4702-8a1f-c71d3a846946 {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 01:08:56 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-0e006db3-6554-4cbb-acac-439c10685df9 tempest-GroupsV314Test-623800646 None] snapshot_file for this snap is: volume-02f574e0-00ea-4702-8a1f-c71d3a846946.e3efed8f-56a7-45f4-bcc8-51c45e1b0eec {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 01:08:56 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[087677af-e60b-4292-8afa-90f693acb422]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:08:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0e006db3-6554-4cbb-acac-439c10685df9 tempest-GroupsV314Test-623800646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-02f574e0-00ea-4702-8a1f-c71d3a846946.e3efed8f-56a7-45f4-bcc8-51c45e1b0eec {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:08:56 devstack sudo[93717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-02f574e0-00ea-4702-8a1f-c71d3a846946.e3efed8f-56a7-45f4-bcc8-51c45e1b0eec
Jul 03 01:08:56 devstack sudo[93717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:08:57 devstack sudo[93717]: pam_unix(sudo:session): session closed for user root
Jul 03 01:08:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0e006db3-6554-4cbb-acac-439c10685df9 tempest-GroupsV314Test-623800646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-02f574e0-00ea-4702-8a1f-c71d3a846946.e3efed8f-56a7-45f4-bcc8-51c45e1b0eec" returned: 0 in 0.982s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:08:57 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-0e006db3-6554-4cbb-acac-439c10685df9 tempest-GroupsV314Test-623800646 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02f574e0-00ea-4702-8a1f-c71d3a846946(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:08:57 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[0156a0de-1f2c-4b02-9f31-9624c4a9eec5]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:08:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0e006db3-6554-4cbb-acac-439c10685df9 tempest-GroupsV314Test-623800646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-02f574e0-00ea-4702-8a1f-c71d3a846946 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:08:57 devstack sudo[93731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-02f574e0-00ea-4702-8a1f-c71d3a846946
Jul 03 01:08:57 devstack sudo[93731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:08:58 devstack sudo[93731]: pam_unix(sudo:session): session closed for user root
Jul 03 01:08:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0e006db3-6554-4cbb-acac-439c10685df9 tempest-GroupsV314Test-623800646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-02f574e0-00ea-4702-8a1f-c71d3a846946" returned: 0 in 0.839s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:08:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0e006db3-6554-4cbb-acac-439c10685df9 tempest-GroupsV314Test-623800646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-02f574e0-00ea-4702-8a1f-c71d3a846946.e3efed8f-56a7-45f4-bcc8-51c45e1b0eec {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:08:58 devstack sudo[93755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-02f574e0-00ea-4702-8a1f-c71d3a846946.e3efed8f-56a7-45f4-bcc8-51c45e1b0eec
Jul 03 01:08:58 devstack sudo[93755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:08:58 devstack sudo[93755]: pam_unix(sudo:session): session closed for user root
Jul 03 01:08:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0e006db3-6554-4cbb-acac-439c10685df9 tempest-GroupsV314Test-623800646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-02f574e0-00ea-4702-8a1f-c71d3a846946.e3efed8f-56a7-45f4-bcc8-51c45e1b0eec" returned: 0 in 0.752s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:08:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0e006db3-6554-4cbb-acac-439c10685df9 tempest-GroupsV314Test-623800646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-02f574e0-00ea-4702-8a1f-c71d3a846946.e3efed8f-56a7-45f4-bcc8-51c45e1b0eec {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:08:58 devstack sudo[93760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-02f574e0-00ea-4702-8a1f-c71d3a846946.e3efed8f-56a7-45f4-bcc8-51c45e1b0eec
Jul 03 01:08:58 devstack sudo[93760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:08:59 devstack sudo[93760]: pam_unix(sudo:session): session closed for user root
Jul 03 01:08:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0e006db3-6554-4cbb-acac-439c10685df9 tempest-GroupsV314Test-623800646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-02f574e0-00ea-4702-8a1f-c71d3a846946.e3efed8f-56a7-45f4-bcc8-51c45e1b0eec" returned: 0 in 0.768s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:08:59 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-0e006db3-6554-4cbb-acac-439c10685df9 tempest-GroupsV314Test-623800646 None] Lock "cinder-quobyte-e3efed8f-56a7-45f4-bcc8-51c45e1b0eec" released by "_delete_snapshot" :: held 3.449s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:08:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-0e006db3-6554-4cbb-acac-439c10685df9 tempest-GroupsV314Test-623800646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 26.205s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:08:59 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-0e006db3-6554-4cbb-acac-439c10685df9 tempest-GroupsV314Test-623800646 None] Create group from source-group-1c7ab2b2-7b54-4935-97d0-3b5effc5ebe8 completed successfully.
Jul 03 01:09:01 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-1a1693e2-f2b2-4d57-8382-6a33532c8c8a tempest-GroupsV314Test-623800646 None] Acquiring lock "cinder-quobyte-6fd27b46-5492-4092-8651-98546b88ca6e" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:09:01 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-1a1693e2-f2b2-4d57-8382-6a33532c8c8a tempest-GroupsV314Test-623800646 None] Lock "cinder-quobyte-6fd27b46-5492-4092-8651-98546b88ca6e" acquired by "delete_volume" :: waited 0.037s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:09:01 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[999523e7-2609-4eac-aa04-1234187840ab]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:09:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1a1693e2-f2b2-4d57-8382-6a33532c8c8a tempest-GroupsV314Test-623800646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-6fd27b46-5492-4092-8651-98546b88ca6e {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:09:01 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-846c1331-b414-43c2-be14-44b7cc533ac3 tempest-AttachVolumeShelveTestJSON-910043292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:09:01 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-846c1331-b414-43c2-be14-44b7cc533ac3 tempest-AttachVolumeShelveTestJSON-910043292 None] Flow 'volume_create_manager' (01918ab1-bd44-4dc0-80d7-0a5f9dac4ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:09:01 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-846c1331-b414-43c2-be14-44b7cc533ac3 tempest-AttachVolumeShelveTestJSON-910043292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3467b40-5b3f-4fd1-9c74-bea397600e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:09:01 devstack sudo[93765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-6fd27b46-5492-4092-8651-98546b88ca6e
Jul 03 01:09:01 devstack sudo[93765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:09:01 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-846c1331-b414-43c2-be14-44b7cc533ac3 tempest-AttachVolumeShelveTestJSON-910043292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3467b40-5b3f-4fd1-9c74-bea397600e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:09:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1588064584',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=181b12e8-2a9e-4505-ac72-e0a314177826,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f7d7c0d6c334bb7a8b7ccff47478787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:09:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:09:02Z,use_quota=True,user_id='e65819e646c04b7e8831ce1efd155075',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:09:01 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-846c1331-b414-43c2-be14-44b7cc533ac3 tempest-AttachVolumeShelveTestJSON-910043292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67cf4e92-d2f8-4d57-93e5-d5cdf6c24413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:09:01 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-846c1331-b414-43c2-be14-44b7cc533ac3 tempest-AttachVolumeShelveTestJSON-910043292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67cf4e92-d2f8-4d57-93e5-d5cdf6c24413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:09:01 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-846c1331-b414-43c2-be14-44b7cc533ac3 tempest-AttachVolumeShelveTestJSON-910043292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9e99ace-ec63-454e-9a25-0fe42e43ea09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:09:01 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-846c1331-b414-43c2-be14-44b7cc533ac3 tempest-AttachVolumeShelveTestJSON-910043292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9e99ace-ec63-454e-9a25-0fe42e43ea09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '181b12e8-2a9e-4505-ac72-e0a314177826', 'volume_name': 'volume-181b12e8-2a9e-4505-ac72-e0a314177826', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:09:01 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-846c1331-b414-43c2-be14-44b7cc533ac3 tempest-AttachVolumeShelveTestJSON-910043292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b57ecf8-250e-4e10-bff9-bd100ad474e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:09:01 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-846c1331-b414-43c2-be14-44b7cc533ac3 tempest-AttachVolumeShelveTestJSON-910043292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b57ecf8-250e-4e10-bff9-bd100ad474e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:09:01 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-846c1331-b414-43c2-be14-44b7cc533ac3 tempest-AttachVolumeShelveTestJSON-910043292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d32dfd7-ffa9-4563-a367-07e83520899e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:09:01 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-846c1331-b414-43c2-be14-44b7cc533ac3 tempest-AttachVolumeShelveTestJSON-910043292 None] Volume 181b12e8-2a9e-4505-ac72-e0a314177826: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-181b12e8-2a9e-4505-ac72-e0a314177826', 'volume_size': 1}
Jul 03 01:09:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-846c1331-b414-43c2-be14-44b7cc533ac3 tempest-AttachVolumeShelveTestJSON-910043292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:09:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-846c1331-b414-43c2-be14-44b7cc533ac3 tempest-AttachVolumeShelveTestJSON-910043292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:09:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-846c1331-b414-43c2-be14-44b7cc533ac3 tempest-AttachVolumeShelveTestJSON-910043292 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:09:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1588064584',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=181b12e8-2a9e-4505-ac72-e0a314177826,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f7d7c0d6c334bb7a8b7ccff47478787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:09:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:09:02Z,use_quota=True,user_id='e65819e646c04b7e8831ce1efd155075',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:09:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-846c1331-b414-43c2-be14-44b7cc533ac3 tempest-AttachVolumeShelveTestJSON-910043292 None] Creating volume 181b12e8-2a9e-4505-ac72-e0a314177826 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:09:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-846c1331-b414-43c2-be14-44b7cc533ac3 tempest-AttachVolumeShelveTestJSON-910043292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:09:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-846c1331-b414-43c2-be14-44b7cc533ac3 tempest-AttachVolumeShelveTestJSON-910043292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:09:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-846c1331-b414-43c2-be14-44b7cc533ac3 tempest-AttachVolumeShelveTestJSON-910043292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:09:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-846c1331-b414-43c2-be14-44b7cc533ac3 tempest-AttachVolumeShelveTestJSON-910043292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:09:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-846c1331-b414-43c2-be14-44b7cc533ac3 tempest-AttachVolumeShelveTestJSON-910043292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:09:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-846c1331-b414-43c2-be14-44b7cc533ac3 tempest-AttachVolumeShelveTestJSON-910043292 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:09:01 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-846c1331-b414-43c2-be14-44b7cc533ac3 tempest-AttachVolumeShelveTestJSON-910043292 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:09:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-846c1331-b414-43c2-be14-44b7cc533ac3 tempest-AttachVolumeShelveTestJSON-910043292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-181b12e8-2a9e-4505-ac72-e0a314177826 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:09:01 devstack sudo[93767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-181b12e8-2a9e-4505-ac72-e0a314177826 1073741824
Jul 03 01:09:01 devstack sudo[93767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:09:01 devstack cinder-volume[86891]: DEBUG oslo_service.periodic_task [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86891) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 01:09:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:09:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:09:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:09:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:09:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:09:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:09:01 devstack sudo[93769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:09:02 devstack sudo[93769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:09:02 devstack sudo[93765]: pam_unix(sudo:session): session closed for user root
Jul 03 01:09:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1a1693e2-f2b2-4d57-8382-6a33532c8c8a tempest-GroupsV314Test-623800646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-6fd27b46-5492-4092-8651-98546b88ca6e" returned: 0 in 1.128s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:09:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1a1693e2-f2b2-4d57-8382-6a33532c8c8a tempest-GroupsV314Test-623800646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-6fd27b46-5492-4092-8651-98546b88ca6e {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:09:02 devstack sudo[93769]: pam_unix(sudo:session): session closed for user root
Jul 03 01:09:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.841s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:09:02 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:09:02 devstack sudo[93779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-6fd27b46-5492-4092-8651-98546b88ca6e
Jul 03 01:09:02 devstack cinder-volume[86891]: DEBUG oslo_service.periodic_task [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running periodic task VolumeManager._thread_info {{(pid=86891) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 01:09:02 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] thread count: 8 {{(pid=86891) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 01:09:02 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] thread info: [<_MainThread(MainThread, started 136731296534656)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136731184953280)>, <Thread(Thread-3 (stat_writer), started daemon 136731184058816)>, <Thread(Rabbit-heartbeat, started daemon 136731184846080)>, <Thread(Thread-5 (_runner), started daemon 136731182936576)>, <Thread(Thread-7 (_runner), started daemon 136731182954944)>, <Thread(fd_logger, started daemon 136731181916416)>, <Thread(privsep_reader, started daemon 136731180942208)>] {{(pid=86891) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 01:09:02 devstack sudo[93779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:09:02 devstack sudo[93767]: pam_unix(sudo:session): session closed for user root
Jul 03 01:09:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-846c1331-b414-43c2-be14-44b7cc533ac3 tempest-AttachVolumeShelveTestJSON-910043292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-181b12e8-2a9e-4505-ac72-e0a314177826 1073741824" returned: 0 in 0.983s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:09:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-846c1331-b414-43c2-be14-44b7cc533ac3 tempest-AttachVolumeShelveTestJSON-910043292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-181b12e8-2a9e-4505-ac72-e0a314177826 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:09:02 devstack sudo[93781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-181b12e8-2a9e-4505-ac72-e0a314177826
Jul 03 01:09:02 devstack sudo[93781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:09:03 devstack sudo[93779]: pam_unix(sudo:session): session closed for user root
Jul 03 01:09:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1a1693e2-f2b2-4d57-8382-6a33532c8c8a tempest-GroupsV314Test-623800646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-6fd27b46-5492-4092-8651-98546b88ca6e" returned: 0 in 0.714s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:09:03 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-1a1693e2-f2b2-4d57-8382-6a33532c8c8a tempest-GroupsV314Test-623800646 None] Lock "cinder-quobyte-6fd27b46-5492-4092-8651-98546b88ca6e" released by "delete_volume" :: held 1.908s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:09:03 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-1a1693e2-f2b2-4d57-8382-6a33532c8c8a tempest-GroupsV314Test-623800646 None] Created reservations ['b5502afe-2246-4c19-a6cd-d773e214a09c'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:09:03 devstack cinder-volume[86891]: WARNING cinder.quota [None req-1a1693e2-f2b2-4d57-8382-6a33532c8c8a tempest-GroupsV314Test-623800646 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-781870188 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-781870188, it is now deprecated. Please use the default quota class for default quota.
Jul 03 01:09:03 devstack cinder-volume[86891]: WARNING cinder.quota [None req-1a1693e2-f2b2-4d57-8382-6a33532c8c8a tempest-GroupsV314Test-623800646 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-781870188 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-781870188, it is now deprecated. Please use the default quota class for default quota.
Jul 03 01:09:03 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-1a1693e2-f2b2-4d57-8382-6a33532c8c8a tempest-GroupsV314Test-623800646 None] Created reservations ['d1420f21-b2b1-4c91-8c98-aac5995eee42', 'bdb85a8a-9b4e-4129-b128-18814faed975', '6bd92f90-5a11-48bb-84c9-dbd3ba51d57c', '1043ec7d-2959-4d5a-b131-96e334d7e548'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:09:03 devstack sudo[93781]: pam_unix(sudo:session): session closed for user root
Jul 03 01:09:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-846c1331-b414-43c2-be14-44b7cc533ac3 tempest-AttachVolumeShelveTestJSON-910043292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-181b12e8-2a9e-4505-ac72-e0a314177826" returned: 0 in 0.740s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:09:03 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-846c1331-b414-43c2-be14-44b7cc533ac3 tempest-AttachVolumeShelveTestJSON-910043292 None] <== create_volume: return (1795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:09:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-846c1331-b414-43c2-be14-44b7cc533ac3 tempest-AttachVolumeShelveTestJSON-910043292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.799s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:09:03 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-846c1331-b414-43c2-be14-44b7cc533ac3 tempest-AttachVolumeShelveTestJSON-910043292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d32dfd7-ffa9-4563-a367-07e83520899e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-181b12e8-2a9e-4505-ac72-e0a314177826', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:09:03 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-846c1331-b414-43c2-be14-44b7cc533ac3 tempest-AttachVolumeShelveTestJSON-910043292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfcdf47d-9d30-48f2-9360-30ecef170be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:09:03 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-846c1331-b414-43c2-be14-44b7cc533ac3 tempest-AttachVolumeShelveTestJSON-910043292 None] Volume volume-181b12e8-2a9e-4505-ac72-e0a314177826 (181b12e8-2a9e-4505-ac72-e0a314177826): created successfully
Jul 03 01:09:03 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-846c1331-b414-43c2-be14-44b7cc533ac3 tempest-AttachVolumeShelveTestJSON-910043292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfcdf47d-9d30-48f2-9360-30ecef170be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:09:03 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-846c1331-b414-43c2-be14-44b7cc533ac3 tempest-AttachVolumeShelveTestJSON-910043292 None] Flow 'volume_create_manager' (01918ab1-bd44-4dc0-80d7-0a5f9dac4ced) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:09:03 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-846c1331-b414-43c2-be14-44b7cc533ac3 tempest-AttachVolumeShelveTestJSON-910043292 None] Created volume successfully.
Jul 03 01:09:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1a1693e2-f2b2-4d57-8382-6a33532c8c8a tempest-GroupsV314Test-623800646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:09:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1a1693e2-f2b2-4d57-8382-6a33532c8c8a tempest-GroupsV314Test-623800646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:09:03 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-1a1693e2-f2b2-4d57-8382-6a33532c8c8a tempest-GroupsV314Test-623800646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:09:03 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-1a1693e2-f2b2-4d57-8382-6a33532c8c8a tempest-GroupsV314Test-623800646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:09:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1a1693e2-f2b2-4d57-8382-6a33532c8c8a tempest-GroupsV314Test-623800646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:09:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1a1693e2-f2b2-4d57-8382-6a33532c8c8a tempest-GroupsV314Test-623800646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:09:03 devstack sudo[93795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:09:03 devstack sudo[93795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:09:04 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-3f34c26a-9e33-4ece-b44d-583e1aef7c73 tempest-GroupsV314Test-623800646 None] Acquiring lock "cinder-quobyte-02f574e0-00ea-4702-8a1f-c71d3a846946" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:09:04 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-3f34c26a-9e33-4ece-b44d-583e1aef7c73 tempest-GroupsV314Test-623800646 None] Lock "cinder-quobyte-02f574e0-00ea-4702-8a1f-c71d3a846946" acquired by "delete_volume" :: waited 0.018s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:09:04 devstack sudo[93795]: pam_unix(sudo:session): session closed for user root
Jul 03 01:09:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1a1693e2-f2b2-4d57-8382-6a33532c8c8a tempest-GroupsV314Test-623800646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.750s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:09:04 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-1a1693e2-f2b2-4d57-8382-6a33532c8c8a tempest-GroupsV314Test-623800646 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:09:04 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-1a1693e2-f2b2-4d57-8382-6a33532c8c8a tempest-GroupsV314Test-623800646 None] Delete group completed successfully.
Jul 03 01:09:04 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[027a481e-5259-4435-9242-3ad14b6461d4]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:09:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-3f34c26a-9e33-4ece-b44d-583e1aef7c73 tempest-GroupsV314Test-623800646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-02f574e0-00ea-4702-8a1f-c71d3a846946 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:09:04 devstack sudo[93810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-02f574e0-00ea-4702-8a1f-c71d3a846946
Jul 03 01:09:04 devstack sudo[93810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:09:04 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b4483be-a664-49e6-b012-b6693632a6ed tempest-AttachVolumeTestJSON-670724779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:09:04 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1b4483be-a664-49e6-b012-b6693632a6ed tempest-AttachVolumeTestJSON-670724779 None] Flow 'volume_create_manager' (2d0d5051-e4e6-4f54-a2b4-8656053bf1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:09:04 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1b4483be-a664-49e6-b012-b6693632a6ed tempest-AttachVolumeTestJSON-670724779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3de1ec7-d099-4430-b5e5-2ba11e7dd4b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:09:04 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1b4483be-a664-49e6-b012-b6693632a6ed tempest-AttachVolumeTestJSON-670724779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3de1ec7-d099-4430-b5e5-2ba11e7dd4b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:09:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1603595680',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=554e3870-616e-40ba-8df9-2d7a9c232add,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61b4846e43014cf4a821bb29f9c5a6f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:09:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:09:05Z,use_quota=True,user_id='7509a11726914eeab94b9bb92af3be37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:09:04 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1b4483be-a664-49e6-b012-b6693632a6ed tempest-AttachVolumeTestJSON-670724779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1904b21c-3c68-4333-be67-b97dd9f3c174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:09:04 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1b4483be-a664-49e6-b012-b6693632a6ed tempest-AttachVolumeTestJSON-670724779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1904b21c-3c68-4333-be67-b97dd9f3c174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:09:04 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1b4483be-a664-49e6-b012-b6693632a6ed tempest-AttachVolumeTestJSON-670724779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48f238bf-5d66-4682-b33b-6b09f5943c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:09:04 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1b4483be-a664-49e6-b012-b6693632a6ed tempest-AttachVolumeTestJSON-670724779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48f238bf-5d66-4682-b33b-6b09f5943c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '554e3870-616e-40ba-8df9-2d7a9c232add', 'volume_name': 'volume-554e3870-616e-40ba-8df9-2d7a9c232add', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:09:04 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1b4483be-a664-49e6-b012-b6693632a6ed tempest-AttachVolumeTestJSON-670724779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (550c60c2-b25d-464e-a29a-09921425bb7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:09:04 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1b4483be-a664-49e6-b012-b6693632a6ed tempest-AttachVolumeTestJSON-670724779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (550c60c2-b25d-464e-a29a-09921425bb7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:09:04 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1b4483be-a664-49e6-b012-b6693632a6ed tempest-AttachVolumeTestJSON-670724779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7773d6e5-82b3-4f71-bb02-e4f076eb65e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:09:04 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-1b4483be-a664-49e6-b012-b6693632a6ed tempest-AttachVolumeTestJSON-670724779 None] Volume 554e3870-616e-40ba-8df9-2d7a9c232add: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-554e3870-616e-40ba-8df9-2d7a9c232add', 'volume_size': 1}
Jul 03 01:09:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1b4483be-a664-49e6-b012-b6693632a6ed tempest-AttachVolumeTestJSON-670724779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:09:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1b4483be-a664-49e6-b012-b6693632a6ed tempest-AttachVolumeTestJSON-670724779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:09:04 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-1b4483be-a664-49e6-b012-b6693632a6ed tempest-AttachVolumeTestJSON-670724779 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:09:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1603595680',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=554e3870-616e-40ba-8df9-2d7a9c232add,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61b4846e43014cf4a821bb29f9c5a6f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:09:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:09:05Z,use_quota=True,user_id='7509a11726914eeab94b9bb92af3be37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:09:04 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-1b4483be-a664-49e6-b012-b6693632a6ed tempest-AttachVolumeTestJSON-670724779 None] Creating volume 554e3870-616e-40ba-8df9-2d7a9c232add {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:09:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1b4483be-a664-49e6-b012-b6693632a6ed tempest-AttachVolumeTestJSON-670724779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:09:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1b4483be-a664-49e6-b012-b6693632a6ed tempest-AttachVolumeTestJSON-670724779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:09:04 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-1b4483be-a664-49e6-b012-b6693632a6ed tempest-AttachVolumeTestJSON-670724779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:09:04 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-1b4483be-a664-49e6-b012-b6693632a6ed tempest-AttachVolumeTestJSON-670724779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:09:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1b4483be-a664-49e6-b012-b6693632a6ed tempest-AttachVolumeTestJSON-670724779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:09:04 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-1b4483be-a664-49e6-b012-b6693632a6ed tempest-AttachVolumeTestJSON-670724779 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:09:04 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-1b4483be-a664-49e6-b012-b6693632a6ed tempest-AttachVolumeTestJSON-670724779 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:09:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1b4483be-a664-49e6-b012-b6693632a6ed tempest-AttachVolumeTestJSON-670724779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-554e3870-616e-40ba-8df9-2d7a9c232add 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:09:04 devstack sudo[93816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-554e3870-616e-40ba-8df9-2d7a9c232add 1073741824
Jul 03 01:09:04 devstack sudo[93816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:09:05 devstack sudo[93810]: pam_unix(sudo:session): session closed for user root
Jul 03 01:09:05 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-3f34c26a-9e33-4ece-b44d-583e1aef7c73 tempest-GroupsV314Test-623800646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-02f574e0-00ea-4702-8a1f-c71d3a846946" returned: 0 in 0.817s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:09:05 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-3f34c26a-9e33-4ece-b44d-583e1aef7c73 tempest-GroupsV314Test-623800646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-02f574e0-00ea-4702-8a1f-c71d3a846946 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:09:05 devstack sudo[93822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-02f574e0-00ea-4702-8a1f-c71d3a846946
Jul 03 01:09:05 devstack sudo[93822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:09:05 devstack sudo[93816]: pam_unix(sudo:session): session closed for user root
Jul 03 01:09:05 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1b4483be-a664-49e6-b012-b6693632a6ed tempest-AttachVolumeTestJSON-670724779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-554e3870-616e-40ba-8df9-2d7a9c232add 1073741824" returned: 0 in 0.938s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:09:05 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1b4483be-a664-49e6-b012-b6693632a6ed tempest-AttachVolumeTestJSON-670724779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-554e3870-616e-40ba-8df9-2d7a9c232add {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:09:05 devstack sudo[93827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-554e3870-616e-40ba-8df9-2d7a9c232add
Jul 03 01:09:05 devstack sudo[93827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:09:06 devstack sudo[93822]: pam_unix(sudo:session): session closed for user root
Jul 03 01:09:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-3f34c26a-9e33-4ece-b44d-583e1aef7c73 tempest-GroupsV314Test-623800646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-02f574e0-00ea-4702-8a1f-c71d3a846946" returned: 0 in 0.784s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:09:06 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-3f34c26a-9e33-4ece-b44d-583e1aef7c73 tempest-GroupsV314Test-623800646 None] Lock "cinder-quobyte-02f574e0-00ea-4702-8a1f-c71d3a846946" released by "delete_volume" :: held 1.703s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:09:06 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-3f34c26a-9e33-4ece-b44d-583e1aef7c73 tempest-GroupsV314Test-623800646 None] Created reservations ['d26aa3af-d83b-48d9-9f7a-a4869190f370'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:09:06 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-3f34c26a-9e33-4ece-b44d-583e1aef7c73 tempest-GroupsV314Test-623800646 None] Created reservations ['bd8fb55b-29d4-4aa5-bd8f-5c50d24f4a51', '1e19460b-ec11-4a12-a446-bee1391a1eef', 'ca672be0-e2ff-44d9-aaf5-51a84d1f0b2b', '06da6e32-5bc9-4457-b603-7baddfc5ae3b'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:09:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-3f34c26a-9e33-4ece-b44d-583e1aef7c73 tempest-GroupsV314Test-623800646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:09:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-3f34c26a-9e33-4ece-b44d-583e1aef7c73 tempest-GroupsV314Test-623800646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:09:06 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-3f34c26a-9e33-4ece-b44d-583e1aef7c73 tempest-GroupsV314Test-623800646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:09:06 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-3f34c26a-9e33-4ece-b44d-583e1aef7c73 tempest-GroupsV314Test-623800646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:09:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-3f34c26a-9e33-4ece-b44d-583e1aef7c73 tempest-GroupsV314Test-623800646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:09:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-3f34c26a-9e33-4ece-b44d-583e1aef7c73 tempest-GroupsV314Test-623800646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:09:06 devstack sudo[93833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:09:06 devstack sudo[93833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:09:06 devstack sudo[93827]: pam_unix(sudo:session): session closed for user root
Jul 03 01:09:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1b4483be-a664-49e6-b012-b6693632a6ed tempest-AttachVolumeTestJSON-670724779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-554e3870-616e-40ba-8df9-2d7a9c232add" returned: 0 in 0.694s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:09:06 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-1b4483be-a664-49e6-b012-b6693632a6ed tempest-AttachVolumeTestJSON-670724779 None] <== create_volume: return (1700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:09:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1b4483be-a664-49e6-b012-b6693632a6ed tempest-AttachVolumeTestJSON-670724779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.703s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:09:06 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1b4483be-a664-49e6-b012-b6693632a6ed tempest-AttachVolumeTestJSON-670724779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7773d6e5-82b3-4f71-bb02-e4f076eb65e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-554e3870-616e-40ba-8df9-2d7a9c232add', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:09:06 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1b4483be-a664-49e6-b012-b6693632a6ed tempest-AttachVolumeTestJSON-670724779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (880cfbd9-14e2-4a18-92f2-e063f1d00080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:09:06 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-1b4483be-a664-49e6-b012-b6693632a6ed tempest-AttachVolumeTestJSON-670724779 None] Volume volume-554e3870-616e-40ba-8df9-2d7a9c232add (554e3870-616e-40ba-8df9-2d7a9c232add): created successfully
Jul 03 01:09:06 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1b4483be-a664-49e6-b012-b6693632a6ed tempest-AttachVolumeTestJSON-670724779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (880cfbd9-14e2-4a18-92f2-e063f1d00080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:09:06 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1b4483be-a664-49e6-b012-b6693632a6ed tempest-AttachVolumeTestJSON-670724779 None] Flow 'volume_create_manager' (2d0d5051-e4e6-4f54-a2b4-8656053bf1c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:09:06 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-1b4483be-a664-49e6-b012-b6693632a6ed tempest-AttachVolumeTestJSON-670724779 None] Created volume successfully.
Jul 03 01:09:07 devstack sudo[93833]: pam_unix(sudo:session): session closed for user root
Jul 03 01:09:07 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-3f34c26a-9e33-4ece-b44d-583e1aef7c73 tempest-GroupsV314Test-623800646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.633s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:09:07 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-3f34c26a-9e33-4ece-b44d-583e1aef7c73 tempest-GroupsV314Test-623800646 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:09:07 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-3f34c26a-9e33-4ece-b44d-583e1aef7c73 tempest-GroupsV314Test-623800646 None] Delete group completed successfully.
Jul 03 01:09:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-bb88566a-dac6-4a03-872c-086a24b820b8 req-869ec91b-c3b3-45f1-a7df-43cb99f1ceac tempest-AttachVolumeTestJSON-670724779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:09:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-bb88566a-dac6-4a03-872c-086a24b820b8 req-869ec91b-c3b3-45f1-a7df-43cb99f1ceac tempest-AttachVolumeTestJSON-670724779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:09:09 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9777ce-e33b-41ca-9fcc-56aaa691bdd9]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:09:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-bb88566a-dac6-4a03-872c-086a24b820b8 req-869ec91b-c3b3-45f1-a7df-43cb99f1ceac tempest-AttachVolumeTestJSON-670724779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-554e3870-616e-40ba-8df9-2d7a9c232add {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:09:10 devstack sudo[93956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-554e3870-616e-40ba-8df9-2d7a9c232add
Jul 03 01:09:10 devstack sudo[93956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:09:10 devstack sudo[93956]: pam_unix(sudo:session): session closed for user root
Jul 03 01:09:10 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-bb88566a-dac6-4a03-872c-086a24b820b8 req-869ec91b-c3b3-45f1-a7df-43cb99f1ceac tempest-AttachVolumeTestJSON-670724779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-554e3870-616e-40ba-8df9-2d7a9c232add" returned: 0 in 0.980s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:09:10 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-bb88566a-dac6-4a03-872c-086a24b820b8 req-869ec91b-c3b3-45f1-a7df-43cb99f1ceac tempest-AttachVolumeTestJSON-670724779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:09:11 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [req-bb88566a-dac6-4a03-872c-086a24b820b8 req-869ec91b-c3b3-45f1-a7df-43cb99f1ceac tempest-AttachVolumeTestJSON-670724779 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3', 'name': 'volume-554e3870-616e-40ba-8df9-2d7a9c232add', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8f41d382-a79d-4789-bdec-c86c0ac01935', 'enforce_multipath': True} {{(pid=86891) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 01:09:11 devstack cinder-volume[86891]: INFO cinder.volume.manager [req-bb88566a-dac6-4a03-872c-086a24b820b8 req-869ec91b-c3b3-45f1-a7df-43cb99f1ceac tempest-AttachVolumeTestJSON-670724779 None] attachment_update completed successfully.
Jul 03 01:09:14 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-f391dce6-0ed2-4fa9-84fb-dc9853c201ee tempest-VolumesServicesTestJSON-1877073383 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:09:14 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f391dce6-0ed2-4fa9-84fb-dc9853c201ee tempest-VolumesServicesTestJSON-1877073383 None] Flow 'volume_create_manager' (7e31d9f2-88f7-45e6-a9a9-d8dfa42a6ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:09:14 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f391dce6-0ed2-4fa9-84fb-dc9853c201ee tempest-VolumesServicesTestJSON-1877073383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52a4eb46-655a-4c44-aaeb-e104bfacebe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:09:14 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f391dce6-0ed2-4fa9-84fb-dc9853c201ee tempest-VolumesServicesTestJSON-1877073383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52a4eb46-655a-4c44-aaeb-e104bfacebe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:09:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-390867421',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=309cddbd-687a-4799-991c-d93bdca209cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='893aa4e317914f8aa307bab8c2df30cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:09:14Z,use_quota=True,user_id='583d291add424cd1a418653adf4cc18f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:09:14 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f391dce6-0ed2-4fa9-84fb-dc9853c201ee tempest-VolumesServicesTestJSON-1877073383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fb86f7c-e436-4a01-b013-a984720c4379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:09:14 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f391dce6-0ed2-4fa9-84fb-dc9853c201ee tempest-VolumesServicesTestJSON-1877073383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fb86f7c-e436-4a01-b013-a984720c4379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:09:14 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f391dce6-0ed2-4fa9-84fb-dc9853c201ee tempest-VolumesServicesTestJSON-1877073383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (013ea660-6c2c-4cff-b7bc-b45de2429562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:09:14 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f391dce6-0ed2-4fa9-84fb-dc9853c201ee tempest-VolumesServicesTestJSON-1877073383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (013ea660-6c2c-4cff-b7bc-b45de2429562) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '309cddbd-687a-4799-991c-d93bdca209cc', 'volume_name': 'volume-309cddbd-687a-4799-991c-d93bdca209cc', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:09:14 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f391dce6-0ed2-4fa9-84fb-dc9853c201ee tempest-VolumesServicesTestJSON-1877073383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fb2206e-3d8d-4607-8f80-7ca24fa9aa6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:09:14 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f391dce6-0ed2-4fa9-84fb-dc9853c201ee tempest-VolumesServicesTestJSON-1877073383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fb2206e-3d8d-4607-8f80-7ca24fa9aa6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:09:14 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f391dce6-0ed2-4fa9-84fb-dc9853c201ee tempest-VolumesServicesTestJSON-1877073383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c66d0f6b-b462-4d87-b186-96f64d3befdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:09:14 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-f391dce6-0ed2-4fa9-84fb-dc9853c201ee tempest-VolumesServicesTestJSON-1877073383 None] Volume 309cddbd-687a-4799-991c-d93bdca209cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-309cddbd-687a-4799-991c-d93bdca209cc', 'volume_size': 1}
Jul 03 01:09:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f391dce6-0ed2-4fa9-84fb-dc9853c201ee tempest-VolumesServicesTestJSON-1877073383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:09:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f391dce6-0ed2-4fa9-84fb-dc9853c201ee tempest-VolumesServicesTestJSON-1877073383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:09:14 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-f391dce6-0ed2-4fa9-84fb-dc9853c201ee tempest-VolumesServicesTestJSON-1877073383 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:09:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-390867421',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=309cddbd-687a-4799-991c-d93bdca209cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='893aa4e317914f8aa307bab8c2df30cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:09:14Z,use_quota=True,user_id='583d291add424cd1a418653adf4cc18f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:09:14 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-f391dce6-0ed2-4fa9-84fb-dc9853c201ee tempest-VolumesServicesTestJSON-1877073383 None] Creating volume 309cddbd-687a-4799-991c-d93bdca209cc {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:09:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f391dce6-0ed2-4fa9-84fb-dc9853c201ee tempest-VolumesServicesTestJSON-1877073383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:09:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f391dce6-0ed2-4fa9-84fb-dc9853c201ee tempest-VolumesServicesTestJSON-1877073383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:09:14 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-f391dce6-0ed2-4fa9-84fb-dc9853c201ee tempest-VolumesServicesTestJSON-1877073383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:09:14 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-f391dce6-0ed2-4fa9-84fb-dc9853c201ee tempest-VolumesServicesTestJSON-1877073383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:09:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f391dce6-0ed2-4fa9-84fb-dc9853c201ee tempest-VolumesServicesTestJSON-1877073383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:09:14 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-f391dce6-0ed2-4fa9-84fb-dc9853c201ee tempest-VolumesServicesTestJSON-1877073383 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:09:14 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-f391dce6-0ed2-4fa9-84fb-dc9853c201ee tempest-VolumesServicesTestJSON-1877073383 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:09:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f391dce6-0ed2-4fa9-84fb-dc9853c201ee tempest-VolumesServicesTestJSON-1877073383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-309cddbd-687a-4799-991c-d93bdca209cc 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:09:14 devstack sudo[93973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-309cddbd-687a-4799-991c-d93bdca209cc 1073741824
Jul 03 01:09:14 devstack sudo[93973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:09:15 devstack sudo[93973]: pam_unix(sudo:session): session closed for user root
Jul 03 01:09:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f391dce6-0ed2-4fa9-84fb-dc9853c201ee tempest-VolumesServicesTestJSON-1877073383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-309cddbd-687a-4799-991c-d93bdca209cc 1073741824" returned: 0 in 0.993s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:09:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f391dce6-0ed2-4fa9-84fb-dc9853c201ee tempest-VolumesServicesTestJSON-1877073383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-309cddbd-687a-4799-991c-d93bdca209cc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:09:15 devstack sudo[93983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-309cddbd-687a-4799-991c-d93bdca209cc
Jul 03 01:09:15 devstack sudo[93983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:09:15 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca3fc95d-0655-489c-94ba-6a8f938302a9 tempest-AttachVolumeTestJSON-670724779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:09:15 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ca3fc95d-0655-489c-94ba-6a8f938302a9 tempest-AttachVolumeTestJSON-670724779 None] Flow 'volume_create_manager' (90e02516-70bb-440b-b841-319889663c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:09:15 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ca3fc95d-0655-489c-94ba-6a8f938302a9 tempest-AttachVolumeTestJSON-670724779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18ec8ea1-904b-44ab-a0d6-f0aaf5bc6787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:09:15 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ca3fc95d-0655-489c-94ba-6a8f938302a9 tempest-AttachVolumeTestJSON-670724779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18ec8ea1-904b-44ab-a0d6-f0aaf5bc6787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:09:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2096295266',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33ccf2e8-97bf-4919-b142-2d73710113ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61b4846e43014cf4a821bb29f9c5a6f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:09:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:09:16Z,use_quota=True,user_id='7509a11726914eeab94b9bb92af3be37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:09:15 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ca3fc95d-0655-489c-94ba-6a8f938302a9 tempest-AttachVolumeTestJSON-670724779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ccd67f4-3ad2-4835-b54f-c8dba2071591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:09:15 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ca3fc95d-0655-489c-94ba-6a8f938302a9 tempest-AttachVolumeTestJSON-670724779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ccd67f4-3ad2-4835-b54f-c8dba2071591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:09:15 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ca3fc95d-0655-489c-94ba-6a8f938302a9 tempest-AttachVolumeTestJSON-670724779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff7b3db3-d3a3-46de-8449-a4c0d298453f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:09:15 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ca3fc95d-0655-489c-94ba-6a8f938302a9 tempest-AttachVolumeTestJSON-670724779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff7b3db3-d3a3-46de-8449-a4c0d298453f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33ccf2e8-97bf-4919-b142-2d73710113ed', 'volume_name': 'volume-33ccf2e8-97bf-4919-b142-2d73710113ed', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:09:15 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ca3fc95d-0655-489c-94ba-6a8f938302a9 tempest-AttachVolumeTestJSON-670724779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8e6e39f-9c29-4125-8915-a1b0dbbf2165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:09:15 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ca3fc95d-0655-489c-94ba-6a8f938302a9 tempest-AttachVolumeTestJSON-670724779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8e6e39f-9c29-4125-8915-a1b0dbbf2165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:09:15 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ca3fc95d-0655-489c-94ba-6a8f938302a9 tempest-AttachVolumeTestJSON-670724779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a412494-084a-42f1-b1f2-14fc11ca9e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:09:15 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-ca3fc95d-0655-489c-94ba-6a8f938302a9 tempest-AttachVolumeTestJSON-670724779 None] Volume 33ccf2e8-97bf-4919-b142-2d73710113ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33ccf2e8-97bf-4919-b142-2d73710113ed', 'volume_size': 1}
Jul 03 01:09:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-ca3fc95d-0655-489c-94ba-6a8f938302a9 tempest-AttachVolumeTestJSON-670724779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:09:16 devstack sudo[93983]: pam_unix(sudo:session): session closed for user root
Jul 03 01:09:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f391dce6-0ed2-4fa9-84fb-dc9853c201ee tempest-VolumesServicesTestJSON-1877073383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-309cddbd-687a-4799-991c-d93bdca209cc" returned: 0 in 0.682s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:09:16 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-f391dce6-0ed2-4fa9-84fb-dc9853c201ee tempest-VolumesServicesTestJSON-1877073383 None] <== create_volume: return (1729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:09:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f391dce6-0ed2-4fa9-84fb-dc9853c201ee tempest-VolumesServicesTestJSON-1877073383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.732s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:09:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-ca3fc95d-0655-489c-94ba-6a8f938302a9 tempest-AttachVolumeTestJSON-670724779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.135s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:09:16 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-ca3fc95d-0655-489c-94ba-6a8f938302a9 tempest-AttachVolumeTestJSON-670724779 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:09:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2096295266',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33ccf2e8-97bf-4919-b142-2d73710113ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61b4846e43014cf4a821bb29f9c5a6f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:09:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:09:16Z,use_quota=True,user_id='7509a11726914eeab94b9bb92af3be37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:09:16 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-ca3fc95d-0655-489c-94ba-6a8f938302a9 tempest-AttachVolumeTestJSON-670724779 None] Creating volume 33ccf2e8-97bf-4919-b142-2d73710113ed {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:09:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-ca3fc95d-0655-489c-94ba-6a8f938302a9 tempest-AttachVolumeTestJSON-670724779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:09:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-ca3fc95d-0655-489c-94ba-6a8f938302a9 tempest-AttachVolumeTestJSON-670724779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:09:16 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-ca3fc95d-0655-489c-94ba-6a8f938302a9 tempest-AttachVolumeTestJSON-670724779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:09:16 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-ca3fc95d-0655-489c-94ba-6a8f938302a9 tempest-AttachVolumeTestJSON-670724779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:09:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-ca3fc95d-0655-489c-94ba-6a8f938302a9 tempest-AttachVolumeTestJSON-670724779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:09:16 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-ca3fc95d-0655-489c-94ba-6a8f938302a9 tempest-AttachVolumeTestJSON-670724779 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:09:16 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-ca3fc95d-0655-489c-94ba-6a8f938302a9 tempest-AttachVolumeTestJSON-670724779 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:09:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-ca3fc95d-0655-489c-94ba-6a8f938302a9 tempest-AttachVolumeTestJSON-670724779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-33ccf2e8-97bf-4919-b142-2d73710113ed 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:09:16 devstack sudo[93986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-33ccf2e8-97bf-4919-b142-2d73710113ed 1073741824
Jul 03 01:09:16 devstack sudo[93986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:09:16 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f391dce6-0ed2-4fa9-84fb-dc9853c201ee tempest-VolumesServicesTestJSON-1877073383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c66d0f6b-b462-4d87-b186-96f64d3befdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-309cddbd-687a-4799-991c-d93bdca209cc', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:09:16 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f391dce6-0ed2-4fa9-84fb-dc9853c201ee tempest-VolumesServicesTestJSON-1877073383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2c25504-045d-4f52-ae00-6b1f11bd8344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:09:16 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-f391dce6-0ed2-4fa9-84fb-dc9853c201ee tempest-VolumesServicesTestJSON-1877073383 None] Volume volume-309cddbd-687a-4799-991c-d93bdca209cc (309cddbd-687a-4799-991c-d93bdca209cc): created successfully
Jul 03 01:09:16 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f391dce6-0ed2-4fa9-84fb-dc9853c201ee tempest-VolumesServicesTestJSON-1877073383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2c25504-045d-4f52-ae00-6b1f11bd8344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:09:16 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f391dce6-0ed2-4fa9-84fb-dc9853c201ee tempest-VolumesServicesTestJSON-1877073383 None] Flow 'volume_create_manager' (7e31d9f2-88f7-45e6-a9a9-d8dfa42a6ac3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:09:16 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-f391dce6-0ed2-4fa9-84fb-dc9853c201ee tempest-VolumesServicesTestJSON-1877073383 None] Created volume successfully.
Jul 03 01:09:16 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-7ce2a3d3-ab7a-4c7d-9713-5f704fcf4830 tempest-VolumesServicesTestJSON-1877073383 None] Acquiring lock "cinder-309cddbd-687a-4799-991c-d93bdca209cc-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:09:16 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-7ce2a3d3-ab7a-4c7d-9713-5f704fcf4830 tempest-VolumesServicesTestJSON-1877073383 None] Lock "cinder-309cddbd-687a-4799-991c-d93bdca209cc-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:09:16 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-7ce2a3d3-ab7a-4c7d-9713-5f704fcf4830 tempest-VolumesServicesTestJSON-1877073383 None] Acquiring lock "cinder-quobyte-309cddbd-687a-4799-991c-d93bdca209cc" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:09:16 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-7ce2a3d3-ab7a-4c7d-9713-5f704fcf4830 tempest-VolumesServicesTestJSON-1877073383 None] Lock "cinder-quobyte-309cddbd-687a-4799-991c-d93bdca209cc" acquired by "delete_volume" :: waited 0.021s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:09:16 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[b852ec0e-2a05-49f8-91fb-601054901418]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:09:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-7ce2a3d3-ab7a-4c7d-9713-5f704fcf4830 tempest-VolumesServicesTestJSON-1877073383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-309cddbd-687a-4799-991c-d93bdca209cc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:09:17 devstack sudo[94035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-309cddbd-687a-4799-991c-d93bdca209cc
Jul 03 01:09:17 devstack sudo[94035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:09:17 devstack sudo[93986]: pam_unix(sudo:session): session closed for user root
Jul 03 01:09:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-ca3fc95d-0655-489c-94ba-6a8f938302a9 tempest-AttachVolumeTestJSON-670724779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-33ccf2e8-97bf-4919-b142-2d73710113ed 1073741824" returned: 0 in 1.337s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:09:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-ca3fc95d-0655-489c-94ba-6a8f938302a9 tempest-AttachVolumeTestJSON-670724779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-33ccf2e8-97bf-4919-b142-2d73710113ed {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:09:17 devstack sudo[94045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-33ccf2e8-97bf-4919-b142-2d73710113ed
Jul 03 01:09:17 devstack sudo[94045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:09:17 devstack sudo[94035]: pam_unix(sudo:session): session closed for user root
Jul 03 01:09:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-7ce2a3d3-ab7a-4c7d-9713-5f704fcf4830 tempest-VolumesServicesTestJSON-1877073383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-309cddbd-687a-4799-991c-d93bdca209cc" returned: 0 in 0.958s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:09:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-7ce2a3d3-ab7a-4c7d-9713-5f704fcf4830 tempest-VolumesServicesTestJSON-1877073383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-309cddbd-687a-4799-991c-d93bdca209cc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:09:17 devstack sudo[94052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-309cddbd-687a-4799-991c-d93bdca209cc
Jul 03 01:09:17 devstack sudo[94052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:09:18 devstack sudo[94045]: pam_unix(sudo:session): session closed for user root
Jul 03 01:09:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-ca3fc95d-0655-489c-94ba-6a8f938302a9 tempest-AttachVolumeTestJSON-670724779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-33ccf2e8-97bf-4919-b142-2d73710113ed" returned: 0 in 0.888s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:09:18 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-ca3fc95d-0655-489c-94ba-6a8f938302a9 tempest-AttachVolumeTestJSON-670724779 None] <== create_volume: return (2266ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:09:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-ca3fc95d-0655-489c-94ba-6a8f938302a9 tempest-AttachVolumeTestJSON-670724779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.268s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:09:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ca3fc95d-0655-489c-94ba-6a8f938302a9 tempest-AttachVolumeTestJSON-670724779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a412494-084a-42f1-b1f2-14fc11ca9e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33ccf2e8-97bf-4919-b142-2d73710113ed', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:09:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ca3fc95d-0655-489c-94ba-6a8f938302a9 tempest-AttachVolumeTestJSON-670724779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ab77130-74ea-477a-a258-947b885c5c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:09:18 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-ca3fc95d-0655-489c-94ba-6a8f938302a9 tempest-AttachVolumeTestJSON-670724779 None] Volume volume-33ccf2e8-97bf-4919-b142-2d73710113ed (33ccf2e8-97bf-4919-b142-2d73710113ed): created successfully
Jul 03 01:09:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ca3fc95d-0655-489c-94ba-6a8f938302a9 tempest-AttachVolumeTestJSON-670724779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ab77130-74ea-477a-a258-947b885c5c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:09:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ca3fc95d-0655-489c-94ba-6a8f938302a9 tempest-AttachVolumeTestJSON-670724779 None] Flow 'volume_create_manager' (90e02516-70bb-440b-b841-319889663c46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:09:18 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-ca3fc95d-0655-489c-94ba-6a8f938302a9 tempest-AttachVolumeTestJSON-670724779 None] Created volume successfully.
Jul 03 01:09:18 devstack sudo[94052]: pam_unix(sudo:session): session closed for user root
Jul 03 01:09:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-7ce2a3d3-ab7a-4c7d-9713-5f704fcf4830 tempest-VolumesServicesTestJSON-1877073383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-309cddbd-687a-4799-991c-d93bdca209cc" returned: 0 in 0.926s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:09:18 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-7ce2a3d3-ab7a-4c7d-9713-5f704fcf4830 tempest-VolumesServicesTestJSON-1877073383 None] Lock "cinder-quobyte-309cddbd-687a-4799-991c-d93bdca209cc" released by "delete_volume" :: held 1.940s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:09:18 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-7ce2a3d3-ab7a-4c7d-9713-5f704fcf4830 tempest-VolumesServicesTestJSON-1877073383 None] Created reservations ['b2b79a9a-fbe1-4bf0-b3aa-fae92a79f261', '54ddec14-3b41-4c7f-8062-86fe0f126b6b', '3f91f888-cb93-40d6-be80-56de0872e815', '624ffa5f-a6ee-403d-b94f-b65d96832c6f'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:09:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-7ce2a3d3-ab7a-4c7d-9713-5f704fcf4830 tempest-VolumesServicesTestJSON-1877073383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:09:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-7ce2a3d3-ab7a-4c7d-9713-5f704fcf4830 tempest-VolumesServicesTestJSON-1877073383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:09:18 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-7ce2a3d3-ab7a-4c7d-9713-5f704fcf4830 tempest-VolumesServicesTestJSON-1877073383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:09:18 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-7ce2a3d3-ab7a-4c7d-9713-5f704fcf4830 tempest-VolumesServicesTestJSON-1877073383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:09:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-7ce2a3d3-ab7a-4c7d-9713-5f704fcf4830 tempest-VolumesServicesTestJSON-1877073383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:09:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-7ce2a3d3-ab7a-4c7d-9713-5f704fcf4830 tempest-VolumesServicesTestJSON-1877073383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:09:18 devstack sudo[94062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:09:18 devstack sudo[94062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:09:19 devstack sudo[94062]: pam_unix(sudo:session): session closed for user root
Jul 03 01:09:19 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-7ce2a3d3-ab7a-4c7d-9713-5f704fcf4830 tempest-VolumesServicesTestJSON-1877073383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.902s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:09:19 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-7ce2a3d3-ab7a-4c7d-9713-5f704fcf4830 tempest-VolumesServicesTestJSON-1877073383 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:09:19 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-7ce2a3d3-ab7a-4c7d-9713-5f704fcf4830 tempest-VolumesServicesTestJSON-1877073383 None] Deleted volume successfully.
Jul 03 01:09:19 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-7ce2a3d3-ab7a-4c7d-9713-5f704fcf4830 tempest-VolumesServicesTestJSON-1877073383 None] Lock "cinder-309cddbd-687a-4799-991c-d93bdca209cc-delete_volume" released by "delete_volume" :: held 3.131s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:09:20 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [req-6b330d78-d500-4fb0-9583-cf2dac2390a9 req-21a7261d-b5e8-4dfd-9bdf-8d7939c53ae0 tempest-AttachVolumeShelveTestJSON-910043292 None] No connector for attachment a22adc57-fb63-436e-bbb3-239af5aac7dc; skipping storage backend terminate_connection call. {{(pid=86891) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Jul 03 01:09:20 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [req-6b330d78-d500-4fb0-9583-cf2dac2390a9 req-21a7261d-b5e8-4dfd-9bdf-8d7939c53ae0 tempest-AttachVolumeShelveTestJSON-910043292 None] Deleting attachment a22adc57-fb63-436e-bbb3-239af5aac7dc. {{(pid=86891) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 01:09:22 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-41805981-785b-483f-b9ff-89ba795346f3 req-47e4ae68-b7fe-4f12-a939-a46b62c7090c tempest-AttachVolumeTestJSON-670724779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:09:22 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-41805981-785b-483f-b9ff-89ba795346f3 req-47e4ae68-b7fe-4f12-a939-a46b62c7090c tempest-AttachVolumeTestJSON-670724779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:09:22 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0202489-5ae8-4b54-a9c4-a78a83ff087d]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:09:22 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-41805981-785b-483f-b9ff-89ba795346f3 req-47e4ae68-b7fe-4f12-a939-a46b62c7090c tempest-AttachVolumeTestJSON-670724779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-33ccf2e8-97bf-4919-b142-2d73710113ed {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:09:22 devstack sudo[94118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-33ccf2e8-97bf-4919-b142-2d73710113ed
Jul 03 01:09:22 devstack sudo[94118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:09:23 devstack sudo[94118]: pam_unix(sudo:session): session closed for user root
Jul 03 01:09:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-41805981-785b-483f-b9ff-89ba795346f3 req-47e4ae68-b7fe-4f12-a939-a46b62c7090c tempest-AttachVolumeTestJSON-670724779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-33ccf2e8-97bf-4919-b142-2d73710113ed" returned: 0 in 0.902s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:09:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-41805981-785b-483f-b9ff-89ba795346f3 req-47e4ae68-b7fe-4f12-a939-a46b62c7090c tempest-AttachVolumeTestJSON-670724779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.934s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:09:23 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [req-41805981-785b-483f-b9ff-89ba795346f3 req-47e4ae68-b7fe-4f12-a939-a46b62c7090c tempest-AttachVolumeTestJSON-670724779 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3', 'name': 'volume-33ccf2e8-97bf-4919-b142-2d73710113ed', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0401e242-d056-4940-9a98-74c78166946a', 'enforce_multipath': True} {{(pid=86891) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 01:09:23 devstack cinder-volume[86891]: INFO cinder.volume.manager [req-41805981-785b-483f-b9ff-89ba795346f3 req-47e4ae68-b7fe-4f12-a939-a46b62c7090c tempest-AttachVolumeTestJSON-670724779 None] attachment_update completed successfully.
Jul 03 01:09:26 devstack cinder-volume[86891]: INFO cinder.volume.manager [req-14cda801-47e9-43f1-9f21-b76582d85577 req-f7831412-b9a5-4584-9043-af82f1c09fe2 tempest-AttachVolumeNegativeTest-1781307442 None] Terminate volume connection completed successfully.
Jul 03 01:09:26 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [req-14cda801-47e9-43f1-9f21-b76582d85577 req-f7831412-b9a5-4584-9043-af82f1c09fe2 tempest-AttachVolumeNegativeTest-1781307442 None] Deleting attachment e57a23c5-c65e-4be3-986b-b99cafafda01. {{(pid=86891) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 01:09:30 devstack cinder-volume[86891]: INFO cinder.volume.manager [req-dbe2a770-759a-4879-a7bd-598225532d37 req-80df7dd4-8af8-44c6-b71c-4d81ac7bd503 tempest-AttachVolumeTestJSON-670724779 None] Terminate volume connection completed successfully.
Jul 03 01:09:30 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [req-dbe2a770-759a-4879-a7bd-598225532d37 req-80df7dd4-8af8-44c6-b71c-4d81ac7bd503 tempest-AttachVolumeTestJSON-670724779 None] Deleting attachment 8f41d382-a79d-4789-bdec-c86c0ac01935. {{(pid=86891) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 01:09:33 devstack cinder-volume[86891]: INFO cinder.volume.manager [req-6a6c0366-d73e-4be4-8656-e87b1d72d939 req-bc6a5090-06f0-452d-b322-8312da720607 tempest-AttachVolumeTestJSON-670724779 None] Terminate volume connection completed successfully.
Jul 03 01:09:33 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [req-6a6c0366-d73e-4be4-8656-e87b1d72d939 req-bc6a5090-06f0-452d-b322-8312da720607 tempest-AttachVolumeTestJSON-670724779 None] Deleting attachment 0401e242-d056-4940-9a98-74c78166946a. {{(pid=86891) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 01:09:39 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-77134de4-7434-4be2-9da3-00ee2e3176d9 tempest-VolumesGetTest-1596674288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:09:39 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-77134de4-7434-4be2-9da3-00ee2e3176d9 tempest-VolumesGetTest-1596674288 None] Flow 'volume_create_manager' (0b02b01b-8921-47f9-a24e-ff2182627386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:09:39 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-77134de4-7434-4be2-9da3-00ee2e3176d9 tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79057ac4-6b90-4938-96e8-74d75fe29496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:09:39 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-77134de4-7434-4be2-9da3-00ee2e3176d9 tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79057ac4-6b90-4938-96e8-74d75fe29496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:09:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-919272147',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e661465-56dd-4aba-9c1a-4bc2f4ca27bf,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='087effcc09294d31b1aa60c2a1ea3b65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:09:39Z,use_quota=True,user_id='6bacac4e0d924409b6e00e085cc5dc25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:09:39 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-77134de4-7434-4be2-9da3-00ee2e3176d9 tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a953701-8505-4e8a-9d3a-5bf5461552f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:09:39 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-77134de4-7434-4be2-9da3-00ee2e3176d9 tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a953701-8505-4e8a-9d3a-5bf5461552f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:09:39 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-77134de4-7434-4be2-9da3-00ee2e3176d9 tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cf80daf-8f29-4318-81bd-ab70440fa89f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:09:39 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-77134de4-7434-4be2-9da3-00ee2e3176d9 tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cf80daf-8f29-4318-81bd-ab70440fa89f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e661465-56dd-4aba-9c1a-4bc2f4ca27bf', 'volume_name': 'volume-4e661465-56dd-4aba-9c1a-4bc2f4ca27bf', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:09:39 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-77134de4-7434-4be2-9da3-00ee2e3176d9 tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29c86e0d-27f1-4a71-83fb-8996d1dd5ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:09:39 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-77134de4-7434-4be2-9da3-00ee2e3176d9 tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29c86e0d-27f1-4a71-83fb-8996d1dd5ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:09:39 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-77134de4-7434-4be2-9da3-00ee2e3176d9 tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3299ff5-0012-417b-8f0b-c9f3181fc81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:09:39 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-77134de4-7434-4be2-9da3-00ee2e3176d9 tempest-VolumesGetTest-1596674288 None] Volume 4e661465-56dd-4aba-9c1a-4bc2f4ca27bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e661465-56dd-4aba-9c1a-4bc2f4ca27bf', 'volume_size': 1}
Jul 03 01:09:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-77134de4-7434-4be2-9da3-00ee2e3176d9 tempest-VolumesGetTest-1596674288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:09:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-77134de4-7434-4be2-9da3-00ee2e3176d9 tempest-VolumesGetTest-1596674288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:09:39 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-77134de4-7434-4be2-9da3-00ee2e3176d9 tempest-VolumesGetTest-1596674288 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:09:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-919272147',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e661465-56dd-4aba-9c1a-4bc2f4ca27bf,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='087effcc09294d31b1aa60c2a1ea3b65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:09:39Z,use_quota=True,user_id='6bacac4e0d924409b6e00e085cc5dc25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:09:39 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-77134de4-7434-4be2-9da3-00ee2e3176d9 tempest-VolumesGetTest-1596674288 None] Creating volume 4e661465-56dd-4aba-9c1a-4bc2f4ca27bf {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:09:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-77134de4-7434-4be2-9da3-00ee2e3176d9 tempest-VolumesGetTest-1596674288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:09:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-77134de4-7434-4be2-9da3-00ee2e3176d9 tempest-VolumesGetTest-1596674288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:09:39 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-77134de4-7434-4be2-9da3-00ee2e3176d9 tempest-VolumesGetTest-1596674288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:09:39 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-77134de4-7434-4be2-9da3-00ee2e3176d9 tempest-VolumesGetTest-1596674288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:09:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-77134de4-7434-4be2-9da3-00ee2e3176d9 tempest-VolumesGetTest-1596674288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:09:39 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-77134de4-7434-4be2-9da3-00ee2e3176d9 tempest-VolumesGetTest-1596674288 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:09:39 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-77134de4-7434-4be2-9da3-00ee2e3176d9 tempest-VolumesGetTest-1596674288 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:09:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-77134de4-7434-4be2-9da3-00ee2e3176d9 tempest-VolumesGetTest-1596674288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4e661465-56dd-4aba-9c1a-4bc2f4ca27bf 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:09:39 devstack sudo[94269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4e661465-56dd-4aba-9c1a-4bc2f4ca27bf 1073741824
Jul 03 01:09:39 devstack sudo[94269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:09:40 devstack sudo[94269]: pam_unix(sudo:session): session closed for user root
Jul 03 01:09:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-77134de4-7434-4be2-9da3-00ee2e3176d9 tempest-VolumesGetTest-1596674288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4e661465-56dd-4aba-9c1a-4bc2f4ca27bf 1073741824" returned: 0 in 0.934s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:09:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-77134de4-7434-4be2-9da3-00ee2e3176d9 tempest-VolumesGetTest-1596674288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4e661465-56dd-4aba-9c1a-4bc2f4ca27bf {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:09:40 devstack sudo[94275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4e661465-56dd-4aba-9c1a-4bc2f4ca27bf
Jul 03 01:09:40 devstack sudo[94275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:09:41 devstack sudo[94275]: pam_unix(sudo:session): session closed for user root
Jul 03 01:09:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-77134de4-7434-4be2-9da3-00ee2e3176d9 tempest-VolumesGetTest-1596674288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4e661465-56dd-4aba-9c1a-4bc2f4ca27bf" returned: 0 in 0.865s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:09:41 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-77134de4-7434-4be2-9da3-00ee2e3176d9 tempest-VolumesGetTest-1596674288 None] <== create_volume: return (1849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:09:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-77134de4-7434-4be2-9da3-00ee2e3176d9 tempest-VolumesGetTest-1596674288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.865s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:09:41 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-77134de4-7434-4be2-9da3-00ee2e3176d9 tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3299ff5-0012-417b-8f0b-c9f3181fc81f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e661465-56dd-4aba-9c1a-4bc2f4ca27bf', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:09:41 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-77134de4-7434-4be2-9da3-00ee2e3176d9 tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1102ea60-fb82-4ad9-86c7-d2866a3ccc0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:09:41 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-77134de4-7434-4be2-9da3-00ee2e3176d9 tempest-VolumesGetTest-1596674288 None] Volume volume-4e661465-56dd-4aba-9c1a-4bc2f4ca27bf (4e661465-56dd-4aba-9c1a-4bc2f4ca27bf): created successfully
Jul 03 01:09:41 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-77134de4-7434-4be2-9da3-00ee2e3176d9 tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1102ea60-fb82-4ad9-86c7-d2866a3ccc0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:09:41 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-77134de4-7434-4be2-9da3-00ee2e3176d9 tempest-VolumesGetTest-1596674288 None] Flow 'volume_create_manager' (0b02b01b-8921-47f9-a24e-ff2182627386) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:09:41 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-77134de4-7434-4be2-9da3-00ee2e3176d9 tempest-VolumesGetTest-1596674288 None] Created volume successfully.
Jul 03 01:09:43 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cc5a4e4-49cb-4e2e-af97-9cd6faf9c863 tempest-VolumesGetTest-1596674288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:09:43 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-9cc5a4e4-49cb-4e2e-af97-9cd6faf9c863 tempest-VolumesGetTest-1596674288 None] Flow 'volume_create_manager' (6d82f742-9631-4843-8a80-00ab6d5ed942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:09:43 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-9cc5a4e4-49cb-4e2e-af97-9cd6faf9c863 tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1b22423-70b0-45ad-a8b9-76f14941feec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:09:43 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-9cc5a4e4-49cb-4e2e-af97-9cd6faf9c863 tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1b22423-70b0-45ad-a8b9-76f14941feec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:09:43Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-979825724',display_name='tempest-VolumesGetTest-Volume-317539164',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe510322-5571-4d96-a6f5-12c43da88c1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='087effcc09294d31b1aa60c2a1ea3b65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:09:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:09:44Z,use_quota=True,user_id='6bacac4e0d924409b6e00e085cc5dc25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:09:43 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-9cc5a4e4-49cb-4e2e-af97-9cd6faf9c863 tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6248626-84c6-4d4e-b5de-b0aed6555c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:09:43 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-9cc5a4e4-49cb-4e2e-af97-9cd6faf9c863 tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6248626-84c6-4d4e-b5de-b0aed6555c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:09:43 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-9cc5a4e4-49cb-4e2e-af97-9cd6faf9c863 tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc707451-ce1d-4e8b-a249-965536df60e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:09:43 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-9cc5a4e4-49cb-4e2e-af97-9cd6faf9c863 tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc707451-ce1d-4e8b-a249-965536df60e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe510322-5571-4d96-a6f5-12c43da88c1e', 'volume_name': 'volume-fe510322-5571-4d96-a6f5-12c43da88c1e', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:09:43 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-9cc5a4e4-49cb-4e2e-af97-9cd6faf9c863 tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e5e04d1-e0c0-4c50-8864-0d0868192b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:09:43 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-9cc5a4e4-49cb-4e2e-af97-9cd6faf9c863 tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e5e04d1-e0c0-4c50-8864-0d0868192b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:09:43 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-9cc5a4e4-49cb-4e2e-af97-9cd6faf9c863 tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff043cfd-9b28-4ee7-a62f-5c6a47403401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:09:43 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-9cc5a4e4-49cb-4e2e-af97-9cd6faf9c863 tempest-VolumesGetTest-1596674288 None] Volume fe510322-5571-4d96-a6f5-12c43da88c1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe510322-5571-4d96-a6f5-12c43da88c1e', 'volume_size': 1}
Jul 03 01:09:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-9cc5a4e4-49cb-4e2e-af97-9cd6faf9c863 tempest-VolumesGetTest-1596674288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:09:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-9cc5a4e4-49cb-4e2e-af97-9cd6faf9c863 tempest-VolumesGetTest-1596674288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:09:43 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-9cc5a4e4-49cb-4e2e-af97-9cd6faf9c863 tempest-VolumesGetTest-1596674288 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:09:43Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-979825724',display_name='tempest-VolumesGetTest-Volume-317539164',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe510322-5571-4d96-a6f5-12c43da88c1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='087effcc09294d31b1aa60c2a1ea3b65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:09:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:09:44Z,use_quota=True,user_id='6bacac4e0d924409b6e00e085cc5dc25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:09:43 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-9cc5a4e4-49cb-4e2e-af97-9cd6faf9c863 tempest-VolumesGetTest-1596674288 None] Creating volume fe510322-5571-4d96-a6f5-12c43da88c1e {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:09:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-9cc5a4e4-49cb-4e2e-af97-9cd6faf9c863 tempest-VolumesGetTest-1596674288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:09:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-9cc5a4e4-49cb-4e2e-af97-9cd6faf9c863 tempest-VolumesGetTest-1596674288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:09:43 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-9cc5a4e4-49cb-4e2e-af97-9cd6faf9c863 tempest-VolumesGetTest-1596674288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:09:43 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-9cc5a4e4-49cb-4e2e-af97-9cd6faf9c863 tempest-VolumesGetTest-1596674288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:09:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-9cc5a4e4-49cb-4e2e-af97-9cd6faf9c863 tempest-VolumesGetTest-1596674288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:09:43 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-9cc5a4e4-49cb-4e2e-af97-9cd6faf9c863 tempest-VolumesGetTest-1596674288 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:09:43 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-9cc5a4e4-49cb-4e2e-af97-9cd6faf9c863 tempest-VolumesGetTest-1596674288 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:09:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9cc5a4e4-49cb-4e2e-af97-9cd6faf9c863 tempest-VolumesGetTest-1596674288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-fe510322-5571-4d96-a6f5-12c43da88c1e 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:09:43 devstack sudo[94352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-fe510322-5571-4d96-a6f5-12c43da88c1e 1073741824
Jul 03 01:09:43 devstack sudo[94352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:09:44 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8de4e059-c0c4-4572-8118-ccf5c6724614 tempest-AttachVolumeTestJSON-670724779 None] Acquiring lock "cinder-33ccf2e8-97bf-4919-b142-2d73710113ed-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:09:44 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8de4e059-c0c4-4572-8118-ccf5c6724614 tempest-AttachVolumeTestJSON-670724779 None] Lock "cinder-33ccf2e8-97bf-4919-b142-2d73710113ed-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:09:44 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8de4e059-c0c4-4572-8118-ccf5c6724614 tempest-AttachVolumeTestJSON-670724779 None] Acquiring lock "cinder-quobyte-33ccf2e8-97bf-4919-b142-2d73710113ed" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:09:44 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8de4e059-c0c4-4572-8118-ccf5c6724614 tempest-AttachVolumeTestJSON-670724779 None] Lock "cinder-quobyte-33ccf2e8-97bf-4919-b142-2d73710113ed" acquired by "delete_volume" :: waited 0.017s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:09:44 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e3294b-9f5f-41be-8096-59104084b3d7]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:09:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8de4e059-c0c4-4572-8118-ccf5c6724614 tempest-AttachVolumeTestJSON-670724779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-33ccf2e8-97bf-4919-b142-2d73710113ed {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:09:45 devstack sudo[94352]: pam_unix(sudo:session): session closed for user root
Jul 03 01:09:45 devstack sudo[94358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-33ccf2e8-97bf-4919-b142-2d73710113ed
Jul 03 01:09:45 devstack sudo[94358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:09:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9cc5a4e4-49cb-4e2e-af97-9cd6faf9c863 tempest-VolumesGetTest-1596674288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-fe510322-5571-4d96-a6f5-12c43da88c1e 1073741824" returned: 0 in 1.271s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:09:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9cc5a4e4-49cb-4e2e-af97-9cd6faf9c863 tempest-VolumesGetTest-1596674288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-fe510322-5571-4d96-a6f5-12c43da88c1e {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:09:45 devstack sudo[94360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-fe510322-5571-4d96-a6f5-12c43da88c1e
Jul 03 01:09:45 devstack sudo[94360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:09:45 devstack sudo[94360]: pam_unix(sudo:session): session closed for user root
Jul 03 01:09:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9cc5a4e4-49cb-4e2e-af97-9cd6faf9c863 tempest-VolumesGetTest-1596674288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-fe510322-5571-4d96-a6f5-12c43da88c1e" returned: 0 in 0.653s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:09:45 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-9cc5a4e4-49cb-4e2e-af97-9cd6faf9c863 tempest-VolumesGetTest-1596674288 None] <== create_volume: return (2008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:09:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-9cc5a4e4-49cb-4e2e-af97-9cd6faf9c863 tempest-VolumesGetTest-1596674288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.010s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:09:45 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-9cc5a4e4-49cb-4e2e-af97-9cd6faf9c863 tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff043cfd-9b28-4ee7-a62f-5c6a47403401) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe510322-5571-4d96-a6f5-12c43da88c1e', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:09:45 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-9cc5a4e4-49cb-4e2e-af97-9cd6faf9c863 tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44df1832-2ae0-4aef-9908-b4758a11595f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:09:45 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-9cc5a4e4-49cb-4e2e-af97-9cd6faf9c863 tempest-VolumesGetTest-1596674288 None] Volume volume-fe510322-5571-4d96-a6f5-12c43da88c1e (fe510322-5571-4d96-a6f5-12c43da88c1e): created successfully
Jul 03 01:09:45 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-9cc5a4e4-49cb-4e2e-af97-9cd6faf9c863 tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44df1832-2ae0-4aef-9908-b4758a11595f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:09:45 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-9cc5a4e4-49cb-4e2e-af97-9cd6faf9c863 tempest-VolumesGetTest-1596674288 None] Flow 'volume_create_manager' (6d82f742-9631-4843-8a80-00ab6d5ed942) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:09:45 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-9cc5a4e4-49cb-4e2e-af97-9cd6faf9c863 tempest-VolumesGetTest-1596674288 None] Created volume successfully.
Jul 03 01:09:45 devstack sudo[94358]: pam_unix(sudo:session): session closed for user root
Jul 03 01:09:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8de4e059-c0c4-4572-8118-ccf5c6724614 tempest-AttachVolumeTestJSON-670724779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-33ccf2e8-97bf-4919-b142-2d73710113ed" returned: 0 in 0.913s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:09:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8de4e059-c0c4-4572-8118-ccf5c6724614 tempest-AttachVolumeTestJSON-670724779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-33ccf2e8-97bf-4919-b142-2d73710113ed {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:09:45 devstack sudo[94366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-33ccf2e8-97bf-4919-b142-2d73710113ed
Jul 03 01:09:45 devstack sudo[94366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:09:46 devstack sudo[94366]: pam_unix(sudo:session): session closed for user root
Jul 03 01:09:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8de4e059-c0c4-4572-8118-ccf5c6724614 tempest-AttachVolumeTestJSON-670724779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-33ccf2e8-97bf-4919-b142-2d73710113ed" returned: 0 in 0.684s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:09:46 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8de4e059-c0c4-4572-8118-ccf5c6724614 tempest-AttachVolumeTestJSON-670724779 None] Lock "cinder-quobyte-33ccf2e8-97bf-4919-b142-2d73710113ed" released by "delete_volume" :: held 1.643s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:09:46 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-8de4e059-c0c4-4572-8118-ccf5c6724614 tempest-AttachVolumeTestJSON-670724779 None] Created reservations ['e2fc41f6-b542-4dcd-b4cd-bd7528a17580', '0077924b-c53a-47a9-865e-566998fc3879', '5b61142d-25b5-43fb-8567-1e06cffe8d82', '3d4f2bcd-ecff-4bf6-9444-e75c2facf79a'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:09:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-8de4e059-c0c4-4572-8118-ccf5c6724614 tempest-AttachVolumeTestJSON-670724779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:09:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-8de4e059-c0c4-4572-8118-ccf5c6724614 tempest-AttachVolumeTestJSON-670724779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:09:46 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-8de4e059-c0c4-4572-8118-ccf5c6724614 tempest-AttachVolumeTestJSON-670724779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:09:46 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-8de4e059-c0c4-4572-8118-ccf5c6724614 tempest-AttachVolumeTestJSON-670724779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:09:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-8de4e059-c0c4-4572-8118-ccf5c6724614 tempest-AttachVolumeTestJSON-670724779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:09:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8de4e059-c0c4-4572-8118-ccf5c6724614 tempest-AttachVolumeTestJSON-670724779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:09:46 devstack sudo[94369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:09:46 devstack sudo[94369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:09:47 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-15a8f78b-36db-42e6-be5e-4b2702300bfd tempest-AttachVolumeTestJSON-670724779 None] Acquiring lock "cinder-554e3870-616e-40ba-8df9-2d7a9c232add-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:09:47 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d4075d6a-6c32-48df-bfd6-8d9f737c6987 tempest-VolumesGetTest-1596674288 None] Acquiring lock "cinder-fe510322-5571-4d96-a6f5-12c43da88c1e-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:09:47 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d4075d6a-6c32-48df-bfd6-8d9f737c6987 tempest-VolumesGetTest-1596674288 None] Lock "cinder-fe510322-5571-4d96-a6f5-12c43da88c1e-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:09:47 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-15a8f78b-36db-42e6-be5e-4b2702300bfd tempest-AttachVolumeTestJSON-670724779 None] Lock "cinder-554e3870-616e-40ba-8df9-2d7a9c232add-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:09:47 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d4075d6a-6c32-48df-bfd6-8d9f737c6987 tempest-VolumesGetTest-1596674288 None] Acquiring lock "cinder-quobyte-fe510322-5571-4d96-a6f5-12c43da88c1e" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:09:47 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-15a8f78b-36db-42e6-be5e-4b2702300bfd tempest-AttachVolumeTestJSON-670724779 None] Acquiring lock "cinder-quobyte-554e3870-616e-40ba-8df9-2d7a9c232add" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:09:47 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d4075d6a-6c32-48df-bfd6-8d9f737c6987 tempest-VolumesGetTest-1596674288 None] Lock "cinder-quobyte-fe510322-5571-4d96-a6f5-12c43da88c1e" acquired by "delete_volume" :: waited 0.047s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:09:47 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-15a8f78b-36db-42e6-be5e-4b2702300bfd tempest-AttachVolumeTestJSON-670724779 None] Lock "cinder-quobyte-554e3870-616e-40ba-8df9-2d7a9c232add" acquired by "delete_volume" :: waited 0.069s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:09:47 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c57adec-f6a9-4d90-925f-294eb16b9c27]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:09:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d4075d6a-6c32-48df-bfd6-8d9f737c6987 tempest-VolumesGetTest-1596674288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-fe510322-5571-4d96-a6f5-12c43da88c1e {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:09:47 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf2fccb-e452-4863-8ee0-7bdfad0f11ba]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:09:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-15a8f78b-36db-42e6-be5e-4b2702300bfd tempest-AttachVolumeTestJSON-670724779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-554e3870-616e-40ba-8df9-2d7a9c232add {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:09:47 devstack sudo[94372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-554e3870-616e-40ba-8df9-2d7a9c232add
Jul 03 01:09:47 devstack sudo[94372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:09:47 devstack sudo[94371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-fe510322-5571-4d96-a6f5-12c43da88c1e
Jul 03 01:09:47 devstack sudo[94371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:09:47 devstack sudo[94369]: pam_unix(sudo:session): session closed for user root
Jul 03 01:09:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8de4e059-c0c4-4572-8118-ccf5c6724614 tempest-AttachVolumeTestJSON-670724779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 1.037s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:09:47 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-8de4e059-c0c4-4572-8118-ccf5c6724614 tempest-AttachVolumeTestJSON-670724779 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:09:47 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-8de4e059-c0c4-4572-8118-ccf5c6724614 tempest-AttachVolumeTestJSON-670724779 None] Deleted volume successfully.
Jul 03 01:09:47 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8de4e059-c0c4-4572-8118-ccf5c6724614 tempest-AttachVolumeTestJSON-670724779 None] Lock "cinder-33ccf2e8-97bf-4919-b142-2d73710113ed-delete_volume" released by "delete_volume" :: held 2.938s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:09:48 devstack sudo[94371]: pam_unix(sudo:session): session closed for user root
Jul 03 01:09:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d4075d6a-6c32-48df-bfd6-8d9f737c6987 tempest-VolumesGetTest-1596674288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-fe510322-5571-4d96-a6f5-12c43da88c1e" returned: 0 in 1.240s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:09:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d4075d6a-6c32-48df-bfd6-8d9f737c6987 tempest-VolumesGetTest-1596674288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-fe510322-5571-4d96-a6f5-12c43da88c1e {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:09:48 devstack sudo[94372]: pam_unix(sudo:session): session closed for user root
Jul 03 01:09:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-15a8f78b-36db-42e6-be5e-4b2702300bfd tempest-AttachVolumeTestJSON-670724779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-554e3870-616e-40ba-8df9-2d7a9c232add" returned: 0 in 1.258s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:09:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-15a8f78b-36db-42e6-be5e-4b2702300bfd tempest-AttachVolumeTestJSON-670724779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-554e3870-616e-40ba-8df9-2d7a9c232add {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:09:48 devstack sudo[94384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-fe510322-5571-4d96-a6f5-12c43da88c1e
Jul 03 01:09:48 devstack sudo[94384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:09:48 devstack sudo[94385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-554e3870-616e-40ba-8df9-2d7a9c232add
Jul 03 01:09:48 devstack sudo[94385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:09:49 devstack sudo[94385]: pam_unix(sudo:session): session closed for user root
Jul 03 01:09:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-15a8f78b-36db-42e6-be5e-4b2702300bfd tempest-AttachVolumeTestJSON-670724779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-554e3870-616e-40ba-8df9-2d7a9c232add" returned: 0 in 1.242s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:09:49 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-15a8f78b-36db-42e6-be5e-4b2702300bfd tempest-AttachVolumeTestJSON-670724779 None] Lock "cinder-quobyte-554e3870-616e-40ba-8df9-2d7a9c232add" released by "delete_volume" :: held 2.596s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:09:50 devstack sudo[94384]: pam_unix(sudo:session): session closed for user root
Jul 03 01:09:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d4075d6a-6c32-48df-bfd6-8d9f737c6987 tempest-VolumesGetTest-1596674288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-fe510322-5571-4d96-a6f5-12c43da88c1e" returned: 0 in 1.430s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:09:50 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d4075d6a-6c32-48df-bfd6-8d9f737c6987 tempest-VolumesGetTest-1596674288 None] Lock "cinder-quobyte-fe510322-5571-4d96-a6f5-12c43da88c1e" released by "delete_volume" :: held 2.760s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:09:50 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-15a8f78b-36db-42e6-be5e-4b2702300bfd tempest-AttachVolumeTestJSON-670724779 None] Created reservations ['5e79f472-fc46-460e-9bc1-adb1e882f39d', '7ff26263-bf04-4327-9098-6ca026631d78', 'f2fd6e82-5a17-4229-b4b5-d40f06877750', '3964cd53-9532-4271-aa31-d600cd52e7f3'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:09:50 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-d4075d6a-6c32-48df-bfd6-8d9f737c6987 tempest-VolumesGetTest-1596674288 None] Created reservations ['e48690fb-8937-43ea-ad99-24e139a3453c', 'fe9c7f9a-e1dd-411e-800b-80f0cb8a7e67', 'e03e06fa-e8d4-44c2-9099-97106d965f19', '7375b8f1-a032-49e5-b38c-6a97eda348fe'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:09:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-15a8f78b-36db-42e6-be5e-4b2702300bfd tempest-AttachVolumeTestJSON-670724779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:09:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-15a8f78b-36db-42e6-be5e-4b2702300bfd tempest-AttachVolumeTestJSON-670724779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:09:50 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-15a8f78b-36db-42e6-be5e-4b2702300bfd tempest-AttachVolumeTestJSON-670724779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:09:50 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-15a8f78b-36db-42e6-be5e-4b2702300bfd tempest-AttachVolumeTestJSON-670724779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:09:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-15a8f78b-36db-42e6-be5e-4b2702300bfd tempest-AttachVolumeTestJSON-670724779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:09:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-15a8f78b-36db-42e6-be5e-4b2702300bfd tempest-AttachVolumeTestJSON-670724779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:09:50 devstack sudo[94406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:09:50 devstack sudo[94406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:09:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-d4075d6a-6c32-48df-bfd6-8d9f737c6987 tempest-VolumesGetTest-1596674288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:09:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-d4075d6a-6c32-48df-bfd6-8d9f737c6987 tempest-VolumesGetTest-1596674288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:09:50 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-d4075d6a-6c32-48df-bfd6-8d9f737c6987 tempest-VolumesGetTest-1596674288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:09:50 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-d4075d6a-6c32-48df-bfd6-8d9f737c6987 tempest-VolumesGetTest-1596674288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:09:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-d4075d6a-6c32-48df-bfd6-8d9f737c6987 tempest-VolumesGetTest-1596674288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:09:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d4075d6a-6c32-48df-bfd6-8d9f737c6987 tempest-VolumesGetTest-1596674288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:09:50 devstack sudo[94411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:09:50 devstack sudo[94411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:09:50 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-c183596b-43ae-49d6-96ae-0ada57b4b5a8 tempest-VolumesGetTest-1596674288 None] Acquiring lock "cinder-4e661465-56dd-4aba-9c1a-4bc2f4ca27bf-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:09:50 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-20372f36-1f36-408e-8999-c7f798030a55 tempest-AttachVolumeTestJSON-670724779 None] Acquiring lock "cinder-ac793674-2d51-4fb1-ad04-f71736426f39-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:09:50 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-c183596b-43ae-49d6-96ae-0ada57b4b5a8 tempest-VolumesGetTest-1596674288 None] Lock "cinder-4e661465-56dd-4aba-9c1a-4bc2f4ca27bf-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:09:51 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-20372f36-1f36-408e-8999-c7f798030a55 tempest-AttachVolumeTestJSON-670724779 None] Lock "cinder-ac793674-2d51-4fb1-ad04-f71736426f39-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:09:51 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-c183596b-43ae-49d6-96ae-0ada57b4b5a8 tempest-VolumesGetTest-1596674288 None] Acquiring lock "cinder-quobyte-4e661465-56dd-4aba-9c1a-4bc2f4ca27bf" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:09:51 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-20372f36-1f36-408e-8999-c7f798030a55 tempest-AttachVolumeTestJSON-670724779 None] Acquiring lock "cinder-quobyte-ac793674-2d51-4fb1-ad04-f71736426f39" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:09:51 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-c183596b-43ae-49d6-96ae-0ada57b4b5a8 tempest-VolumesGetTest-1596674288 None] Lock "cinder-quobyte-4e661465-56dd-4aba-9c1a-4bc2f4ca27bf" acquired by "delete_volume" :: waited 0.037s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:09:51 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-20372f36-1f36-408e-8999-c7f798030a55 tempest-AttachVolumeTestJSON-670724779 None] Lock "cinder-quobyte-ac793674-2d51-4fb1-ad04-f71736426f39" acquired by "delete_volume" :: waited 0.039s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:09:51 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[40fcd4af-e6dd-4cce-a3e0-86d008577bb3]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:09:51 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c183596b-43ae-49d6-96ae-0ada57b4b5a8 tempest-VolumesGetTest-1596674288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4e661465-56dd-4aba-9c1a-4bc2f4ca27bf {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:09:51 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[87179242-0a1c-4b7b-86fb-71e675624d89]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:09:51 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-20372f36-1f36-408e-8999-c7f798030a55 tempest-AttachVolumeTestJSON-670724779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ac793674-2d51-4fb1-ad04-f71736426f39 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:09:51 devstack sudo[94415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ac793674-2d51-4fb1-ad04-f71736426f39
Jul 03 01:09:51 devstack sudo[94415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:09:51 devstack sudo[94414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4e661465-56dd-4aba-9c1a-4bc2f4ca27bf
Jul 03 01:09:51 devstack sudo[94414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:09:51 devstack sudo[94411]: pam_unix(sudo:session): session closed for user root
Jul 03 01:09:51 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d4075d6a-6c32-48df-bfd6-8d9f737c6987 tempest-VolumesGetTest-1596674288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 1.090s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:09:51 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-d4075d6a-6c32-48df-bfd6-8d9f737c6987 tempest-VolumesGetTest-1596674288 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:09:51 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-d4075d6a-6c32-48df-bfd6-8d9f737c6987 tempest-VolumesGetTest-1596674288 None] Deleted volume successfully.
Jul 03 01:09:51 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:UPDATE=86,cinder:SELECT=68,cinder:INSERT=14,cinder:DELETE=4 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:09:51 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d4075d6a-6c32-48df-bfd6-8d9f737c6987 tempest-VolumesGetTest-1596674288 None] Lock "cinder-fe510322-5571-4d96-a6f5-12c43da88c1e-delete_volume" released by "delete_volume" :: held 4.447s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:09:52 devstack sudo[94406]: pam_unix(sudo:session): session closed for user root
Jul 03 01:09:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-15a8f78b-36db-42e6-be5e-4b2702300bfd tempest-AttachVolumeTestJSON-670724779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 1.646s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:09:52 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-15a8f78b-36db-42e6-be5e-4b2702300bfd tempest-AttachVolumeTestJSON-670724779 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:09:52 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-15a8f78b-36db-42e6-be5e-4b2702300bfd tempest-AttachVolumeTestJSON-670724779 None] Deleted volume successfully.
Jul 03 01:09:52 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-15a8f78b-36db-42e6-be5e-4b2702300bfd tempest-AttachVolumeTestJSON-670724779 None] Lock "cinder-554e3870-616e-40ba-8df9-2d7a9c232add-delete_volume" released by "delete_volume" :: held 4.844s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:09:52 devstack sudo[94415]: pam_unix(sudo:session): session closed for user root
Jul 03 01:09:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-20372f36-1f36-408e-8999-c7f798030a55 tempest-AttachVolumeTestJSON-670724779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ac793674-2d51-4fb1-ad04-f71736426f39" returned: 0 in 1.200s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:09:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-20372f36-1f36-408e-8999-c7f798030a55 tempest-AttachVolumeTestJSON-670724779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ac793674-2d51-4fb1-ad04-f71736426f39 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:09:52 devstack sudo[94425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ac793674-2d51-4fb1-ad04-f71736426f39
Jul 03 01:09:52 devstack sudo[94425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:09:52 devstack sudo[94414]: pam_unix(sudo:session): session closed for user root
Jul 03 01:09:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c183596b-43ae-49d6-96ae-0ada57b4b5a8 tempest-VolumesGetTest-1596674288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4e661465-56dd-4aba-9c1a-4bc2f4ca27bf" returned: 0 in 1.366s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:09:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c183596b-43ae-49d6-96ae-0ada57b4b5a8 tempest-VolumesGetTest-1596674288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4e661465-56dd-4aba-9c1a-4bc2f4ca27bf {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:09:52 devstack sudo[94428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4e661465-56dd-4aba-9c1a-4bc2f4ca27bf
Jul 03 01:09:52 devstack sudo[94428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:09:53 devstack sudo[94425]: pam_unix(sudo:session): session closed for user root
Jul 03 01:09:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-20372f36-1f36-408e-8999-c7f798030a55 tempest-AttachVolumeTestJSON-670724779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ac793674-2d51-4fb1-ad04-f71736426f39" returned: 0 in 0.718s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:09:53 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-20372f36-1f36-408e-8999-c7f798030a55 tempest-AttachVolumeTestJSON-670724779 None] Lock "cinder-quobyte-ac793674-2d51-4fb1-ad04-f71736426f39" released by "delete_volume" :: held 1.985s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:09:53 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:UPDATE=72,cinder:SELECT=68,cinder:INSERT=18,cinder:DELETE=5 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:09:53 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-20372f36-1f36-408e-8999-c7f798030a55 tempest-AttachVolumeTestJSON-670724779 None] Created reservations ['04ece994-7b0f-4a27-999e-0f8b7ae56a41', '1a095480-bf5f-4b47-ba0c-107d20d7f5b0', 'c76caf70-cf69-416e-8fd7-6052d1002b45', 'efeb4553-ef9e-4a0c-9aea-2f590acdbaf5'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:09:53 devstack sudo[94428]: pam_unix(sudo:session): session closed for user root
Jul 03 01:09:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c183596b-43ae-49d6-96ae-0ada57b4b5a8 tempest-VolumesGetTest-1596674288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4e661465-56dd-4aba-9c1a-4bc2f4ca27bf" returned: 0 in 0.755s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:09:53 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-c183596b-43ae-49d6-96ae-0ada57b4b5a8 tempest-VolumesGetTest-1596674288 None] Lock "cinder-quobyte-4e661465-56dd-4aba-9c1a-4bc2f4ca27bf" released by "delete_volume" :: held 2.212s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:09:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-20372f36-1f36-408e-8999-c7f798030a55 tempest-AttachVolumeTestJSON-670724779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:09:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-20372f36-1f36-408e-8999-c7f798030a55 tempest-AttachVolumeTestJSON-670724779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:09:53 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-20372f36-1f36-408e-8999-c7f798030a55 tempest-AttachVolumeTestJSON-670724779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:09:53 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-20372f36-1f36-408e-8999-c7f798030a55 tempest-AttachVolumeTestJSON-670724779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:09:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-20372f36-1f36-408e-8999-c7f798030a55 tempest-AttachVolumeTestJSON-670724779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:09:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-20372f36-1f36-408e-8999-c7f798030a55 tempest-AttachVolumeTestJSON-670724779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:09:53 devstack sudo[94432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:09:53 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-c183596b-43ae-49d6-96ae-0ada57b4b5a8 tempest-VolumesGetTest-1596674288 None] Created reservations ['613ecdd5-0c34-42e9-9003-1ec553e45f53', 'a31c2845-acb4-4beb-9c7a-c48b0607eab1', 'e9fdab42-0ce0-410f-8878-72dc32b54720', 'dfa006a4-bfa1-4de4-8bd6-be6bafa136c6'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:09:53 devstack sudo[94432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:09:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-c183596b-43ae-49d6-96ae-0ada57b4b5a8 tempest-VolumesGetTest-1596674288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:09:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-c183596b-43ae-49d6-96ae-0ada57b4b5a8 tempest-VolumesGetTest-1596674288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:09:53 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-c183596b-43ae-49d6-96ae-0ada57b4b5a8 tempest-VolumesGetTest-1596674288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:09:53 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-c183596b-43ae-49d6-96ae-0ada57b4b5a8 tempest-VolumesGetTest-1596674288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:09:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-c183596b-43ae-49d6-96ae-0ada57b4b5a8 tempest-VolumesGetTest-1596674288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:09:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c183596b-43ae-49d6-96ae-0ada57b4b5a8 tempest-VolumesGetTest-1596674288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:09:53 devstack sudo[94434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:09:53 devstack sudo[94434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:09:54 devstack sudo[94432]: pam_unix(sudo:session): session closed for user root
Jul 03 01:09:54 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-20372f36-1f36-408e-8999-c7f798030a55 tempest-AttachVolumeTestJSON-670724779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.760s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:09:54 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-20372f36-1f36-408e-8999-c7f798030a55 tempest-AttachVolumeTestJSON-670724779 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:09:54 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-20372f36-1f36-408e-8999-c7f798030a55 tempest-AttachVolumeTestJSON-670724779 None] Deleted volume successfully.
Jul 03 01:09:54 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-20372f36-1f36-408e-8999-c7f798030a55 tempest-AttachVolumeTestJSON-670724779 None] Lock "cinder-ac793674-2d51-4fb1-ad04-f71736426f39-delete_volume" released by "delete_volume" :: held 3.242s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:09:54 devstack sudo[94434]: pam_unix(sudo:session): session closed for user root
Jul 03 01:09:54 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c183596b-43ae-49d6-96ae-0ada57b4b5a8 tempest-VolumesGetTest-1596674288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.749s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:09:54 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-c183596b-43ae-49d6-96ae-0ada57b4b5a8 tempest-VolumesGetTest-1596674288 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:09:54 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-c183596b-43ae-49d6-96ae-0ada57b4b5a8 tempest-VolumesGetTest-1596674288 None] Deleted volume successfully.
Jul 03 01:09:54 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-c183596b-43ae-49d6-96ae-0ada57b4b5a8 tempest-VolumesGetTest-1596674288 None] Lock "cinder-4e661465-56dd-4aba-9c1a-4bc2f4ca27bf-delete_volume" released by "delete_volume" :: held 3.470s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:09:55 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc900bba-3ee0-4744-a6ec-ace5bf98fa12 tempest-VolumesGetTest-1596674288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:09:55 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bc900bba-3ee0-4744-a6ec-ace5bf98fa12 tempest-VolumesGetTest-1596674288 None] Flow 'volume_create_manager' (ff899f55-bfd8-4816-8188-a3218ce18d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:09:55 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bc900bba-3ee0-4744-a6ec-ace5bf98fa12 tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82e574d5-488a-45cf-b312-f555d519a4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:09:55 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bc900bba-3ee0-4744-a6ec-ace5bf98fa12 tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82e574d5-488a-45cf-b312-f555d519a4ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:09:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-424941867',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c46bbbe1-f74e-4abb-a658-a9a11af14f06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='087effcc09294d31b1aa60c2a1ea3b65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:09:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:09:55Z,use_quota=True,user_id='6bacac4e0d924409b6e00e085cc5dc25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:09:55 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bc900bba-3ee0-4744-a6ec-ace5bf98fa12 tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7a5fc63-d710-4c19-9767-e8684ae57c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:09:55 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bc900bba-3ee0-4744-a6ec-ace5bf98fa12 tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7a5fc63-d710-4c19-9767-e8684ae57c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:09:55 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bc900bba-3ee0-4744-a6ec-ace5bf98fa12 tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40da7fdb-687e-47d7-8e66-64d77afd30c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:09:55 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bc900bba-3ee0-4744-a6ec-ace5bf98fa12 tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40da7fdb-687e-47d7-8e66-64d77afd30c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c46bbbe1-f74e-4abb-a658-a9a11af14f06', 'volume_name': 'volume-c46bbbe1-f74e-4abb-a658-a9a11af14f06', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:09:55 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bc900bba-3ee0-4744-a6ec-ace5bf98fa12 tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68285c4f-0313-4cdc-871e-87537bf10b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:09:55 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bc900bba-3ee0-4744-a6ec-ace5bf98fa12 tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68285c4f-0313-4cdc-871e-87537bf10b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:09:55 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bc900bba-3ee0-4744-a6ec-ace5bf98fa12 tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ced389ae-3ca9-4a45-bdfb-ac4ed279cb97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:09:55 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-bc900bba-3ee0-4744-a6ec-ace5bf98fa12 tempest-VolumesGetTest-1596674288 None] Volume c46bbbe1-f74e-4abb-a658-a9a11af14f06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c46bbbe1-f74e-4abb-a658-a9a11af14f06', 'volume_size': 1}
Jul 03 01:09:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-bc900bba-3ee0-4744-a6ec-ace5bf98fa12 tempest-VolumesGetTest-1596674288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:09:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-bc900bba-3ee0-4744-a6ec-ace5bf98fa12 tempest-VolumesGetTest-1596674288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:09:55 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-bc900bba-3ee0-4744-a6ec-ace5bf98fa12 tempest-VolumesGetTest-1596674288 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:09:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-424941867',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c46bbbe1-f74e-4abb-a658-a9a11af14f06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='087effcc09294d31b1aa60c2a1ea3b65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:09:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:09:55Z,use_quota=True,user_id='6bacac4e0d924409b6e00e085cc5dc25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:09:55 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-bc900bba-3ee0-4744-a6ec-ace5bf98fa12 tempest-VolumesGetTest-1596674288 None] Creating volume c46bbbe1-f74e-4abb-a658-a9a11af14f06 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:09:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-bc900bba-3ee0-4744-a6ec-ace5bf98fa12 tempest-VolumesGetTest-1596674288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:09:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-bc900bba-3ee0-4744-a6ec-ace5bf98fa12 tempest-VolumesGetTest-1596674288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:09:55 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-bc900bba-3ee0-4744-a6ec-ace5bf98fa12 tempest-VolumesGetTest-1596674288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:09:55 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-bc900bba-3ee0-4744-a6ec-ace5bf98fa12 tempest-VolumesGetTest-1596674288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:09:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-bc900bba-3ee0-4744-a6ec-ace5bf98fa12 tempest-VolumesGetTest-1596674288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:09:55 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-bc900bba-3ee0-4744-a6ec-ace5bf98fa12 tempest-VolumesGetTest-1596674288 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:09:55 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-bc900bba-3ee0-4744-a6ec-ace5bf98fa12 tempest-VolumesGetTest-1596674288 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:09:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bc900bba-3ee0-4744-a6ec-ace5bf98fa12 tempest-VolumesGetTest-1596674288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c46bbbe1-f74e-4abb-a658-a9a11af14f06 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:09:55 devstack sudo[94457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c46bbbe1-f74e-4abb-a658-a9a11af14f06 1073741824
Jul 03 01:09:55 devstack sudo[94457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:09:56 devstack sudo[94457]: pam_unix(sudo:session): session closed for user root
Jul 03 01:09:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bc900bba-3ee0-4744-a6ec-ace5bf98fa12 tempest-VolumesGetTest-1596674288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c46bbbe1-f74e-4abb-a658-a9a11af14f06 1073741824" returned: 0 in 0.906s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:09:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bc900bba-3ee0-4744-a6ec-ace5bf98fa12 tempest-VolumesGetTest-1596674288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c46bbbe1-f74e-4abb-a658-a9a11af14f06 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:09:56 devstack sudo[94464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c46bbbe1-f74e-4abb-a658-a9a11af14f06
Jul 03 01:09:56 devstack sudo[94464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:09:57 devstack sudo[94464]: pam_unix(sudo:session): session closed for user root
Jul 03 01:09:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bc900bba-3ee0-4744-a6ec-ace5bf98fa12 tempest-VolumesGetTest-1596674288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c46bbbe1-f74e-4abb-a658-a9a11af14f06" returned: 0 in 0.984s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:09:57 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-bc900bba-3ee0-4744-a6ec-ace5bf98fa12 tempest-VolumesGetTest-1596674288 None] <== create_volume: return (1969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:09:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-bc900bba-3ee0-4744-a6ec-ace5bf98fa12 tempest-VolumesGetTest-1596674288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.971s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:09:57 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bc900bba-3ee0-4744-a6ec-ace5bf98fa12 tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ced389ae-3ca9-4a45-bdfb-ac4ed279cb97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c46bbbe1-f74e-4abb-a658-a9a11af14f06', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:09:57 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bc900bba-3ee0-4744-a6ec-ace5bf98fa12 tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba609acb-c42c-4290-bc53-36b17c709b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:09:57 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-bc900bba-3ee0-4744-a6ec-ace5bf98fa12 tempest-VolumesGetTest-1596674288 None] Volume volume-c46bbbe1-f74e-4abb-a658-a9a11af14f06 (c46bbbe1-f74e-4abb-a658-a9a11af14f06): created successfully
Jul 03 01:09:57 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bc900bba-3ee0-4744-a6ec-ace5bf98fa12 tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba609acb-c42c-4290-bc53-36b17c709b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:09:57 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bc900bba-3ee0-4744-a6ec-ace5bf98fa12 tempest-VolumesGetTest-1596674288 None] Flow 'volume_create_manager' (ff899f55-bfd8-4816-8188-a3218ce18d28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:09:57 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-bc900bba-3ee0-4744-a6ec-ace5bf98fa12 tempest-VolumesGetTest-1596674288 None] Created volume successfully.
Jul 03 01:09:59 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:09:59 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] Flow 'volume_create_manager' (8884ba1f-42c2-4a71-b247-d4952f7842d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:09:59 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe99460b-64cc-428b-a74b-4f9aaabd0830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:09:59 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe99460b-64cc-428b-a74b-4f9aaabd0830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:09:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1116885332',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=123add89-7770-48a6-9915-ec87f09727b2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='087effcc09294d31b1aa60c2a1ea3b65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:09:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=c46bbbe1-f74e-4abb-a658-a9a11af14f06,status='creating',terminated_at=None,updated_at=2026-07-02T23:09:59Z,use_quota=True,user_id='6bacac4e0d924409b6e00e085cc5dc25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:09:59 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d15730a0-0d55-4074-81e5-4077097a3804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:09:59 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d15730a0-0d55-4074-81e5-4077097a3804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:09:59 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30338abc-c6d1-4b70-8f11-3a834bf08692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:09:59 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30338abc-c6d1-4b70-8f11-3a834bf08692) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '123add89-7770-48a6-9915-ec87f09727b2', 'volume_name': 'volume-123add89-7770-48a6-9915-ec87f09727b2', 'volume_size': 1, 'source_volid': 'c46bbbe1-f74e-4abb-a658-a9a11af14f06', 'source_volstatus': 'available'}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:09:59 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ea8627f-c63f-4859-bd0f-064392451946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:09:59 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ea8627f-c63f-4859-bd0f-064392451946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:09:59 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3db4fef2-40cd-4763-babb-a37e02507e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:09:59 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] Volume 123add89-7770-48a6-9915-ec87f09727b2: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-123add89-7770-48a6-9915-ec87f09727b2', 'volume_size': 1, 'source_volid': 'c46bbbe1-f74e-4abb-a658-a9a11af14f06', 'source_volstatus': 'available'}
Jul 03 01:09:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:09:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:09:59 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] Cloning volume c46bbbe1-f74e-4abb-a658-a9a11af14f06 to volume 123add89-7770-48a6-9915-ec87f09727b2
Jul 03 01:09:59 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] Creating offline snapshot 67b7cc68-bd89-4d10-af1c-fa4973ec4e82 of volume c46bbbe1-f74e-4abb-a658-a9a11af14f06 {{(pid=86891) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 01:09:59 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[4213afd5-c585-4b13-bba1-1bac4f57a2a0]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:09:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c46bbbe1-f74e-4abb-a658-a9a11af14f06 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:09:59 devstack sudo[94547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c46bbbe1-f74e-4abb-a658-a9a11af14f06
Jul 03 01:09:59 devstack sudo[94547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:00 devstack sudo[94547]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:00 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c46bbbe1-f74e-4abb-a658-a9a11af14f06" returned: 0 in 1.099s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:00 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c46bbbe1-f74e-4abb-a658-a9a11af14f06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c46bbbe1-f74e-4abb-a658-a9a11af14f06.67b7cc68-bd89-4d10-af1c-fa4973ec4e82 1G {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:00 devstack sudo[94556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c46bbbe1-f74e-4abb-a658-a9a11af14f06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c46bbbe1-f74e-4abb-a658-a9a11af14f06.67b7cc68-bd89-4d10-af1c-fa4973ec4e82 1G
Jul 03 01:10:00 devstack sudo[94556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:01 devstack cinder-volume[86891]: DEBUG oslo_service.periodic_task [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running periodic task VolumeManager._thread_info {{(pid=86891) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 01:10:01 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] thread count: 8 {{(pid=86891) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 01:10:01 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] thread info: [<_MainThread(MainThread, started 136731296534656)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136731184953280)>, <Thread(Thread-3 (stat_writer), started daemon 136731184058816)>, <Thread(Rabbit-heartbeat, started daemon 136731184846080)>, <Thread(Thread-5 (_runner), started daemon 136731182936576)>, <Thread(Thread-7 (_runner), started daemon 136731182954944)>, <Thread(fd_logger, started daemon 136731181916416)>, <Thread(privsep_reader, started daemon 136731180942208)>] {{(pid=86891) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 01:10:02 devstack sudo[94556]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c46bbbe1-f74e-4abb-a658-a9a11af14f06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c46bbbe1-f74e-4abb-a658-a9a11af14f06.67b7cc68-bd89-4d10-af1c-fa4973ec4e82 1G" returned: 0 in 1.335s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c46bbbe1-f74e-4abb-a658-a9a11af14f06 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c46bbbe1-f74e-4abb-a658-a9a11af14f06.67b7cc68-bd89-4d10-af1c-fa4973ec4e82 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:02 devstack sudo[94565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c46bbbe1-f74e-4abb-a658-a9a11af14f06 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c46bbbe1-f74e-4abb-a658-a9a11af14f06.67b7cc68-bd89-4d10-af1c-fa4973ec4e82
Jul 03 01:10:02 devstack sudo[94565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:03 devstack sudo[94565]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c46bbbe1-f74e-4abb-a658-a9a11af14f06 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c46bbbe1-f74e-4abb-a658-a9a11af14f06.67b7cc68-bd89-4d10-af1c-fa4973ec4e82" returned: 0 in 1.015s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:03 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c46bbbe1-f74e-4abb-a658-a9a11af14f06.67b7cc68-bd89-4d10-af1c-fa4973ec4e82 is being set with open permissions: ugo+rw
Jul 03 01:10:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c46bbbe1-f74e-4abb-a658-a9a11af14f06.67b7cc68-bd89-4d10-af1c-fa4973ec4e82 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:03 devstack sudo[94572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c46bbbe1-f74e-4abb-a658-a9a11af14f06.67b7cc68-bd89-4d10-af1c-fa4973ec4e82
Jul 03 01:10:03 devstack sudo[94572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:04 devstack sudo[94572]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c46bbbe1-f74e-4abb-a658-a9a11af14f06.67b7cc68-bd89-4d10-af1c-fa4973ec4e82" returned: 0 in 0.905s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c46bbbe1-f74e-4abb-a658-a9a11af14f06.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:04 devstack sudo[94575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c46bbbe1-f74e-4abb-a658-a9a11af14f06.info
Jul 03 01:10:04 devstack sudo[94575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:05 devstack sudo[94575]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:05 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c46bbbe1-f74e-4abb-a658-a9a11af14f06.info" returned: 0 in 0.885s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:05 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c46bbbe1-f74e-4abb-a658-a9a11af14f06.info is being set with open permissions: ugo+rw
Jul 03 01:10:05 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c46bbbe1-f74e-4abb-a658-a9a11af14f06.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:05 devstack sudo[94581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c46bbbe1-f74e-4abb-a658-a9a11af14f06.info
Jul 03 01:10:05 devstack sudo[94581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:05 devstack sudo[94581]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:05 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c46bbbe1-f74e-4abb-a658-a9a11af14f06.info" returned: 0 in 0.773s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:05 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] Acquiring lock "cinder-quobyte-123add89-7770-48a6-9915-ec87f09727b2" by "_copy_volume_from_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:10:05 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] Lock "cinder-quobyte-123add89-7770-48a6-9915-ec87f09727b2" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:10:05 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] snapshot: 67b7cc68-bd89-4d10-af1c-fa4973ec4e82, volume: 123add89-7770-48a6-9915-ec87f09727b2,  {{(pid=86891) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 03 01:10:05 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:10:05 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:10:05 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:10:05 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:10:05 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:10:05 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-b4233dfb-a0fd-4376-bbeb-44243d6254e6 tempest-GroupSnapshotsV319Test-1280481491 None] Group tempest-GroupSnapshotsV319Test-Group-399428384: creating
Jul 03 01:10:05 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83ff173-daf5-43bd-9797-ef4bf66b8b2b]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:10:05 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c46bbbe1-f74e-4abb-a658-a9a11af14f06.67b7cc68-bd89-4d10-af1c-fa4973ec4e82 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:06 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-b4233dfb-a0fd-4376-bbeb-44243d6254e6 tempest-GroupSnapshotsV319Test-1280481491 None] Group tempest-GroupSnapshotsV319Test-Group-399428384: created successfully
Jul 03 01:10:06 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-b4233dfb-a0fd-4376-bbeb-44243d6254e6 tempest-GroupSnapshotsV319Test-1280481491 None] Create group completed successfully.
Jul 03 01:10:06 devstack sudo[94584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c46bbbe1-f74e-4abb-a658-a9a11af14f06.67b7cc68-bd89-4d10-af1c-fa4973ec4e82
Jul 03 01:10:06 devstack sudo[94584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:07 devstack sudo[94584]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:07 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c46bbbe1-f74e-4abb-a658-a9a11af14f06.67b7cc68-bd89-4d10-af1c-fa4973ec4e82" returned: 0 in 1.269s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:07 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c46bbbe1-f74e-4abb-a658-a9a11af14f06(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:10:07 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] will copy from snapshot at /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c46bbbe1-f74e-4abb-a658-a9a11af14f06 {{(pid=86891) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 03 01:10:07 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] Creating direct copy from snapshot {{(pid=86891) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 03 01:10:07 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f394cd0-a435-4283-982b-07e6db3ef27a]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:10:07 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c46bbbe1-f74e-4abb-a658-a9a11af14f06 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:07 devstack sudo[94630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c46bbbe1-f74e-4abb-a658-a9a11af14f06
Jul 03 01:10:07 devstack sudo[94630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:07 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab9bf1c1-aa6c-40e0-8ac3-59b75a49e65c tempest-GroupSnapshotsV319Test-1280481491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:10:07 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ab9bf1c1-aa6c-40e0-8ac3-59b75a49e65c tempest-GroupSnapshotsV319Test-1280481491 None] Flow 'volume_create_manager' (17179a04-c0cc-47e6-a1c4-cee64ee58e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:10:07 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ab9bf1c1-aa6c-40e0-8ac3-59b75a49e65c tempest-GroupSnapshotsV319Test-1280481491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (236b102e-6df6-4dac-b46f-e1c58d16b96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:10:07 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ab9bf1c1-aa6c-40e0-8ac3-59b75a49e65c tempest-GroupSnapshotsV319Test-1280481491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (236b102e-6df6-4dac-b46f-e1c58d16b96b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:10:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1652910532',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1630906a-5e58-44a9-b261-4fd65427b18d,host='devstack@QuobyteHD#QuobyteHD',id=783c0dbe-c54c-4f6e-a519-4fd7a271e2a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55a0b0b761694832a102285de6fb5303',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:10:08Z,use_quota=True,user_id='83e60e37ccf84504a4860ecba3b33bf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbb497c1-0e9d-4613-9849-00cb539a7fff),volume_type_id=bbb497c1-0e9d-4613-9849-00cb539a7fff)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:10:07 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ab9bf1c1-aa6c-40e0-8ac3-59b75a49e65c tempest-GroupSnapshotsV319Test-1280481491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbf48dde-72c7-4e45-add6-6abc6b149340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:10:07 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ab9bf1c1-aa6c-40e0-8ac3-59b75a49e65c tempest-GroupSnapshotsV319Test-1280481491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbf48dde-72c7-4e45-add6-6abc6b149340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:10:07 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ab9bf1c1-aa6c-40e0-8ac3-59b75a49e65c tempest-GroupSnapshotsV319Test-1280481491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (715e5bf0-a316-498a-945e-dedaf424b4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:10:07 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ab9bf1c1-aa6c-40e0-8ac3-59b75a49e65c tempest-GroupSnapshotsV319Test-1280481491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (715e5bf0-a316-498a-945e-dedaf424b4fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '783c0dbe-c54c-4f6e-a519-4fd7a271e2a2', 'volume_name': 'volume-783c0dbe-c54c-4f6e-a519-4fd7a271e2a2', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:10:07 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ab9bf1c1-aa6c-40e0-8ac3-59b75a49e65c tempest-GroupSnapshotsV319Test-1280481491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b48b652-cc6e-4e3c-9856-55372fd675be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:10:07 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ab9bf1c1-aa6c-40e0-8ac3-59b75a49e65c tempest-GroupSnapshotsV319Test-1280481491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b48b652-cc6e-4e3c-9856-55372fd675be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:10:07 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ab9bf1c1-aa6c-40e0-8ac3-59b75a49e65c tempest-GroupSnapshotsV319Test-1280481491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (572f04de-e58b-4a5e-82ee-06305fe40826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:10:07 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-ab9bf1c1-aa6c-40e0-8ac3-59b75a49e65c tempest-GroupSnapshotsV319Test-1280481491 None] Volume 783c0dbe-c54c-4f6e-a519-4fd7a271e2a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-783c0dbe-c54c-4f6e-a519-4fd7a271e2a2', 'volume_size': 1}
Jul 03 01:10:07 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-ab9bf1c1-aa6c-40e0-8ac3-59b75a49e65c tempest-GroupSnapshotsV319Test-1280481491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:10:08 devstack sudo[94630]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:08 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c46bbbe1-f74e-4abb-a658-a9a11af14f06" returned: 0 in 0.974s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:08 devstack cinder-volume[86891]: DEBUG cinder.utils [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] Path /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-123add89-7770-48a6-9915-ec87f09727b2 not found in is_blk_device check {{(pid=86891) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 03 01:10:08 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c46bbbe1-f74e-4abb-a658-a9a11af14f06 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-123add89-7770-48a6-9915-ec87f09727b2 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:08 devstack sudo[94638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c46bbbe1-f74e-4abb-a658-a9a11af14f06 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-123add89-7770-48a6-9915-ec87f09727b2
Jul 03 01:10:08 devstack sudo[94638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:13 devstack sudo[94638]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c46bbbe1-f74e-4abb-a658-a9a11af14f06 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-123add89-7770-48a6-9915-ec87f09727b2" returned: 0 in 5.398s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:13 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[44bb766f-35fd-4eab-beb6-1ad82585ad94]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:10:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c46bbbe1-f74e-4abb-a658-a9a11af14f06 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:13 devstack sudo[94681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c46bbbe1-f74e-4abb-a658-a9a11af14f06
Jul 03 01:10:13 devstack sudo[94681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:14 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-a0665433-1ac5-4dda-b6c9-4575932e20e8 tempest-AttachVolumeShelveTestJSON-910043292 None] Acquiring lock "cinder-181b12e8-2a9e-4505-ac72-e0a314177826-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:10:14 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-a0665433-1ac5-4dda-b6c9-4575932e20e8 tempest-AttachVolumeShelveTestJSON-910043292 None] Lock "cinder-181b12e8-2a9e-4505-ac72-e0a314177826-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:10:14 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-a0665433-1ac5-4dda-b6c9-4575932e20e8 tempest-AttachVolumeShelveTestJSON-910043292 None] Acquiring lock "cinder-quobyte-181b12e8-2a9e-4505-ac72-e0a314177826" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:10:14 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-a0665433-1ac5-4dda-b6c9-4575932e20e8 tempest-AttachVolumeShelveTestJSON-910043292 None] Lock "cinder-quobyte-181b12e8-2a9e-4505-ac72-e0a314177826" acquired by "delete_volume" :: waited 0.031s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:10:14 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac804113-a630-48b6-a1d1-49eba3e3aac9]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:10:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a0665433-1ac5-4dda-b6c9-4575932e20e8 tempest-AttachVolumeShelveTestJSON-910043292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-181b12e8-2a9e-4505-ac72-e0a314177826 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:14 devstack sudo[94681]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c46bbbe1-f74e-4abb-a658-a9a11af14f06" returned: 0 in 0.979s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:14 devstack cinder-volume[86891]: DEBUG cinder.image.image_utils [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] Image conversion details: src /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c46bbbe1-f74e-4abb-a658-a9a11af14f06, size 1024.00 MB, duration 5.40 sec, destination /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-123add89-7770-48a6-9915-ec87f09727b2 {{(pid=86891) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 03 01:10:14 devstack cinder-volume[86891]: INFO cinder.image.image_utils [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] Converted 1024.00 MB image at 189.65 MB/s
Jul 03 01:10:14 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-123add89-7770-48a6-9915-ec87f09727b2 is being set with open permissions: ugo+rw
Jul 03 01:10:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-123add89-7770-48a6-9915-ec87f09727b2 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:14 devstack sudo[94688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-123add89-7770-48a6-9915-ec87f09727b2
Jul 03 01:10:14 devstack sudo[94688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:14 devstack sudo[94687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-181b12e8-2a9e-4505-ac72-e0a314177826
Jul 03 01:10:14 devstack sudo[94687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:15 devstack sudo[94688]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-123add89-7770-48a6-9915-ec87f09727b2" returned: 0 in 0.622s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:15 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] Lock "cinder-quobyte-123add89-7770-48a6-9915-ec87f09727b2" released by "_copy_volume_from_snapshot" :: held 9.349s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:10:15 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] Acquiring lock "cinder-quobyte-67b7cc68-bd89-4d10-af1c-fa4973ec4e82" by "_delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:10:15 devstack sudo[94687]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a0665433-1ac5-4dda-b6c9-4575932e20e8 tempest-AttachVolumeShelveTestJSON-910043292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-181b12e8-2a9e-4505-ac72-e0a314177826" returned: 0 in 0.740s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a0665433-1ac5-4dda-b6c9-4575932e20e8 tempest-AttachVolumeShelveTestJSON-910043292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-181b12e8-2a9e-4505-ac72-e0a314177826 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:15 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] Lock "cinder-quobyte-67b7cc68-bd89-4d10-af1c-fa4973ec4e82" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:10:15 devstack sudo[94695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-181b12e8-2a9e-4505-ac72-e0a314177826
Jul 03 01:10:15 devstack sudo[94695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:15 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] Deleting offline snapshot 67b7cc68-bd89-4d10-af1c-fa4973ec4e82 of volume c46bbbe1-f74e-4abb-a658-a9a11af14f06 {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 01:10:15 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] snapshot_file for this snap is: volume-c46bbbe1-f74e-4abb-a658-a9a11af14f06.67b7cc68-bd89-4d10-af1c-fa4973ec4e82 {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 01:10:15 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5ec299-0183-4682-87e8-6c0cb21f7d5c]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:10:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c46bbbe1-f74e-4abb-a658-a9a11af14f06.67b7cc68-bd89-4d10-af1c-fa4973ec4e82 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:15 devstack sudo[94697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c46bbbe1-f74e-4abb-a658-a9a11af14f06.67b7cc68-bd89-4d10-af1c-fa4973ec4e82
Jul 03 01:10:15 devstack sudo[94697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:15 devstack sudo[94695]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a0665433-1ac5-4dda-b6c9-4575932e20e8 tempest-AttachVolumeShelveTestJSON-910043292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-181b12e8-2a9e-4505-ac72-e0a314177826" returned: 0 in 0.667s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:15 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-a0665433-1ac5-4dda-b6c9-4575932e20e8 tempest-AttachVolumeShelveTestJSON-910043292 None] Lock "cinder-quobyte-181b12e8-2a9e-4505-ac72-e0a314177826" released by "delete_volume" :: held 1.451s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:10:16 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-a0665433-1ac5-4dda-b6c9-4575932e20e8 tempest-AttachVolumeShelveTestJSON-910043292 None] Created reservations ['5785250a-8038-4adf-baf2-36b86eba296d', 'fb33a531-0324-43c4-b716-540c6d421cfe', 'c3ef715b-dd66-4fc7-be63-8a66794be02a', 'c93d5db6-c3ac-40cb-83e9-e36c136aa66d'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:10:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a0665433-1ac5-4dda-b6c9-4575932e20e8 tempest-AttachVolumeShelveTestJSON-910043292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:10:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a0665433-1ac5-4dda-b6c9-4575932e20e8 tempest-AttachVolumeShelveTestJSON-910043292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:10:16 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-a0665433-1ac5-4dda-b6c9-4575932e20e8 tempest-AttachVolumeShelveTestJSON-910043292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:10:16 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-a0665433-1ac5-4dda-b6c9-4575932e20e8 tempest-AttachVolumeShelveTestJSON-910043292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:10:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a0665433-1ac5-4dda-b6c9-4575932e20e8 tempest-AttachVolumeShelveTestJSON-910043292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:10:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a0665433-1ac5-4dda-b6c9-4575932e20e8 tempest-AttachVolumeShelveTestJSON-910043292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:16 devstack sudo[94697]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c46bbbe1-f74e-4abb-a658-a9a11af14f06.67b7cc68-bd89-4d10-af1c-fa4973ec4e82" returned: 0 in 0.794s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:16 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c46bbbe1-f74e-4abb-a658-a9a11af14f06(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:10:16 devstack sudo[94703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:10:16 devstack sudo[94703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:16 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6857798-fc2c-4e17-9dbf-98c66992618e]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:10:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c46bbbe1-f74e-4abb-a658-a9a11af14f06 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:16 devstack sudo[94705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c46bbbe1-f74e-4abb-a658-a9a11af14f06
Jul 03 01:10:16 devstack sudo[94705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:16 devstack sudo[94703]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a0665433-1ac5-4dda-b6c9-4575932e20e8 tempest-AttachVolumeShelveTestJSON-910043292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.693s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:16 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-a0665433-1ac5-4dda-b6c9-4575932e20e8 tempest-AttachVolumeShelveTestJSON-910043292 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:10:16 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-a0665433-1ac5-4dda-b6c9-4575932e20e8 tempest-AttachVolumeShelveTestJSON-910043292 None] Deleted volume successfully.
Jul 03 01:10:16 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-a0665433-1ac5-4dda-b6c9-4575932e20e8 tempest-AttachVolumeShelveTestJSON-910043292 None] Lock "cinder-181b12e8-2a9e-4505-ac72-e0a314177826-delete_volume" released by "delete_volume" :: held 2.434s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:10:17 devstack sudo[94705]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c46bbbe1-f74e-4abb-a658-a9a11af14f06" returned: 0 in 0.910s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c46bbbe1-f74e-4abb-a658-a9a11af14f06.67b7cc68-bd89-4d10-af1c-fa4973ec4e82 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:17 devstack sudo[94711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c46bbbe1-f74e-4abb-a658-a9a11af14f06.67b7cc68-bd89-4d10-af1c-fa4973ec4e82
Jul 03 01:10:17 devstack sudo[94711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:17 devstack sudo[94711]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c46bbbe1-f74e-4abb-a658-a9a11af14f06.67b7cc68-bd89-4d10-af1c-fa4973ec4e82" returned: 0 in 0.836s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c46bbbe1-f74e-4abb-a658-a9a11af14f06.67b7cc68-bd89-4d10-af1c-fa4973ec4e82 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:17 devstack sudo[94718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c46bbbe1-f74e-4abb-a658-a9a11af14f06.67b7cc68-bd89-4d10-af1c-fa4973ec4e82
Jul 03 01:10:17 devstack sudo[94718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:18 devstack sudo[94718]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c46bbbe1-f74e-4abb-a658-a9a11af14f06.67b7cc68-bd89-4d10-af1c-fa4973ec4e82" returned: 0 in 0.716s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:18 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] Lock "cinder-quobyte-67b7cc68-bd89-4d10-af1c-fa4973ec4e82" released by "_delete_snapshot" :: held 3.369s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:10:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.998s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:10:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-ab9bf1c1-aa6c-40e0-8ac3-59b75a49e65c tempest-GroupSnapshotsV319Test-1280481491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.754s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:10:18 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-ab9bf1c1-aa6c-40e0-8ac3-59b75a49e65c tempest-GroupSnapshotsV319Test-1280481491 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=1630906a-5e58-44a9-b261-4fd65427b18d,created_at=2026-07-02T23:10:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1652910532',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1630906a-5e58-44a9-b261-4fd65427b18d,host='devstack@QuobyteHD#QuobyteHD',id=783c0dbe-c54c-4f6e-a519-4fd7a271e2a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55a0b0b761694832a102285de6fb5303',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:10:08Z,use_quota=True,user_id='83e60e37ccf84504a4860ecba3b33bf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbb497c1-0e9d-4613-9849-00cb539a7fff),volume_type_id=bbb497c1-0e9d-4613-9849-00cb539a7fff)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:10:18 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-ab9bf1c1-aa6c-40e0-8ac3-59b75a49e65c tempest-GroupSnapshotsV319Test-1280481491 None] Creating volume 783c0dbe-c54c-4f6e-a519-4fd7a271e2a2 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:10:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-ab9bf1c1-aa6c-40e0-8ac3-59b75a49e65c tempest-GroupSnapshotsV319Test-1280481491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:10:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-ab9bf1c1-aa6c-40e0-8ac3-59b75a49e65c tempest-GroupSnapshotsV319Test-1280481491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:10:18 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-ab9bf1c1-aa6c-40e0-8ac3-59b75a49e65c tempest-GroupSnapshotsV319Test-1280481491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:10:18 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-ab9bf1c1-aa6c-40e0-8ac3-59b75a49e65c tempest-GroupSnapshotsV319Test-1280481491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:10:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-ab9bf1c1-aa6c-40e0-8ac3-59b75a49e65c tempest-GroupSnapshotsV319Test-1280481491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:10:18 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-ab9bf1c1-aa6c-40e0-8ac3-59b75a49e65c tempest-GroupSnapshotsV319Test-1280481491 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:10:18 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-ab9bf1c1-aa6c-40e0-8ac3-59b75a49e65c tempest-GroupSnapshotsV319Test-1280481491 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:10:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-ab9bf1c1-aa6c-40e0-8ac3-59b75a49e65c tempest-GroupSnapshotsV319Test-1280481491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-783c0dbe-c54c-4f6e-a519-4fd7a271e2a2 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3db4fef2-40cd-4763-babb-a37e02507e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-123add89-7770-48a6-9915-ec87f09727b2', 'volume_size': 1, 'source_volid': 'c46bbbe1-f74e-4abb-a658-a9a11af14f06', 'source_volstatus': 'available'}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:10:18 devstack sudo[94723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-783c0dbe-c54c-4f6e-a519-4fd7a271e2a2 1073741824
Jul 03 01:10:18 devstack sudo[94723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85307083-765b-476e-960a-f9b3a30d8fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:10:18 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] Volume volume-123add89-7770-48a6-9915-ec87f09727b2 (123add89-7770-48a6-9915-ec87f09727b2): created successfully
Jul 03 01:10:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85307083-765b-476e-960a-f9b3a30d8fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:10:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] Flow 'volume_create_manager' (8884ba1f-42c2-4a71-b247-d4952f7842d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:10:18 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-66fc96bb-7232-49a3-b909-9c1c47e988a2 tempest-VolumesGetTest-1596674288 None] Created volume successfully.
Jul 03 01:10:19 devstack sudo[94723]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:19 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-ab9bf1c1-aa6c-40e0-8ac3-59b75a49e65c tempest-GroupSnapshotsV319Test-1280481491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-783c0dbe-c54c-4f6e-a519-4fd7a271e2a2 1073741824" returned: 0 in 1.141s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:19 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c73f2f5-c336-435f-b435-c39c82f09cfc tempest-VolumesGetTest-1596674288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:10:19 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-9c73f2f5-c336-435f-b435-c39c82f09cfc tempest-VolumesGetTest-1596674288 None] Flow 'volume_create_manager' (32c67dd8-be54-48f4-9db0-3a6b0e4509ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:10:19 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-9c73f2f5-c336-435f-b435-c39c82f09cfc tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13e40a74-f109-4eb2-b87d-d1e8dfb33da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:10:19 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-ab9bf1c1-aa6c-40e0-8ac3-59b75a49e65c tempest-GroupSnapshotsV319Test-1280481491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-783c0dbe-c54c-4f6e-a519-4fd7a271e2a2 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:19 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-9c73f2f5-c336-435f-b435-c39c82f09cfc tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13e40a74-f109-4eb2-b87d-d1e8dfb33da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:10:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1051578435',display_name='tempest-VolumesGetTest-Volume-369801085',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=460b3c64-d8e5-4f2a-a168-b68958f74c46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='087effcc09294d31b1aa60c2a1ea3b65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:10:20Z,use_quota=True,user_id='6bacac4e0d924409b6e00e085cc5dc25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:10:19 devstack sudo[94730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-783c0dbe-c54c-4f6e-a519-4fd7a271e2a2
Jul 03 01:10:19 devstack sudo[94730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:19 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-9c73f2f5-c336-435f-b435-c39c82f09cfc tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6383870-8dc9-4aef-bf10-01335e0a28e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:10:19 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-9c73f2f5-c336-435f-b435-c39c82f09cfc tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6383870-8dc9-4aef-bf10-01335e0a28e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:10:19 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-9c73f2f5-c336-435f-b435-c39c82f09cfc tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9698f0e6-4393-45d0-abf8-6a10923256f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:10:20 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-9c73f2f5-c336-435f-b435-c39c82f09cfc tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9698f0e6-4393-45d0-abf8-6a10923256f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '460b3c64-d8e5-4f2a-a168-b68958f74c46', 'volume_name': 'volume-460b3c64-d8e5-4f2a-a168-b68958f74c46', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:10:20 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-9c73f2f5-c336-435f-b435-c39c82f09cfc tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acd40db5-fa7e-4c2a-9f2c-20c3907363a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:10:20 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-9c73f2f5-c336-435f-b435-c39c82f09cfc tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acd40db5-fa7e-4c2a-9f2c-20c3907363a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:10:20 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-9c73f2f5-c336-435f-b435-c39c82f09cfc tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (927bd9b9-11b8-4dfb-93e5-70c893314bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:10:20 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-9c73f2f5-c336-435f-b435-c39c82f09cfc tempest-VolumesGetTest-1596674288 None] Volume 460b3c64-d8e5-4f2a-a168-b68958f74c46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-460b3c64-d8e5-4f2a-a168-b68958f74c46', 'volume_size': 1}
Jul 03 01:10:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-9c73f2f5-c336-435f-b435-c39c82f09cfc tempest-VolumesGetTest-1596674288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:10:20 devstack sudo[94730]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-ab9bf1c1-aa6c-40e0-8ac3-59b75a49e65c tempest-GroupSnapshotsV319Test-1280481491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-783c0dbe-c54c-4f6e-a519-4fd7a271e2a2" returned: 0 in 0.660s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:20 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-ab9bf1c1-aa6c-40e0-8ac3-59b75a49e65c tempest-GroupSnapshotsV319Test-1280481491 None] <== create_volume: return (1896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:10:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-ab9bf1c1-aa6c-40e0-8ac3-59b75a49e65c tempest-GroupSnapshotsV319Test-1280481491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.899s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:10:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-9c73f2f5-c336-435f-b435-c39c82f09cfc tempest-VolumesGetTest-1596674288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.608s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:10:20 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-9c73f2f5-c336-435f-b435-c39c82f09cfc tempest-VolumesGetTest-1596674288 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:10:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1051578435',display_name='tempest-VolumesGetTest-Volume-369801085',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=460b3c64-d8e5-4f2a-a168-b68958f74c46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='087effcc09294d31b1aa60c2a1ea3b65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:10:20Z,use_quota=True,user_id='6bacac4e0d924409b6e00e085cc5dc25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:10:20 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-9c73f2f5-c336-435f-b435-c39c82f09cfc tempest-VolumesGetTest-1596674288 None] Creating volume 460b3c64-d8e5-4f2a-a168-b68958f74c46 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:10:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-9c73f2f5-c336-435f-b435-c39c82f09cfc tempest-VolumesGetTest-1596674288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:10:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-9c73f2f5-c336-435f-b435-c39c82f09cfc tempest-VolumesGetTest-1596674288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:10:20 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-9c73f2f5-c336-435f-b435-c39c82f09cfc tempest-VolumesGetTest-1596674288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:10:20 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-9c73f2f5-c336-435f-b435-c39c82f09cfc tempest-VolumesGetTest-1596674288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:10:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-9c73f2f5-c336-435f-b435-c39c82f09cfc tempest-VolumesGetTest-1596674288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:10:20 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-9c73f2f5-c336-435f-b435-c39c82f09cfc tempest-VolumesGetTest-1596674288 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:10:20 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-9c73f2f5-c336-435f-b435-c39c82f09cfc tempest-VolumesGetTest-1596674288 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:10:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9c73f2f5-c336-435f-b435-c39c82f09cfc tempest-VolumesGetTest-1596674288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-460b3c64-d8e5-4f2a-a168-b68958f74c46 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:20 devstack sudo[94735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-460b3c64-d8e5-4f2a-a168-b68958f74c46 1073741824
Jul 03 01:10:20 devstack sudo[94735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:20 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ab9bf1c1-aa6c-40e0-8ac3-59b75a49e65c tempest-GroupSnapshotsV319Test-1280481491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (572f04de-e58b-4a5e-82ee-06305fe40826) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-783c0dbe-c54c-4f6e-a519-4fd7a271e2a2', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:10:20 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ab9bf1c1-aa6c-40e0-8ac3-59b75a49e65c tempest-GroupSnapshotsV319Test-1280481491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e2b836f-2947-422c-b723-650302e0bb95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:10:20 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-ab9bf1c1-aa6c-40e0-8ac3-59b75a49e65c tempest-GroupSnapshotsV319Test-1280481491 None] Volume volume-783c0dbe-c54c-4f6e-a519-4fd7a271e2a2 (783c0dbe-c54c-4f6e-a519-4fd7a271e2a2): created successfully
Jul 03 01:10:20 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ab9bf1c1-aa6c-40e0-8ac3-59b75a49e65c tempest-GroupSnapshotsV319Test-1280481491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e2b836f-2947-422c-b723-650302e0bb95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:10:20 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ab9bf1c1-aa6c-40e0-8ac3-59b75a49e65c tempest-GroupSnapshotsV319Test-1280481491 None] Flow 'volume_create_manager' (17179a04-c0cc-47e6-a1c4-cee64ee58e58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:10:20 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-ab9bf1c1-aa6c-40e0-8ac3-59b75a49e65c tempest-GroupSnapshotsV319Test-1280481491 None] Created volume successfully.
Jul 03 01:10:21 devstack sudo[94735]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:21 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-c49c5df8-e4b5-46ad-a84a-298ae7de5947 tempest-GroupSnapshotsV319Test-1280481491 None] GroupSnapshot 89c211ff-b904-4507-84c7-9bab2e4f766c: creating.
Jul 03 01:10:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9c73f2f5-c336-435f-b435-c39c82f09cfc tempest-VolumesGetTest-1596674288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-460b3c64-d8e5-4f2a-a168-b68958f74c46 1073741824" returned: 0 in 1.038s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:21 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c49c5df8-e4b5-46ad-a84a-298ae7de5947 tempest-GroupSnapshotsV319Test-1280481491 None] Group snapshot 89c211ff-b904-4507-84c7-9bab2e4f766c: creating. {{(pid=86891) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 03 01:10:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-c49c5df8-e4b5-46ad-a84a-298ae7de5947 tempest-GroupSnapshotsV319Test-1280481491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:10:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9c73f2f5-c336-435f-b435-c39c82f09cfc tempest-VolumesGetTest-1596674288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-460b3c64-d8e5-4f2a-a168-b68958f74c46 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:21 devstack sudo[94756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-460b3c64-d8e5-4f2a-a168-b68958f74c46
Jul 03 01:10:21 devstack sudo[94756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:22 devstack sudo[94756]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:22 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9c73f2f5-c336-435f-b435-c39c82f09cfc tempest-VolumesGetTest-1596674288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-460b3c64-d8e5-4f2a-a168-b68958f74c46" returned: 0 in 0.730s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:22 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-9c73f2f5-c336-435f-b435-c39c82f09cfc tempest-VolumesGetTest-1596674288 None] <== create_volume: return (1827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:10:22 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-9c73f2f5-c336-435f-b435-c39c82f09cfc tempest-VolumesGetTest-1596674288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.831s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:10:22 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-c49c5df8-e4b5-46ad-a84a-298ae7de5947 tempest-GroupSnapshotsV319Test-1280481491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.744s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:10:22 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-9c73f2f5-c336-435f-b435-c39c82f09cfc tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (927bd9b9-11b8-4dfb-93e5-70c893314bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-460b3c64-d8e5-4f2a-a168-b68958f74c46', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:10:22 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-9c73f2f5-c336-435f-b435-c39c82f09cfc tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acf0cc2f-3524-480f-a326-415c9e9139c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:10:22 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-c49c5df8-e4b5-46ad-a84a-298ae7de5947 tempest-GroupSnapshotsV319Test-1280481491 None] Creating offline snapshot 876e9a5d-148d-409c-a25f-0ef7fbaedea8 of volume 783c0dbe-c54c-4f6e-a519-4fd7a271e2a2 {{(pid=86891) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 01:10:22 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-9c73f2f5-c336-435f-b435-c39c82f09cfc tempest-VolumesGetTest-1596674288 None] Volume volume-460b3c64-d8e5-4f2a-a168-b68958f74c46 (460b3c64-d8e5-4f2a-a168-b68958f74c46): created successfully
Jul 03 01:10:22 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-9c73f2f5-c336-435f-b435-c39c82f09cfc tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acf0cc2f-3524-480f-a326-415c9e9139c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:10:22 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-9c73f2f5-c336-435f-b435-c39c82f09cfc tempest-VolumesGetTest-1596674288 None] Flow 'volume_create_manager' (32c67dd8-be54-48f4-9db0-3a6b0e4509ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:10:22 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[02094113-9df4-4bf2-a151-3d97f34a50de]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:10:22 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c49c5df8-e4b5-46ad-a84a-298ae7de5947 tempest-GroupSnapshotsV319Test-1280481491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-783c0dbe-c54c-4f6e-a519-4fd7a271e2a2 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:22 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-9c73f2f5-c336-435f-b435-c39c82f09cfc tempest-VolumesGetTest-1596674288 None] Created volume successfully.
Jul 03 01:10:22 devstack sudo[94781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-783c0dbe-c54c-4f6e-a519-4fd7a271e2a2
Jul 03 01:10:22 devstack sudo[94781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:23 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-98d42a3b-16fc-46eb-a123-42f34187b3f4 tempest-VolumesGetTest-1596674288 None] Acquiring lock "cinder-460b3c64-d8e5-4f2a-a168-b68958f74c46-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:10:23 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-98d42a3b-16fc-46eb-a123-42f34187b3f4 tempest-VolumesGetTest-1596674288 None] Lock "cinder-460b3c64-d8e5-4f2a-a168-b68958f74c46-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:10:23 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-98d42a3b-16fc-46eb-a123-42f34187b3f4 tempest-VolumesGetTest-1596674288 None] Acquiring lock "cinder-quobyte-460b3c64-d8e5-4f2a-a168-b68958f74c46" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:10:23 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-98d42a3b-16fc-46eb-a123-42f34187b3f4 tempest-VolumesGetTest-1596674288 None] Lock "cinder-quobyte-460b3c64-d8e5-4f2a-a168-b68958f74c46" acquired by "delete_volume" :: waited 0.021s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:10:23 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8fa9025-7e5c-4d7a-9b68-5758fdf30c8e]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:10:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-98d42a3b-16fc-46eb-a123-42f34187b3f4 tempest-VolumesGetTest-1596674288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-460b3c64-d8e5-4f2a-a168-b68958f74c46 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:23 devstack sudo[94781]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c49c5df8-e4b5-46ad-a84a-298ae7de5947 tempest-GroupSnapshotsV319Test-1280481491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-783c0dbe-c54c-4f6e-a519-4fd7a271e2a2" returned: 0 in 0.919s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c49c5df8-e4b5-46ad-a84a-298ae7de5947 tempest-GroupSnapshotsV319Test-1280481491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-783c0dbe-c54c-4f6e-a519-4fd7a271e2a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-783c0dbe-c54c-4f6e-a519-4fd7a271e2a2.876e9a5d-148d-409c-a25f-0ef7fbaedea8 1G {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:23 devstack sudo[94789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-783c0dbe-c54c-4f6e-a519-4fd7a271e2a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-783c0dbe-c54c-4f6e-a519-4fd7a271e2a2.876e9a5d-148d-409c-a25f-0ef7fbaedea8 1G
Jul 03 01:10:23 devstack sudo[94789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:23 devstack sudo[94788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-460b3c64-d8e5-4f2a-a168-b68958f74c46
Jul 03 01:10:23 devstack sudo[94788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:23 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-459cc7b8-5e15-4dd3-bee9-2bbb3284bae4 tempest-AttachVolumeNegativeTest-1781307442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:10:23 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-459cc7b8-5e15-4dd3-bee9-2bbb3284bae4 tempest-AttachVolumeNegativeTest-1781307442 None] Flow 'volume_create_manager' (a1a8ed15-a5c6-485c-9145-35cd5bf6c1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:10:23 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-459cc7b8-5e15-4dd3-bee9-2bbb3284bae4 tempest-AttachVolumeNegativeTest-1781307442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff6daabb-2541-4aa7-9068-032650a3b8e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:10:23 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-459cc7b8-5e15-4dd3-bee9-2bbb3284bae4 tempest-AttachVolumeNegativeTest-1781307442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff6daabb-2541-4aa7-9068-032650a3b8e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:10:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1610904655',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b139c6e-e277-4edc-85af-ebc3321ed3a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3348d2c85ae7402095c009310a1f3caa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:10:24Z,use_quota=True,user_id='aa6ba53dbdc145fba5e7c650aea77566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:10:23 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-459cc7b8-5e15-4dd3-bee9-2bbb3284bae4 tempest-AttachVolumeNegativeTest-1781307442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce239dca-7455-4103-a175-a4d450e6858f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:10:23 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-459cc7b8-5e15-4dd3-bee9-2bbb3284bae4 tempest-AttachVolumeNegativeTest-1781307442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce239dca-7455-4103-a175-a4d450e6858f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:10:23 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-459cc7b8-5e15-4dd3-bee9-2bbb3284bae4 tempest-AttachVolumeNegativeTest-1781307442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38b6da4c-c49c-4e59-983a-563bfdbf4d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:10:23 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-459cc7b8-5e15-4dd3-bee9-2bbb3284bae4 tempest-AttachVolumeNegativeTest-1781307442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38b6da4c-c49c-4e59-983a-563bfdbf4d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b139c6e-e277-4edc-85af-ebc3321ed3a1', 'volume_name': 'volume-8b139c6e-e277-4edc-85af-ebc3321ed3a1', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:10:23 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-459cc7b8-5e15-4dd3-bee9-2bbb3284bae4 tempest-AttachVolumeNegativeTest-1781307442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bb34932-a632-4288-a4b9-1f813747857f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:10:23 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-459cc7b8-5e15-4dd3-bee9-2bbb3284bae4 tempest-AttachVolumeNegativeTest-1781307442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bb34932-a632-4288-a4b9-1f813747857f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:10:23 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-459cc7b8-5e15-4dd3-bee9-2bbb3284bae4 tempest-AttachVolumeNegativeTest-1781307442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59be1413-0518-41b9-b3ca-8b4ab5bf1631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:10:23 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-459cc7b8-5e15-4dd3-bee9-2bbb3284bae4 tempest-AttachVolumeNegativeTest-1781307442 None] Volume 8b139c6e-e277-4edc-85af-ebc3321ed3a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b139c6e-e277-4edc-85af-ebc3321ed3a1', 'volume_size': 1}
Jul 03 01:10:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-459cc7b8-5e15-4dd3-bee9-2bbb3284bae4 tempest-AttachVolumeNegativeTest-1781307442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:10:24 devstack sudo[94788]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-98d42a3b-16fc-46eb-a123-42f34187b3f4 tempest-VolumesGetTest-1596674288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-460b3c64-d8e5-4f2a-a168-b68958f74c46" returned: 0 in 0.819s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-98d42a3b-16fc-46eb-a123-42f34187b3f4 tempest-VolumesGetTest-1596674288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-460b3c64-d8e5-4f2a-a168-b68958f74c46 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:24 devstack sudo[94798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-460b3c64-d8e5-4f2a-a168-b68958f74c46
Jul 03 01:10:24 devstack sudo[94798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:24 devstack sudo[94789]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c49c5df8-e4b5-46ad-a84a-298ae7de5947 tempest-GroupSnapshotsV319Test-1280481491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-783c0dbe-c54c-4f6e-a519-4fd7a271e2a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-783c0dbe-c54c-4f6e-a519-4fd7a271e2a2.876e9a5d-148d-409c-a25f-0ef7fbaedea8 1G" returned: 0 in 0.952s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c49c5df8-e4b5-46ad-a84a-298ae7de5947 tempest-GroupSnapshotsV319Test-1280481491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-783c0dbe-c54c-4f6e-a519-4fd7a271e2a2 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-783c0dbe-c54c-4f6e-a519-4fd7a271e2a2.876e9a5d-148d-409c-a25f-0ef7fbaedea8 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:24 devstack sudo[94801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-783c0dbe-c54c-4f6e-a519-4fd7a271e2a2 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-783c0dbe-c54c-4f6e-a519-4fd7a271e2a2.876e9a5d-148d-409c-a25f-0ef7fbaedea8
Jul 03 01:10:24 devstack sudo[94801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:24 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [req-afd62924-3387-47c5-8a37-eb2e3d465d09 req-a921ecba-9073-4368-b4ca-bcc836efac53 tempest-VolumesGetTestJSON-888132944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:10:24 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [req-afd62924-3387-47c5-8a37-eb2e3d465d09 req-a921ecba-9073-4368-b4ca-bcc836efac53 tempest-VolumesGetTestJSON-888132944 None] Flow 'volume_create_manager' (a18e03ac-612e-461c-9dea-3984245fd687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:10:24 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [req-afd62924-3387-47c5-8a37-eb2e3d465d09 req-a921ecba-9073-4368-b4ca-bcc836efac53 tempest-VolumesGetTestJSON-888132944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (178e3fe8-3f38-4b71-b8de-c14d85ada4ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:10:24 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [req-afd62924-3387-47c5-8a37-eb2e3d465d09 req-a921ecba-9073-4368-b4ca-bcc836efac53 tempest-VolumesGetTestJSON-888132944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (178e3fe8-3f38-4b71-b8de-c14d85ada4ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1424602551',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcdc1d52-8b57-44a7-a567-29dd99b0cb4f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a43ba8db366148aba16f97e1e317a774',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:10:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:10:25Z,use_quota=True,user_id='bc2304e861c341c7aa69d26333d5ef04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:10:24 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [req-afd62924-3387-47c5-8a37-eb2e3d465d09 req-a921ecba-9073-4368-b4ca-bcc836efac53 tempest-VolumesGetTestJSON-888132944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e11069e9-c373-463d-9392-f886b328013d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:10:24 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [req-afd62924-3387-47c5-8a37-eb2e3d465d09 req-a921ecba-9073-4368-b4ca-bcc836efac53 tempest-VolumesGetTestJSON-888132944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e11069e9-c373-463d-9392-f886b328013d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:10:24 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [req-afd62924-3387-47c5-8a37-eb2e3d465d09 req-a921ecba-9073-4368-b4ca-bcc836efac53 tempest-VolumesGetTestJSON-888132944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83a4328a-e493-498a-9043-1d442e501d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:10:24 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [req-afd62924-3387-47c5-8a37-eb2e3d465d09 req-a921ecba-9073-4368-b4ca-bcc836efac53 tempest-VolumesGetTestJSON-888132944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83a4328a-e493-498a-9043-1d442e501d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcdc1d52-8b57-44a7-a567-29dd99b0cb4f', 'volume_name': 'volume-fcdc1d52-8b57-44a7-a567-29dd99b0cb4f', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:10:24 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [req-afd62924-3387-47c5-8a37-eb2e3d465d09 req-a921ecba-9073-4368-b4ca-bcc836efac53 tempest-VolumesGetTestJSON-888132944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (149d5b10-3a4a-442b-b4df-6af8b21923b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:10:24 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [req-afd62924-3387-47c5-8a37-eb2e3d465d09 req-a921ecba-9073-4368-b4ca-bcc836efac53 tempest-VolumesGetTestJSON-888132944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (149d5b10-3a4a-442b-b4df-6af8b21923b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:10:24 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [req-afd62924-3387-47c5-8a37-eb2e3d465d09 req-a921ecba-9073-4368-b4ca-bcc836efac53 tempest-VolumesGetTestJSON-888132944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec38bd9f-69cb-489b-97b3-6fb1953f99f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:10:24 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [req-afd62924-3387-47c5-8a37-eb2e3d465d09 req-a921ecba-9073-4368-b4ca-bcc836efac53 tempest-VolumesGetTestJSON-888132944 None] Volume fcdc1d52-8b57-44a7-a567-29dd99b0cb4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcdc1d52-8b57-44a7-a567-29dd99b0cb4f', 'volume_size': 1}
Jul 03 01:10:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-afd62924-3387-47c5-8a37-eb2e3d465d09 req-a921ecba-9073-4368-b4ca-bcc836efac53 tempest-VolumesGetTestJSON-888132944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:10:24 devstack sudo[94798]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-98d42a3b-16fc-46eb-a123-42f34187b3f4 tempest-VolumesGetTest-1596674288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-460b3c64-d8e5-4f2a-a168-b68958f74c46" returned: 0 in 0.787s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:24 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-98d42a3b-16fc-46eb-a123-42f34187b3f4 tempest-VolumesGetTest-1596674288 None] Lock "cinder-quobyte-460b3c64-d8e5-4f2a-a168-b68958f74c46" released by "delete_volume" :: held 1.655s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:10:25 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-98d42a3b-16fc-46eb-a123-42f34187b3f4 tempest-VolumesGetTest-1596674288 None] Created reservations ['5df2c158-7e28-49fe-9877-fb5e3283d0d5', '51291916-29fe-4650-8ad2-9eda9b136ded', 'd67e5042-b803-4097-95b6-ba25f773164e', 'bf380fdc-34bc-492d-a6cf-169af1d3172d'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:10:25 devstack sudo[94801]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c49c5df8-e4b5-46ad-a84a-298ae7de5947 tempest-GroupSnapshotsV319Test-1280481491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-783c0dbe-c54c-4f6e-a519-4fd7a271e2a2 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-783c0dbe-c54c-4f6e-a519-4fd7a271e2a2.876e9a5d-148d-409c-a25f-0ef7fbaedea8" returned: 0 in 0.708s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:25 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-c49c5df8-e4b5-46ad-a84a-298ae7de5947 tempest-GroupSnapshotsV319Test-1280481491 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-783c0dbe-c54c-4f6e-a519-4fd7a271e2a2.876e9a5d-148d-409c-a25f-0ef7fbaedea8 is being set with open permissions: ugo+rw: NotImplementedError
Jul 03 01:10:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c49c5df8-e4b5-46ad-a84a-298ae7de5947 tempest-GroupSnapshotsV319Test-1280481491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-783c0dbe-c54c-4f6e-a519-4fd7a271e2a2.876e9a5d-148d-409c-a25f-0ef7fbaedea8 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-98d42a3b-16fc-46eb-a123-42f34187b3f4 tempest-VolumesGetTest-1596674288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:10:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-98d42a3b-16fc-46eb-a123-42f34187b3f4 tempest-VolumesGetTest-1596674288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:10:25 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-98d42a3b-16fc-46eb-a123-42f34187b3f4 tempest-VolumesGetTest-1596674288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:10:25 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-98d42a3b-16fc-46eb-a123-42f34187b3f4 tempest-VolumesGetTest-1596674288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:10:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-98d42a3b-16fc-46eb-a123-42f34187b3f4 tempest-VolumesGetTest-1596674288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:10:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-98d42a3b-16fc-46eb-a123-42f34187b3f4 tempest-VolumesGetTest-1596674288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:25 devstack sudo[94808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-783c0dbe-c54c-4f6e-a519-4fd7a271e2a2.876e9a5d-148d-409c-a25f-0ef7fbaedea8
Jul 03 01:10:25 devstack sudo[94808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:25 devstack sudo[94810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:10:25 devstack sudo[94810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:25 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-9bdfec7c-e7f5-4514-b226-2bcf28120fe9 tempest-VolumesGetTest-1596674288 None] Acquiring lock "cinder-123add89-7770-48a6-9915-ec87f09727b2-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:10:25 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-9bdfec7c-e7f5-4514-b226-2bcf28120fe9 tempest-VolumesGetTest-1596674288 None] Lock "cinder-123add89-7770-48a6-9915-ec87f09727b2-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:10:25 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-9bdfec7c-e7f5-4514-b226-2bcf28120fe9 tempest-VolumesGetTest-1596674288 None] Acquiring lock "cinder-quobyte-123add89-7770-48a6-9915-ec87f09727b2" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:10:25 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-9bdfec7c-e7f5-4514-b226-2bcf28120fe9 tempest-VolumesGetTest-1596674288 None] Lock "cinder-quobyte-123add89-7770-48a6-9915-ec87f09727b2" acquired by "delete_volume" :: waited 0.016s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:10:25 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38a9315-c5a8-421a-be26-ab32502b2ca2]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:10:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9bdfec7c-e7f5-4514-b226-2bcf28120fe9 tempest-VolumesGetTest-1596674288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-123add89-7770-48a6-9915-ec87f09727b2 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:25 devstack sudo[94808]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c49c5df8-e4b5-46ad-a84a-298ae7de5947 tempest-GroupSnapshotsV319Test-1280481491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-783c0dbe-c54c-4f6e-a519-4fd7a271e2a2.876e9a5d-148d-409c-a25f-0ef7fbaedea8" returned: 0 in 0.703s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:25 devstack sudo[94810]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-98d42a3b-16fc-46eb-a123-42f34187b3f4 tempest-VolumesGetTest-1596674288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.711s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:25 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-98d42a3b-16fc-46eb-a123-42f34187b3f4 tempest-VolumesGetTest-1596674288 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:10:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c49c5df8-e4b5-46ad-a84a-298ae7de5947 tempest-GroupSnapshotsV319Test-1280481491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-783c0dbe-c54c-4f6e-a519-4fd7a271e2a2.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:25 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-98d42a3b-16fc-46eb-a123-42f34187b3f4 tempest-VolumesGetTest-1596674288 None] Deleted volume successfully.
Jul 03 01:10:25 devstack sudo[94815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-783c0dbe-c54c-4f6e-a519-4fd7a271e2a2.info
Jul 03 01:10:25 devstack sudo[94815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:25 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-98d42a3b-16fc-46eb-a123-42f34187b3f4 tempest-VolumesGetTest-1596674288 None] Lock "cinder-460b3c64-d8e5-4f2a-a168-b68958f74c46-delete_volume" released by "delete_volume" :: held 2.620s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:10:25 devstack sudo[94814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-123add89-7770-48a6-9915-ec87f09727b2
Jul 03 01:10:25 devstack sudo[94814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:26 devstack sudo[94815]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:26 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c49c5df8-e4b5-46ad-a84a-298ae7de5947 tempest-GroupSnapshotsV319Test-1280481491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-783c0dbe-c54c-4f6e-a519-4fd7a271e2a2.info" returned: 0 in 0.647s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:26 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-c49c5df8-e4b5-46ad-a84a-298ae7de5947 tempest-GroupSnapshotsV319Test-1280481491 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-783c0dbe-c54c-4f6e-a519-4fd7a271e2a2.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 03 01:10:26 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c49c5df8-e4b5-46ad-a84a-298ae7de5947 tempest-GroupSnapshotsV319Test-1280481491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-783c0dbe-c54c-4f6e-a519-4fd7a271e2a2.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:26 devstack sudo[94822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-783c0dbe-c54c-4f6e-a519-4fd7a271e2a2.info
Jul 03 01:10:26 devstack sudo[94814]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:26 devstack sudo[94822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:26 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9bdfec7c-e7f5-4514-b226-2bcf28120fe9 tempest-VolumesGetTest-1596674288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-123add89-7770-48a6-9915-ec87f09727b2" returned: 0 in 0.757s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:26 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9bdfec7c-e7f5-4514-b226-2bcf28120fe9 tempest-VolumesGetTest-1596674288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-123add89-7770-48a6-9915-ec87f09727b2 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:26 devstack sudo[94824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-123add89-7770-48a6-9915-ec87f09727b2
Jul 03 01:10:26 devstack sudo[94824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:27 devstack sudo[94822]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c49c5df8-e4b5-46ad-a84a-298ae7de5947 tempest-GroupSnapshotsV319Test-1280481491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-783c0dbe-c54c-4f6e-a519-4fd7a271e2a2.info" returned: 0 in 0.643s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-c49c5df8-e4b5-46ad-a84a-298ae7de5947 tempest-GroupSnapshotsV319Test-1280481491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.692s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:10:27 devstack sudo[94824]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-459cc7b8-5e15-4dd3-bee9-2bbb3284bae4 tempest-AttachVolumeNegativeTest-1781307442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.502s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:10:27 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-459cc7b8-5e15-4dd3-bee9-2bbb3284bae4 tempest-AttachVolumeNegativeTest-1781307442 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:10:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1610904655',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b139c6e-e277-4edc-85af-ebc3321ed3a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3348d2c85ae7402095c009310a1f3caa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:10:24Z,use_quota=True,user_id='aa6ba53dbdc145fba5e7c650aea77566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:10:27 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-459cc7b8-5e15-4dd3-bee9-2bbb3284bae4 tempest-AttachVolumeNegativeTest-1781307442 None] Creating volume 8b139c6e-e277-4edc-85af-ebc3321ed3a1 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:10:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-459cc7b8-5e15-4dd3-bee9-2bbb3284bae4 tempest-AttachVolumeNegativeTest-1781307442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:10:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-459cc7b8-5e15-4dd3-bee9-2bbb3284bae4 tempest-AttachVolumeNegativeTest-1781307442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:10:27 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-459cc7b8-5e15-4dd3-bee9-2bbb3284bae4 tempest-AttachVolumeNegativeTest-1781307442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:10:27 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-459cc7b8-5e15-4dd3-bee9-2bbb3284bae4 tempest-AttachVolumeNegativeTest-1781307442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:10:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-459cc7b8-5e15-4dd3-bee9-2bbb3284bae4 tempest-AttachVolumeNegativeTest-1781307442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:10:27 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-459cc7b8-5e15-4dd3-bee9-2bbb3284bae4 tempest-AttachVolumeNegativeTest-1781307442 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:10:27 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-459cc7b8-5e15-4dd3-bee9-2bbb3284bae4 tempest-AttachVolumeNegativeTest-1781307442 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:10:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-459cc7b8-5e15-4dd3-bee9-2bbb3284bae4 tempest-AttachVolumeNegativeTest-1781307442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b139c6e-e277-4edc-85af-ebc3321ed3a1 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9bdfec7c-e7f5-4514-b226-2bcf28120fe9 tempest-VolumesGetTest-1596674288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-123add89-7770-48a6-9915-ec87f09727b2" returned: 0 in 0.650s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:27 devstack sudo[94828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b139c6e-e277-4edc-85af-ebc3321ed3a1 1073741824
Jul 03 01:10:27 devstack sudo[94828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:27 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-9bdfec7c-e7f5-4514-b226-2bcf28120fe9 tempest-VolumesGetTest-1596674288 None] Lock "cinder-quobyte-123add89-7770-48a6-9915-ec87f09727b2" released by "delete_volume" :: held 1.462s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:10:27 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-9bdfec7c-e7f5-4514-b226-2bcf28120fe9 tempest-VolumesGetTest-1596674288 None] Created reservations ['383b274d-aee8-464e-a7e4-bb2c5f93abfd', '73bd609a-9304-435f-891b-9e9d2f299405', 'd44979f3-c6ef-42c9-abfc-ce4716e74e60', '459af2b5-1849-4588-9d27-996369bcd142'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:10:27 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-c49c5df8-e4b5-46ad-a84a-298ae7de5947 tempest-GroupSnapshotsV319Test-1280481491 None] group_snapshot 89c211ff-b904-4507-84c7-9bab2e4f766c: created successfully
Jul 03 01:10:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-9bdfec7c-e7f5-4514-b226-2bcf28120fe9 tempest-VolumesGetTest-1596674288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:10:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-9bdfec7c-e7f5-4514-b226-2bcf28120fe9 tempest-VolumesGetTest-1596674288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:10:27 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-9bdfec7c-e7f5-4514-b226-2bcf28120fe9 tempest-VolumesGetTest-1596674288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:10:27 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-9bdfec7c-e7f5-4514-b226-2bcf28120fe9 tempest-VolumesGetTest-1596674288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:10:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-9bdfec7c-e7f5-4514-b226-2bcf28120fe9 tempest-VolumesGetTest-1596674288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:10:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9bdfec7c-e7f5-4514-b226-2bcf28120fe9 tempest-VolumesGetTest-1596674288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:27 devstack sudo[94830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:10:27 devstack sudo[94830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:27 devstack sudo[94830]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9bdfec7c-e7f5-4514-b226-2bcf28120fe9 tempest-VolumesGetTest-1596674288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.646s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:27 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-9bdfec7c-e7f5-4514-b226-2bcf28120fe9 tempest-VolumesGetTest-1596674288 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:10:27 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-9bdfec7c-e7f5-4514-b226-2bcf28120fe9 tempest-VolumesGetTest-1596674288 None] Deleted volume successfully.
Jul 03 01:10:28 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-be16750c-bb8a-403e-af39-c39c0b04f589 tempest-VolumesGetTest-1596674288 None] Acquiring lock "cinder-c46bbbe1-f74e-4abb-a658-a9a11af14f06-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:10:28 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-9bdfec7c-e7f5-4514-b226-2bcf28120fe9 tempest-VolumesGetTest-1596674288 None] Lock "cinder-123add89-7770-48a6-9915-ec87f09727b2-delete_volume" released by "delete_volume" :: held 2.369s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:10:28 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-be16750c-bb8a-403e-af39-c39c0b04f589 tempest-VolumesGetTest-1596674288 None] Lock "cinder-c46bbbe1-f74e-4abb-a658-a9a11af14f06-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:10:28 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-be16750c-bb8a-403e-af39-c39c0b04f589 tempest-VolumesGetTest-1596674288 None] Acquiring lock "cinder-quobyte-c46bbbe1-f74e-4abb-a658-a9a11af14f06" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:10:28 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-be16750c-bb8a-403e-af39-c39c0b04f589 tempest-VolumesGetTest-1596674288 None] Lock "cinder-quobyte-c46bbbe1-f74e-4abb-a658-a9a11af14f06" acquired by "delete_volume" :: waited 0.018s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:10:28 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcab3016-5aff-4cbe-9f76-56306878d654]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:10:28 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-be16750c-bb8a-403e-af39-c39c0b04f589 tempest-VolumesGetTest-1596674288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c46bbbe1-f74e-4abb-a658-a9a11af14f06 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:28 devstack sudo[94828]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:28 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-459cc7b8-5e15-4dd3-bee9-2bbb3284bae4 tempest-AttachVolumeNegativeTest-1781307442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b139c6e-e277-4edc-85af-ebc3321ed3a1 1073741824" returned: 0 in 1.040s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:28 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-459cc7b8-5e15-4dd3-bee9-2bbb3284bae4 tempest-AttachVolumeNegativeTest-1781307442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b139c6e-e277-4edc-85af-ebc3321ed3a1 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:28 devstack sudo[94839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b139c6e-e277-4edc-85af-ebc3321ed3a1
Jul 03 01:10:28 devstack sudo[94839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:28 devstack sudo[94838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c46bbbe1-f74e-4abb-a658-a9a11af14f06
Jul 03 01:10:28 devstack sudo[94838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:28 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-1eb8fa6b-6094-4a63-a492-0864cb3a5c7c tempest-GroupSnapshotsV319Test-1280481491 None] group_snapshot 89c211ff-b904-4507-84c7-9bab2e4f766c: deleting
Jul 03 01:10:28 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1eb8fa6b-6094-4a63-a492-0864cb3a5c7c tempest-GroupSnapshotsV319Test-1280481491 None] group_snapshot 89c211ff-b904-4507-84c7-9bab2e4f766c: deleting {{(pid=86891) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 03 01:10:28 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-1eb8fa6b-6094-4a63-a492-0864cb3a5c7c tempest-GroupSnapshotsV319Test-1280481491 None] Acquiring lock "cinder-quobyte-783c0dbe-c54c-4f6e-a519-4fd7a271e2a2" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:10:28 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-1eb8fa6b-6094-4a63-a492-0864cb3a5c7c tempest-GroupSnapshotsV319Test-1280481491 None] Lock "cinder-quobyte-783c0dbe-c54c-4f6e-a519-4fd7a271e2a2" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:10:28 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-1eb8fa6b-6094-4a63-a492-0864cb3a5c7c tempest-GroupSnapshotsV319Test-1280481491 None] Acquiring lock "cinder-quobyte-876e9a5d-148d-409c-a25f-0ef7fbaedea8" by "_delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:10:28 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-1eb8fa6b-6094-4a63-a492-0864cb3a5c7c tempest-GroupSnapshotsV319Test-1280481491 None] Lock "cinder-quobyte-876e9a5d-148d-409c-a25f-0ef7fbaedea8" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:10:28 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-1eb8fa6b-6094-4a63-a492-0864cb3a5c7c tempest-GroupSnapshotsV319Test-1280481491 None] Deleting offline snapshot 876e9a5d-148d-409c-a25f-0ef7fbaedea8 of volume 783c0dbe-c54c-4f6e-a519-4fd7a271e2a2 {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 01:10:28 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-1eb8fa6b-6094-4a63-a492-0864cb3a5c7c tempest-GroupSnapshotsV319Test-1280481491 None] snapshot_file for this snap is: volume-783c0dbe-c54c-4f6e-a519-4fd7a271e2a2.876e9a5d-148d-409c-a25f-0ef7fbaedea8 {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 01:10:28 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[b41bee97-aa5d-4e7b-b557-633d0a497635]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:10:28 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1eb8fa6b-6094-4a63-a492-0864cb3a5c7c tempest-GroupSnapshotsV319Test-1280481491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-783c0dbe-c54c-4f6e-a519-4fd7a271e2a2.876e9a5d-148d-409c-a25f-0ef7fbaedea8 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:28 devstack sudo[94842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-783c0dbe-c54c-4f6e-a519-4fd7a271e2a2.876e9a5d-148d-409c-a25f-0ef7fbaedea8
Jul 03 01:10:28 devstack sudo[94842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:28 devstack sudo[94839]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:28 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-459cc7b8-5e15-4dd3-bee9-2bbb3284bae4 tempest-AttachVolumeNegativeTest-1781307442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b139c6e-e277-4edc-85af-ebc3321ed3a1" returned: 0 in 0.726s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:28 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-459cc7b8-5e15-4dd3-bee9-2bbb3284bae4 tempest-AttachVolumeNegativeTest-1781307442 None] <== create_volume: return (1806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:10:28 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-459cc7b8-5e15-4dd3-bee9-2bbb3284bae4 tempest-AttachVolumeNegativeTest-1781307442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.811s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:10:28 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-afd62924-3387-47c5-8a37-eb2e3d465d09 req-a921ecba-9073-4368-b4ca-bcc836efac53 tempest-VolumesGetTestJSON-888132944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.247s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:10:28 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [req-afd62924-3387-47c5-8a37-eb2e3d465d09 req-a921ecba-9073-4368-b4ca-bcc836efac53 tempest-VolumesGetTestJSON-888132944 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1424602551',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcdc1d52-8b57-44a7-a567-29dd99b0cb4f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a43ba8db366148aba16f97e1e317a774',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:10:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:10:25Z,use_quota=True,user_id='bc2304e861c341c7aa69d26333d5ef04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:10:28 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [req-afd62924-3387-47c5-8a37-eb2e3d465d09 req-a921ecba-9073-4368-b4ca-bcc836efac53 tempest-VolumesGetTestJSON-888132944 None] Creating volume fcdc1d52-8b57-44a7-a567-29dd99b0cb4f {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:10:28 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-afd62924-3387-47c5-8a37-eb2e3d465d09 req-a921ecba-9073-4368-b4ca-bcc836efac53 tempest-VolumesGetTestJSON-888132944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:10:28 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-afd62924-3387-47c5-8a37-eb2e3d465d09 req-a921ecba-9073-4368-b4ca-bcc836efac53 tempest-VolumesGetTestJSON-888132944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:10:28 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [req-afd62924-3387-47c5-8a37-eb2e3d465d09 req-a921ecba-9073-4368-b4ca-bcc836efac53 tempest-VolumesGetTestJSON-888132944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:10:28 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [req-afd62924-3387-47c5-8a37-eb2e3d465d09 req-a921ecba-9073-4368-b4ca-bcc836efac53 tempest-VolumesGetTestJSON-888132944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:10:28 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-afd62924-3387-47c5-8a37-eb2e3d465d09 req-a921ecba-9073-4368-b4ca-bcc836efac53 tempest-VolumesGetTestJSON-888132944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:10:28 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [req-afd62924-3387-47c5-8a37-eb2e3d465d09 req-a921ecba-9073-4368-b4ca-bcc836efac53 tempest-VolumesGetTestJSON-888132944 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:10:28 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [req-afd62924-3387-47c5-8a37-eb2e3d465d09 req-a921ecba-9073-4368-b4ca-bcc836efac53 tempest-VolumesGetTestJSON-888132944 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:10:28 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-afd62924-3387-47c5-8a37-eb2e3d465d09 req-a921ecba-9073-4368-b4ca-bcc836efac53 tempest-VolumesGetTestJSON-888132944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-fcdc1d52-8b57-44a7-a567-29dd99b0cb4f 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:29 devstack sudo[94849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-fcdc1d52-8b57-44a7-a567-29dd99b0cb4f 1073741824
Jul 03 01:10:29 devstack sudo[94838]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:29 devstack sudo[94849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:29 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-459cc7b8-5e15-4dd3-bee9-2bbb3284bae4 tempest-AttachVolumeNegativeTest-1781307442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59be1413-0518-41b9-b3ca-8b4ab5bf1631) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b139c6e-e277-4edc-85af-ebc3321ed3a1', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:10:29 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-459cc7b8-5e15-4dd3-bee9-2bbb3284bae4 tempest-AttachVolumeNegativeTest-1781307442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcead3b3-83a1-4e08-839e-28f9bc457330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:10:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-be16750c-bb8a-403e-af39-c39c0b04f589 tempest-VolumesGetTest-1596674288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c46bbbe1-f74e-4abb-a658-a9a11af14f06" returned: 0 in 0.886s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-be16750c-bb8a-403e-af39-c39c0b04f589 tempest-VolumesGetTest-1596674288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c46bbbe1-f74e-4abb-a658-a9a11af14f06 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:29 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-459cc7b8-5e15-4dd3-bee9-2bbb3284bae4 tempest-AttachVolumeNegativeTest-1781307442 None] Volume volume-8b139c6e-e277-4edc-85af-ebc3321ed3a1 (8b139c6e-e277-4edc-85af-ebc3321ed3a1): created successfully
Jul 03 01:10:29 devstack sudo[94851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c46bbbe1-f74e-4abb-a658-a9a11af14f06
Jul 03 01:10:29 devstack sudo[94851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:29 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-459cc7b8-5e15-4dd3-bee9-2bbb3284bae4 tempest-AttachVolumeNegativeTest-1781307442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcead3b3-83a1-4e08-839e-28f9bc457330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:10:29 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-459cc7b8-5e15-4dd3-bee9-2bbb3284bae4 tempest-AttachVolumeNegativeTest-1781307442 None] Flow 'volume_create_manager' (a1a8ed15-a5c6-485c-9145-35cd5bf6c1fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:10:29 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-459cc7b8-5e15-4dd3-bee9-2bbb3284bae4 tempest-AttachVolumeNegativeTest-1781307442 None] Created volume successfully.
Jul 03 01:10:29 devstack sudo[94842]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1eb8fa6b-6094-4a63-a492-0864cb3a5c7c tempest-GroupSnapshotsV319Test-1280481491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-783c0dbe-c54c-4f6e-a519-4fd7a271e2a2.876e9a5d-148d-409c-a25f-0ef7fbaedea8" returned: 0 in 0.856s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:29 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-1eb8fa6b-6094-4a63-a492-0864cb3a5c7c tempest-GroupSnapshotsV319Test-1280481491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-783c0dbe-c54c-4f6e-a519-4fd7a271e2a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:10:29 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52c7e8d-98ff-46cd-be45-d4a7d5a946ae]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:10:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1eb8fa6b-6094-4a63-a492-0864cb3a5c7c tempest-GroupSnapshotsV319Test-1280481491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-783c0dbe-c54c-4f6e-a519-4fd7a271e2a2 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:29 devstack sudo[94856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-783c0dbe-c54c-4f6e-a519-4fd7a271e2a2
Jul 03 01:10:29 devstack sudo[94856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:29 devstack sudo[94851]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-be16750c-bb8a-403e-af39-c39c0b04f589 tempest-VolumesGetTest-1596674288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c46bbbe1-f74e-4abb-a658-a9a11af14f06" returned: 0 in 0.681s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:29 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-be16750c-bb8a-403e-af39-c39c0b04f589 tempest-VolumesGetTest-1596674288 None] Lock "cinder-quobyte-c46bbbe1-f74e-4abb-a658-a9a11af14f06" released by "delete_volume" :: held 1.645s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:10:29 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-be16750c-bb8a-403e-af39-c39c0b04f589 tempest-VolumesGetTest-1596674288 None] Created reservations ['e0e1785a-5d17-4673-b29f-d6447ce5d01b', 'd0c8564e-7da0-47ba-861a-8efb2fa36394', 'f2a2abce-61da-4c7d-8d6f-9a6aa9512404', '3498ccc4-573c-4a48-ac69-fa6721d775f8'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:10:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-be16750c-bb8a-403e-af39-c39c0b04f589 tempest-VolumesGetTest-1596674288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:10:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-be16750c-bb8a-403e-af39-c39c0b04f589 tempest-VolumesGetTest-1596674288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:10:29 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-be16750c-bb8a-403e-af39-c39c0b04f589 tempest-VolumesGetTest-1596674288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:10:29 devstack sudo[94849]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:29 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-be16750c-bb8a-403e-af39-c39c0b04f589 tempest-VolumesGetTest-1596674288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:10:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-be16750c-bb8a-403e-af39-c39c0b04f589 tempest-VolumesGetTest-1596674288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:10:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-be16750c-bb8a-403e-af39-c39c0b04f589 tempest-VolumesGetTest-1596674288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-afd62924-3387-47c5-8a37-eb2e3d465d09 req-a921ecba-9073-4368-b4ca-bcc836efac53 tempest-VolumesGetTestJSON-888132944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-fcdc1d52-8b57-44a7-a567-29dd99b0cb4f 1073741824" returned: 0 in 0.917s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:29 devstack sudo[94862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:10:29 devstack sudo[94862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-afd62924-3387-47c5-8a37-eb2e3d465d09 req-a921ecba-9073-4368-b4ca-bcc836efac53 tempest-VolumesGetTestJSON-888132944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-fcdc1d52-8b57-44a7-a567-29dd99b0cb4f {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:29 devstack sudo[94864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-fcdc1d52-8b57-44a7-a567-29dd99b0cb4f
Jul 03 01:10:29 devstack sudo[94864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:30 devstack sudo[94856]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1eb8fa6b-6094-4a63-a492-0864cb3a5c7c tempest-GroupSnapshotsV319Test-1280481491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-783c0dbe-c54c-4f6e-a519-4fd7a271e2a2" returned: 0 in 0.927s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1eb8fa6b-6094-4a63-a492-0864cb3a5c7c tempest-GroupSnapshotsV319Test-1280481491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-783c0dbe-c54c-4f6e-a519-4fd7a271e2a2.876e9a5d-148d-409c-a25f-0ef7fbaedea8 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:30 devstack sudo[94874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-783c0dbe-c54c-4f6e-a519-4fd7a271e2a2.876e9a5d-148d-409c-a25f-0ef7fbaedea8
Jul 03 01:10:30 devstack sudo[94874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:30 devstack sudo[94862]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-be16750c-bb8a-403e-af39-c39c0b04f589 tempest-VolumesGetTest-1596674288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.815s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:30 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-be16750c-bb8a-403e-af39-c39c0b04f589 tempest-VolumesGetTest-1596674288 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:10:30 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-be16750c-bb8a-403e-af39-c39c0b04f589 tempest-VolumesGetTest-1596674288 None] Deleted volume successfully.
Jul 03 01:10:30 devstack sudo[94864]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:30 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-be16750c-bb8a-403e-af39-c39c0b04f589 tempest-VolumesGetTest-1596674288 None] Lock "cinder-c46bbbe1-f74e-4abb-a658-a9a11af14f06-delete_volume" released by "delete_volume" :: held 2.721s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:10:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-afd62924-3387-47c5-8a37-eb2e3d465d09 req-a921ecba-9073-4368-b4ca-bcc836efac53 tempest-VolumesGetTestJSON-888132944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-fcdc1d52-8b57-44a7-a567-29dd99b0cb4f" returned: 0 in 0.801s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:30 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [req-afd62924-3387-47c5-8a37-eb2e3d465d09 req-a921ecba-9073-4368-b4ca-bcc836efac53 tempest-VolumesGetTestJSON-888132944 None] <== create_volume: return (1783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:10:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-afd62924-3387-47c5-8a37-eb2e3d465d09 req-a921ecba-9073-4368-b4ca-bcc836efac53 tempest-VolumesGetTestJSON-888132944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.788s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:10:30 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [req-afd62924-3387-47c5-8a37-eb2e3d465d09 req-a921ecba-9073-4368-b4ca-bcc836efac53 tempest-VolumesGetTestJSON-888132944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec38bd9f-69cb-489b-97b3-6fb1953f99f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcdc1d52-8b57-44a7-a567-29dd99b0cb4f', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:10:30 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [req-afd62924-3387-47c5-8a37-eb2e3d465d09 req-a921ecba-9073-4368-b4ca-bcc836efac53 tempest-VolumesGetTestJSON-888132944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5b6a988-f95c-48dc-a35f-f07ccb9b5955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:10:30 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [req-afd62924-3387-47c5-8a37-eb2e3d465d09 req-a921ecba-9073-4368-b4ca-bcc836efac53 tempest-VolumesGetTestJSON-888132944 None] Volume volume-fcdc1d52-8b57-44a7-a567-29dd99b0cb4f (fcdc1d52-8b57-44a7-a567-29dd99b0cb4f): created successfully
Jul 03 01:10:30 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [req-afd62924-3387-47c5-8a37-eb2e3d465d09 req-a921ecba-9073-4368-b4ca-bcc836efac53 tempest-VolumesGetTestJSON-888132944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5b6a988-f95c-48dc-a35f-f07ccb9b5955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:10:30 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [req-afd62924-3387-47c5-8a37-eb2e3d465d09 req-a921ecba-9073-4368-b4ca-bcc836efac53 tempest-VolumesGetTestJSON-888132944 None] Flow 'volume_create_manager' (a18e03ac-612e-461c-9dea-3984245fd687) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:10:30 devstack cinder-volume[86891]: INFO cinder.volume.manager [req-afd62924-3387-47c5-8a37-eb2e3d465d09 req-a921ecba-9073-4368-b4ca-bcc836efac53 tempest-VolumesGetTestJSON-888132944 None] Created volume successfully.
Jul 03 01:10:31 devstack sudo[94874]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:31 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1eb8fa6b-6094-4a63-a492-0864cb3a5c7c tempest-GroupSnapshotsV319Test-1280481491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-783c0dbe-c54c-4f6e-a519-4fd7a271e2a2.876e9a5d-148d-409c-a25f-0ef7fbaedea8" returned: 0 in 0.859s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:31 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1eb8fa6b-6094-4a63-a492-0864cb3a5c7c tempest-GroupSnapshotsV319Test-1280481491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-783c0dbe-c54c-4f6e-a519-4fd7a271e2a2.876e9a5d-148d-409c-a25f-0ef7fbaedea8 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:31 devstack sudo[94881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-783c0dbe-c54c-4f6e-a519-4fd7a271e2a2.876e9a5d-148d-409c-a25f-0ef7fbaedea8
Jul 03 01:10:31 devstack sudo[94881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:31 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-95100c26-4c79-4df5-a126-f556ddbd23ac tempest-VolumesGetTest-1596674288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:10:31 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-95100c26-4c79-4df5-a126-f556ddbd23ac tempest-VolumesGetTest-1596674288 None] Flow 'volume_create_manager' (41bd3a08-0407-4cf7-9255-cb3aae87b2a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:10:31 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-95100c26-4c79-4df5-a126-f556ddbd23ac tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40628830-9418-45b8-9765-bee5c027af85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:10:31 devstack cinder-volume[86891]: DEBUG cinder.coordination [req-311b7e4d-1756-4688-a960-2227f953ba9f req-fdbdff4c-074c-4f72-a062-e8a979819e6e tempest-VolumesGetTestJSON-888132944 None] Acquiring lock "cinder-fcdc1d52-8b57-44a7-a567-29dd99b0cb4f-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:10:31 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-95100c26-4c79-4df5-a126-f556ddbd23ac tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40628830-9418-45b8-9765-bee5c027af85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:10:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2077620200',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=262811a6-edbd-4071-8662-9ffc3d761029,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='087effcc09294d31b1aa60c2a1ea3b65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:10:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:10:31Z,use_quota=True,user_id='6bacac4e0d924409b6e00e085cc5dc25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:10:31 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-95100c26-4c79-4df5-a126-f556ddbd23ac tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba05a323-f340-4649-8bd1-eeeda1f175ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:10:31 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-95100c26-4c79-4df5-a126-f556ddbd23ac tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba05a323-f340-4649-8bd1-eeeda1f175ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:10:31 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-95100c26-4c79-4df5-a126-f556ddbd23ac tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f04e8cb3-f8e7-4785-8bde-50c34bdbca48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:10:31 devstack cinder-volume[86891]: DEBUG cinder.image.glance [None req-95100c26-4c79-4df5-a126-f556ddbd23ac tempest-VolumesGetTest-1596674288 None] Creating Keystone auth plugin from conf {{(pid=86891) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 03 01:10:31 devstack cinder-volume[86891]: DEBUG cinder.coordination [req-311b7e4d-1756-4688-a960-2227f953ba9f req-fdbdff4c-074c-4f72-a062-e8a979819e6e tempest-VolumesGetTestJSON-888132944 None] Lock "cinder-fcdc1d52-8b57-44a7-a567-29dd99b0cb4f-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:10:31 devstack cinder-volume[86891]: DEBUG cinder.coordination [req-311b7e4d-1756-4688-a960-2227f953ba9f req-fdbdff4c-074c-4f72-a062-e8a979819e6e tempest-VolumesGetTestJSON-888132944 None] Acquiring lock "cinder-quobyte-fcdc1d52-8b57-44a7-a567-29dd99b0cb4f" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:10:31 devstack cinder-volume[86891]: DEBUG cinder.coordination [req-311b7e4d-1756-4688-a960-2227f953ba9f req-fdbdff4c-074c-4f72-a062-e8a979819e6e tempest-VolumesGetTestJSON-888132944 None] Lock "cinder-quobyte-fcdc1d52-8b57-44a7-a567-29dd99b0cb4f" acquired by "delete_volume" :: waited 0.017s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:10:31 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa7f898-edf0-4bfc-bb2f-4b73047e1685]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:10:31 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-311b7e4d-1756-4688-a960-2227f953ba9f req-fdbdff4c-074c-4f72-a062-e8a979819e6e tempest-VolumesGetTestJSON-888132944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-fcdc1d52-8b57-44a7-a567-29dd99b0cb4f {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:31 devstack sudo[94883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-fcdc1d52-8b57-44a7-a567-29dd99b0cb4f
Jul 03 01:10:31 devstack sudo[94883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:31 devstack sudo[94881]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:32 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-95100c26-4c79-4df5-a126-f556ddbd23ac tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f04e8cb3-f8e7-4785-8bde-50c34bdbca48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '262811a6-edbd-4071-8662-9ffc3d761029', 'volume_name': 'volume-262811a6-edbd-4071-8662-9ffc3d761029', 'volume_size': 1, 'image_id': '65cceacb-879b-4111-919c-966899666f55', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/65cceacb-879b-4111-919c-966899666f55', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0d33e5361cf145ffa2791b827e46aea8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '65cceacb-879b-4111-919c-966899666f55', 'created_at': datetime.datetime(2026, 7, 2, 22, 57, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 22, 57, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/65cceacb-879b-4111-919c-966899666f55/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7c5b35182b10>}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:10:32 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-95100c26-4c79-4df5-a126-f556ddbd23ac tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42c4784b-2397-4a55-9956-cec4a24d3bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:10:32 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-95100c26-4c79-4df5-a126-f556ddbd23ac tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42c4784b-2397-4a55-9956-cec4a24d3bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:10:32 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-95100c26-4c79-4df5-a126-f556ddbd23ac tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad7c8572-69cf-4fc9-81b1-8edfb592fd5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:10:32 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-95100c26-4c79-4df5-a126-f556ddbd23ac tempest-VolumesGetTest-1596674288 None] Volume 262811a6-edbd-4071-8662-9ffc3d761029: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-262811a6-edbd-4071-8662-9ffc3d761029', 'volume_size': 1, 'image_id': '65cceacb-879b-4111-919c-966899666f55', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/65cceacb-879b-4111-919c-966899666f55', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0d33e5361cf145ffa2791b827e46aea8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '65cceacb-879b-4111-919c-966899666f55', 'created_at': datetime.datetime(2026, 7, 2, 22, 57, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 22, 57, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/65cceacb-879b-4111-919c-966899666f55/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7c5b35182b10>}
Jul 03 01:10:32 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-95100c26-4c79-4df5-a126-f556ddbd23ac tempest-VolumesGetTest-1596674288 None] Trying to clone 262811a6-edbd-4071-8662-9ffc3d761029 from image 65cceacb-879b-4111-919c-966899666f55 at location (None, [{'url': 'file:///opt/stack/data/glance/images/65cceacb-879b-4111-919c-966899666f55', 'metadata': {}}]). {{(pid=86891) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 03 01:10:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1eb8fa6b-6094-4a63-a492-0864cb3a5c7c tempest-GroupSnapshotsV319Test-1280481491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-783c0dbe-c54c-4f6e-a519-4fd7a271e2a2.876e9a5d-148d-409c-a25f-0ef7fbaedea8" returned: 0 in 0.752s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:32 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-1eb8fa6b-6094-4a63-a492-0864cb3a5c7c tempest-GroupSnapshotsV319Test-1280481491 None] Lock "cinder-quobyte-876e9a5d-148d-409c-a25f-0ef7fbaedea8" released by "_delete_snapshot" :: held 3.515s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:10:32 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-1eb8fa6b-6094-4a63-a492-0864cb3a5c7c tempest-GroupSnapshotsV319Test-1280481491 None] Lock "cinder-quobyte-783c0dbe-c54c-4f6e-a519-4fd7a271e2a2" released by "delete_snapshot" :: held 3.541s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:10:32 devstack cinder-volume[86891]: WARNING cinder.quota [None req-1eb8fa6b-6094-4a63-a492-0864cb3a5c7c tempest-GroupSnapshotsV319Test-1280481491 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-111559349 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-111559349, it is now deprecated. Please use the default quota class for default quota.
Jul 03 01:10:32 devstack cinder-volume[86891]: WARNING cinder.quota [None req-1eb8fa6b-6094-4a63-a492-0864cb3a5c7c tempest-GroupSnapshotsV319Test-1280481491 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-111559349 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-111559349, it is now deprecated. Please use the default quota class for default quota.
Jul 03 01:10:32 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-1eb8fa6b-6094-4a63-a492-0864cb3a5c7c tempest-GroupSnapshotsV319Test-1280481491 None] Created reservations ['d092f82f-4416-43d9-a0f1-94a46c8ba515', '89d57da4-d8b7-4196-b8a0-8f8eaaf5539c', '229a6ea8-507b-4501-8b45-5878b7005417', '163c9147-8d16-43df-afaf-e2137c1ed1a5'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:10:32 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-1eb8fa6b-6094-4a63-a492-0864cb3a5c7c tempest-GroupSnapshotsV319Test-1280481491 None] group_snapshot 89c211ff-b904-4507-84c7-9bab2e4f766c: deleted successfully
Jul 03 01:10:32 devstack cinder-volume[86891]: DEBUG cinder.image.image_utils [None req-95100c26-4c79-4df5-a126-f556ddbd23ac tempest-VolumesGetTest-1596674288 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_65cceacb-879b-4111-919c-966899666f55_4eve5hgtdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86891) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 03 01:10:32 devstack cinder-volume[86891]: INFO cinder.image.image_utils [None req-95100c26-4c79-4df5-a126-f556ddbd23ac tempest-VolumesGetTest-1596674288 None] Image download 20.69 MB at 20.69 MB/s
Jul 03 01:10:32 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[054167d0-51bf-4eb9-8571-c6b0e6dc0776]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:10:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-95100c26-4c79-4df5-a126-f556ddbd23ac tempest-VolumesGetTest-1596674288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_65cceacb-879b-4111-919c-966899666f55_4eve5hgtdevstack@QuobyteHD {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:32 devstack sudo[94910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_65cceacb-879b-4111-919c-966899666f55_4eve5hgtdevstack@QuobyteHD
Jul 03 01:10:32 devstack sudo[94910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:32 devstack sudo[94883]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-311b7e4d-1756-4688-a960-2227f953ba9f req-fdbdff4c-074c-4f72-a062-e8a979819e6e tempest-VolumesGetTestJSON-888132944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-fcdc1d52-8b57-44a7-a567-29dd99b0cb4f" returned: 0 in 1.018s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-311b7e4d-1756-4688-a960-2227f953ba9f req-fdbdff4c-074c-4f72-a062-e8a979819e6e tempest-VolumesGetTestJSON-888132944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-fcdc1d52-8b57-44a7-a567-29dd99b0cb4f {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:32 devstack sudo[94913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-fcdc1d52-8b57-44a7-a567-29dd99b0cb4f
Jul 03 01:10:32 devstack sudo[94913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:33 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d9588afc-7caf-43f1-87e4-e044ffdd7e1e tempest-GroupSnapshotsV319Test-1280481491 None] Acquiring lock "cinder-quobyte-783c0dbe-c54c-4f6e-a519-4fd7a271e2a2" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:10:33 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d9588afc-7caf-43f1-87e4-e044ffdd7e1e tempest-GroupSnapshotsV319Test-1280481491 None] Lock "cinder-quobyte-783c0dbe-c54c-4f6e-a519-4fd7a271e2a2" acquired by "delete_volume" :: waited 0.033s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:10:33 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[af887453-eb20-4b67-930a-ed787417603e]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:10:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d9588afc-7caf-43f1-87e4-e044ffdd7e1e tempest-GroupSnapshotsV319Test-1280481491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-783c0dbe-c54c-4f6e-a519-4fd7a271e2a2 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-35adb320-247c-4395-a943-8e03d295ad32 req-9d16080b-7880-4f99-85bd-8cce06a71fe4 tempest-AttachVolumeNegativeTest-1781307442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:10:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-35adb320-247c-4395-a943-8e03d295ad32 req-9d16080b-7880-4f99-85bd-8cce06a71fe4 tempest-AttachVolumeNegativeTest-1781307442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:10:33 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf64186-d351-4a0c-bfb6-e5575f8a7e50]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:10:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-35adb320-247c-4395-a943-8e03d295ad32 req-9d16080b-7880-4f99-85bd-8cce06a71fe4 tempest-AttachVolumeNegativeTest-1781307442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b139c6e-e277-4edc-85af-ebc3321ed3a1 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:33 devstack sudo[94910]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-95100c26-4c79-4df5-a126-f556ddbd23ac tempest-VolumesGetTest-1596674288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_65cceacb-879b-4111-919c-966899666f55_4eve5hgtdevstack@QuobyteHD" returned: 0 in 0.863s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:33 devstack cinder-volume[86891]: DEBUG cinder.image.image_utils [None req-95100c26-4c79-4df5-a126-f556ddbd23ac tempest-VolumesGetTest-1596674288 None] Temporary image 65cceacb-879b-4111-919c-966899666f55 is fetched for user 6bacac4e0d924409b6e00e085cc5dc25. {{(pid=86891) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 03 01:10:33 devstack sudo[94926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-783c0dbe-c54c-4f6e-a519-4fd7a271e2a2
Jul 03 01:10:33 devstack sudo[94926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:33 devstack sudo[94927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b139c6e-e277-4edc-85af-ebc3321ed3a1
Jul 03 01:10:33 devstack sudo[94927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:33 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[5003ee6e-1ac3-4999-af75-f766ccc7bcdf]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:10:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-95100c26-4c79-4df5-a126-f556ddbd23ac tempest-VolumesGetTest-1596674288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_65cceacb-879b-4111-919c-966899666f55_4eve5hgtdevstack@QuobyteHD {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:33 devstack sudo[94913]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-311b7e4d-1756-4688-a960-2227f953ba9f req-fdbdff4c-074c-4f72-a062-e8a979819e6e tempest-VolumesGetTestJSON-888132944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-fcdc1d52-8b57-44a7-a567-29dd99b0cb4f" returned: 0 in 0.838s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:33 devstack cinder-volume[86891]: DEBUG cinder.coordination [req-311b7e4d-1756-4688-a960-2227f953ba9f req-fdbdff4c-074c-4f72-a062-e8a979819e6e tempest-VolumesGetTestJSON-888132944 None] Lock "cinder-quobyte-fcdc1d52-8b57-44a7-a567-29dd99b0cb4f" released by "delete_volume" :: held 1.903s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:10:33 devstack cinder-volume[86891]: DEBUG cinder.quota [req-311b7e4d-1756-4688-a960-2227f953ba9f req-fdbdff4c-074c-4f72-a062-e8a979819e6e tempest-VolumesGetTestJSON-888132944 None] Created reservations ['148d8888-48de-4c1f-b603-a659ecbf393b', '8d44a8a1-8ae5-41f1-bee9-24dc6ffbf8f3', '1ce66d63-1120-4eab-a1eb-f7259460c2e7', 'aa2885ef-2cf5-4fc7-b935-c465b05a7907'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:10:33 devstack sudo[94931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_65cceacb-879b-4111-919c-966899666f55_4eve5hgtdevstack@QuobyteHD
Jul 03 01:10:33 devstack sudo[94931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-311b7e4d-1756-4688-a960-2227f953ba9f req-fdbdff4c-074c-4f72-a062-e8a979819e6e tempest-VolumesGetTestJSON-888132944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:10:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-311b7e4d-1756-4688-a960-2227f953ba9f req-fdbdff4c-074c-4f72-a062-e8a979819e6e tempest-VolumesGetTestJSON-888132944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:10:33 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [req-311b7e4d-1756-4688-a960-2227f953ba9f req-fdbdff4c-074c-4f72-a062-e8a979819e6e tempest-VolumesGetTestJSON-888132944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:10:33 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [req-311b7e4d-1756-4688-a960-2227f953ba9f req-fdbdff4c-074c-4f72-a062-e8a979819e6e tempest-VolumesGetTestJSON-888132944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:10:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-311b7e4d-1756-4688-a960-2227f953ba9f req-fdbdff4c-074c-4f72-a062-e8a979819e6e tempest-VolumesGetTestJSON-888132944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:10:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-311b7e4d-1756-4688-a960-2227f953ba9f req-fdbdff4c-074c-4f72-a062-e8a979819e6e tempest-VolumesGetTestJSON-888132944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:33 devstack sudo[94933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:10:33 devstack sudo[94933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:34 devstack sudo[94927]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-35adb320-247c-4395-a943-8e03d295ad32 req-9d16080b-7880-4f99-85bd-8cce06a71fe4 tempest-AttachVolumeNegativeTest-1781307442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b139c6e-e277-4edc-85af-ebc3321ed3a1" returned: 0 in 0.971s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-35adb320-247c-4395-a943-8e03d295ad32 req-9d16080b-7880-4f99-85bd-8cce06a71fe4 tempest-AttachVolumeNegativeTest-1781307442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.989s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:10:34 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [req-35adb320-247c-4395-a943-8e03d295ad32 req-9d16080b-7880-4f99-85bd-8cce06a71fe4 tempest-AttachVolumeNegativeTest-1781307442 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3', 'name': 'volume-8b139c6e-e277-4edc-85af-ebc3321ed3a1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9918fc20-6f4b-4489-8581-03e0cd9bdf31', 'enforce_multipath': True} {{(pid=86891) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 01:10:34 devstack cinder-volume[86891]: INFO cinder.volume.manager [req-35adb320-247c-4395-a943-8e03d295ad32 req-9d16080b-7880-4f99-85bd-8cce06a71fe4 tempest-AttachVolumeNegativeTest-1781307442 None] attachment_update completed successfully.
Jul 03 01:10:34 devstack sudo[94926]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d9588afc-7caf-43f1-87e4-e044ffdd7e1e tempest-GroupSnapshotsV319Test-1280481491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-783c0dbe-c54c-4f6e-a519-4fd7a271e2a2" returned: 0 in 1.253s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d9588afc-7caf-43f1-87e4-e044ffdd7e1e tempest-GroupSnapshotsV319Test-1280481491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-783c0dbe-c54c-4f6e-a519-4fd7a271e2a2 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:34 devstack sudo[94933]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-311b7e4d-1756-4688-a960-2227f953ba9f req-fdbdff4c-074c-4f72-a062-e8a979819e6e tempest-VolumesGetTestJSON-888132944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.863s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:34 devstack cinder-volume[86891]: DEBUG cinder.manager [req-311b7e4d-1756-4688-a960-2227f953ba9f req-fdbdff4c-074c-4f72-a062-e8a979819e6e tempest-VolumesGetTestJSON-888132944 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:10:34 devstack cinder-volume[86891]: INFO cinder.volume.manager [req-311b7e4d-1756-4688-a960-2227f953ba9f req-fdbdff4c-074c-4f72-a062-e8a979819e6e tempest-VolumesGetTestJSON-888132944 None] Deleted volume successfully.
Jul 03 01:10:34 devstack sudo[94946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-783c0dbe-c54c-4f6e-a519-4fd7a271e2a2
Jul 03 01:10:34 devstack sudo[94946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:34 devstack cinder-volume[86891]: DEBUG cinder.coordination [req-311b7e4d-1756-4688-a960-2227f953ba9f req-fdbdff4c-074c-4f72-a062-e8a979819e6e tempest-VolumesGetTestJSON-888132944 None] Lock "cinder-fcdc1d52-8b57-44a7-a567-29dd99b0cb4f-delete_volume" released by "delete_volume" :: held 3.043s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:10:34 devstack sudo[94931]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-95100c26-4c79-4df5-a126-f556ddbd23ac tempest-VolumesGetTest-1596674288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_65cceacb-879b-4111-919c-966899666f55_4eve5hgtdevstack@QuobyteHD" returned: 0 in 1.134s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-95100c26-4c79-4df5-a126-f556ddbd23ac tempest-VolumesGetTest-1596674288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:10:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-95100c26-4c79-4df5-a126-f556ddbd23ac tempest-VolumesGetTest-1596674288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:10:34 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-95100c26-4c79-4df5-a126-f556ddbd23ac tempest-VolumesGetTest-1596674288 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:10:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2077620200',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=262811a6-edbd-4071-8662-9ffc3d761029,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='087effcc09294d31b1aa60c2a1ea3b65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:10:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:10:31Z,use_quota=True,user_id='6bacac4e0d924409b6e00e085cc5dc25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:10:34 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-95100c26-4c79-4df5-a126-f556ddbd23ac tempest-VolumesGetTest-1596674288 None] Creating volume 262811a6-edbd-4071-8662-9ffc3d761029 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:10:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-95100c26-4c79-4df5-a126-f556ddbd23ac tempest-VolumesGetTest-1596674288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:10:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-95100c26-4c79-4df5-a126-f556ddbd23ac tempest-VolumesGetTest-1596674288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:10:34 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-95100c26-4c79-4df5-a126-f556ddbd23ac tempest-VolumesGetTest-1596674288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:10:34 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-95100c26-4c79-4df5-a126-f556ddbd23ac tempest-VolumesGetTest-1596674288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:10:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-95100c26-4c79-4df5-a126-f556ddbd23ac tempest-VolumesGetTest-1596674288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:10:34 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-95100c26-4c79-4df5-a126-f556ddbd23ac tempest-VolumesGetTest-1596674288 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:10:34 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-95100c26-4c79-4df5-a126-f556ddbd23ac tempest-VolumesGetTest-1596674288 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:10:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-95100c26-4c79-4df5-a126-f556ddbd23ac tempest-VolumesGetTest-1596674288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-262811a6-edbd-4071-8662-9ffc3d761029 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:34 devstack sudo[94948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-262811a6-edbd-4071-8662-9ffc3d761029 1073741824
Jul 03 01:10:34 devstack sudo[94948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:35 devstack sudo[94946]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d9588afc-7caf-43f1-87e4-e044ffdd7e1e tempest-GroupSnapshotsV319Test-1280481491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-783c0dbe-c54c-4f6e-a519-4fd7a271e2a2" returned: 0 in 0.851s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:35 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d9588afc-7caf-43f1-87e4-e044ffdd7e1e tempest-GroupSnapshotsV319Test-1280481491 None] Lock "cinder-quobyte-783c0dbe-c54c-4f6e-a519-4fd7a271e2a2" released by "delete_volume" :: held 2.192s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:10:35 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-d9588afc-7caf-43f1-87e4-e044ffdd7e1e tempest-GroupSnapshotsV319Test-1280481491 None] Created reservations ['eca7a43d-cc70-4c34-8fb7-980ce96e2c76'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:10:35 devstack cinder-volume[86891]: WARNING cinder.quota [None req-d9588afc-7caf-43f1-87e4-e044ffdd7e1e tempest-GroupSnapshotsV319Test-1280481491 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-111559349 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-111559349, it is now deprecated. Please use the default quota class for default quota.
Jul 03 01:10:35 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-d9588afc-7caf-43f1-87e4-e044ffdd7e1e tempest-GroupSnapshotsV319Test-1280481491 None] Created reservations ['8547d23c-99ff-450b-ade2-f9a65f75bba6', '7fc64b4f-c181-4e4f-b41e-477ee6958782', '839c2102-37ba-4a0c-94cd-95047b4b27d8', '47f87f5a-9d4e-46c5-8f41-b6f4d062deb2'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:10:35 devstack sudo[94948]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-95100c26-4c79-4df5-a126-f556ddbd23ac tempest-VolumesGetTest-1596674288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-262811a6-edbd-4071-8662-9ffc3d761029 1073741824" returned: 0 in 1.107s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-d9588afc-7caf-43f1-87e4-e044ffdd7e1e tempest-GroupSnapshotsV319Test-1280481491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:10:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-d9588afc-7caf-43f1-87e4-e044ffdd7e1e tempest-GroupSnapshotsV319Test-1280481491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:10:35 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-d9588afc-7caf-43f1-87e4-e044ffdd7e1e tempest-GroupSnapshotsV319Test-1280481491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:10:35 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-d9588afc-7caf-43f1-87e4-e044ffdd7e1e tempest-GroupSnapshotsV319Test-1280481491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:10:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-d9588afc-7caf-43f1-87e4-e044ffdd7e1e tempest-GroupSnapshotsV319Test-1280481491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:10:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d9588afc-7caf-43f1-87e4-e044ffdd7e1e tempest-GroupSnapshotsV319Test-1280481491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-95100c26-4c79-4df5-a126-f556ddbd23ac tempest-VolumesGetTest-1596674288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-262811a6-edbd-4071-8662-9ffc3d761029 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:35 devstack sudo[95337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:10:35 devstack sudo[95337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:35 devstack sudo[95338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-262811a6-edbd-4071-8662-9ffc3d761029
Jul 03 01:10:35 devstack sudo[95338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:36 devstack sudo[95337]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d9588afc-7caf-43f1-87e4-e044ffdd7e1e tempest-GroupSnapshotsV319Test-1280481491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.800s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:36 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-d9588afc-7caf-43f1-87e4-e044ffdd7e1e tempest-GroupSnapshotsV319Test-1280481491 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:10:36 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-d9588afc-7caf-43f1-87e4-e044ffdd7e1e tempest-GroupSnapshotsV319Test-1280481491 None] Delete group completed successfully.
Jul 03 01:10:36 devstack sudo[95338]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-95100c26-4c79-4df5-a126-f556ddbd23ac tempest-VolumesGetTest-1596674288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-262811a6-edbd-4071-8662-9ffc3d761029" returned: 0 in 0.843s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:36 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-95100c26-4c79-4df5-a126-f556ddbd23ac tempest-VolumesGetTest-1596674288 None] <== create_volume: return (2032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:10:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-95100c26-4c79-4df5-a126-f556ddbd23ac tempest-VolumesGetTest-1596674288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.035s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:10:36 devstack cinder-volume[86891]: DEBUG cinder.volume.volume_utils [None req-95100c26-4c79-4df5-a126-f556ddbd23ac tempest-VolumesGetTest-1596674288 None] Attempting download of 65cceacb-879b-4111-919c-966899666f55 ((None, [{'url': 'file:///opt/stack/data/glance/images/65cceacb-879b-4111-919c-966899666f55', 'metadata': {}}])) to volume 262811a6-edbd-4071-8662-9ffc3d761029. {{(pid=86891) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 03 01:10:36 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c69784-b820-40b7-bd88-12088a207cd5]: (4, 'raw') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:10:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-95100c26-4c79-4df5-a126-f556ddbd23ac tempest-VolumesGetTest-1596674288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_65cceacb-879b-4111-919c-966899666f55_5tw_pjsa {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:36 devstack sudo[95343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_65cceacb-879b-4111-919c-966899666f55_5tw_pjsa
Jul 03 01:10:36 devstack sudo[95343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:37 devstack sudo[95343]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-95100c26-4c79-4df5-a126-f556ddbd23ac tempest-VolumesGetTest-1596674288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_65cceacb-879b-4111-919c-966899666f55_5tw_pjsa" returned: 0 in 0.816s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-95100c26-4c79-4df5-a126-f556ddbd23ac tempest-VolumesGetTest-1596674288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_65cceacb-879b-4111-919c-966899666f55_5tw_pjsa {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:37 devstack sudo[95347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_65cceacb-879b-4111-919c-966899666f55_5tw_pjsa
Jul 03 01:10:37 devstack sudo[95347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:38 devstack sudo[95347]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-95100c26-4c79-4df5-a126-f556ddbd23ac tempest-VolumesGetTest-1596674288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_65cceacb-879b-4111-919c-966899666f55_5tw_pjsa" returned: 1 in 0.820s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-95100c26-4c79-4df5-a126-f556ddbd23ac tempest-VolumesGetTest-1596674288 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_65cceacb-879b-4111-919c-966899666f55_5tw_pjsa' failed. Not Retrying. {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 01:10:38 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9a68e1-ad48-4874-ac96-42a2796e9718]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:10:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-95100c26-4c79-4df5-a126-f556ddbd23ac tempest-VolumesGetTest-1596674288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_65cceacb-879b-4111-919c-966899666f55_4eve5hgtdevstack@QuobyteHD {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:38 devstack sudo[95352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_65cceacb-879b-4111-919c-966899666f55_4eve5hgtdevstack@QuobyteHD
Jul 03 01:10:38 devstack sudo[95352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:38 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-e3839413-c15e-43ae-b1a7-3d033848f68b tempest-GroupSnapshotsTest-1320333608 None] Group tempest-GroupSnapshotsTest-Group-25802205: creating
Jul 03 01:10:38 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-e3839413-c15e-43ae-b1a7-3d033848f68b tempest-GroupSnapshotsTest-1320333608 None] Group tempest-GroupSnapshotsTest-Group-25802205: created successfully
Jul 03 01:10:38 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-e3839413-c15e-43ae-b1a7-3d033848f68b tempest-GroupSnapshotsTest-1320333608 None] Create group completed successfully.
Jul 03 01:10:39 devstack sudo[95352]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-95100c26-4c79-4df5-a126-f556ddbd23ac tempest-VolumesGetTest-1596674288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_65cceacb-879b-4111-919c-966899666f55_4eve5hgtdevstack@QuobyteHD" returned: 0 in 0.861s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:39 devstack cinder-volume[86891]: DEBUG cinder.image.image_utils [None req-95100c26-4c79-4df5-a126-f556ddbd23ac tempest-VolumesGetTest-1596674288 None] 65cceacb-879b-4111-919c-966899666f55 was qcow2, converting to raw {{(pid=86891) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 03 01:10:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-95100c26-4c79-4df5-a126-f556ddbd23ac tempest-VolumesGetTest-1596674288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_65cceacb-879b-4111-919c-966899666f55_4eve5hgtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-262811a6-edbd-4071-8662-9ffc3d761029 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:39 devstack sudo[95364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_65cceacb-879b-4111-919c-966899666f55_4eve5hgtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-262811a6-edbd-4071-8662-9ffc3d761029
Jul 03 01:10:39 devstack sudo[95364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:40 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe8ffb47-1917-4772-b58d-3500b1191fa8 tempest-GroupSnapshotsTest-1320333608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:10:40 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fe8ffb47-1917-4772-b58d-3500b1191fa8 tempest-GroupSnapshotsTest-1320333608 None] Flow 'volume_create_manager' (f2a06ea1-282f-4f6c-85e4-313af5963d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:10:40 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fe8ffb47-1917-4772-b58d-3500b1191fa8 tempest-GroupSnapshotsTest-1320333608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (771d8c39-0377-43d6-95d3-9dcc890e7479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:10:40 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fe8ffb47-1917-4772-b58d-3500b1191fa8 tempest-GroupSnapshotsTest-1320333608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (771d8c39-0377-43d6-95d3-9dcc890e7479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:10:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-368817757',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3b1f4c48-7a7d-406d-9a5a-e0fc88b3bc4a,host='devstack@QuobyteHD#QuobyteHD',id=9d59b300-4865-4b2c-9315-c3edfa32038c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='605b15a8b401420c832ed398e7a562bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:10:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:10:41Z,use_quota=True,user_id='aee26ffd1cc24952b7327629329664f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cf84de18-e928-4449-90ec-ae9cf2151048),volume_type_id=cf84de18-e928-4449-90ec-ae9cf2151048)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:10:40 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fe8ffb47-1917-4772-b58d-3500b1191fa8 tempest-GroupSnapshotsTest-1320333608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77207e61-e5ba-40df-91d4-0121a96f73c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:10:40 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fe8ffb47-1917-4772-b58d-3500b1191fa8 tempest-GroupSnapshotsTest-1320333608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77207e61-e5ba-40df-91d4-0121a96f73c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:10:40 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fe8ffb47-1917-4772-b58d-3500b1191fa8 tempest-GroupSnapshotsTest-1320333608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (272540e7-9450-4a79-b5d6-9ac7c1dab3d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:10:40 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fe8ffb47-1917-4772-b58d-3500b1191fa8 tempest-GroupSnapshotsTest-1320333608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (272540e7-9450-4a79-b5d6-9ac7c1dab3d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d59b300-4865-4b2c-9315-c3edfa32038c', 'volume_name': 'volume-9d59b300-4865-4b2c-9315-c3edfa32038c', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:10:40 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fe8ffb47-1917-4772-b58d-3500b1191fa8 tempest-GroupSnapshotsTest-1320333608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ee93753-fcf2-4f61-9d71-9d0433f3c33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:10:40 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fe8ffb47-1917-4772-b58d-3500b1191fa8 tempest-GroupSnapshotsTest-1320333608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ee93753-fcf2-4f61-9d71-9d0433f3c33b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:10:40 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fe8ffb47-1917-4772-b58d-3500b1191fa8 tempest-GroupSnapshotsTest-1320333608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bd7a115-466d-40cc-b399-14148dc10893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:10:40 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-fe8ffb47-1917-4772-b58d-3500b1191fa8 tempest-GroupSnapshotsTest-1320333608 None] Volume 9d59b300-4865-4b2c-9315-c3edfa32038c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d59b300-4865-4b2c-9315-c3edfa32038c', 'volume_size': 1}
Jul 03 01:10:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-fe8ffb47-1917-4772-b58d-3500b1191fa8 tempest-GroupSnapshotsTest-1320333608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:10:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-fe8ffb47-1917-4772-b58d-3500b1191fa8 tempest-GroupSnapshotsTest-1320333608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:10:40 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-fe8ffb47-1917-4772-b58d-3500b1191fa8 tempest-GroupSnapshotsTest-1320333608 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=3b1f4c48-7a7d-406d-9a5a-e0fc88b3bc4a,created_at=2026-07-02T23:10:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-368817757',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3b1f4c48-7a7d-406d-9a5a-e0fc88b3bc4a,host='devstack@QuobyteHD#QuobyteHD',id=9d59b300-4865-4b2c-9315-c3edfa32038c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='605b15a8b401420c832ed398e7a562bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:10:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:10:41Z,use_quota=True,user_id='aee26ffd1cc24952b7327629329664f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cf84de18-e928-4449-90ec-ae9cf2151048),volume_type_id=cf84de18-e928-4449-90ec-ae9cf2151048)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:10:40 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-fe8ffb47-1917-4772-b58d-3500b1191fa8 tempest-GroupSnapshotsTest-1320333608 None] Creating volume 9d59b300-4865-4b2c-9315-c3edfa32038c {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:10:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-fe8ffb47-1917-4772-b58d-3500b1191fa8 tempest-GroupSnapshotsTest-1320333608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:10:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-fe8ffb47-1917-4772-b58d-3500b1191fa8 tempest-GroupSnapshotsTest-1320333608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:10:40 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-fe8ffb47-1917-4772-b58d-3500b1191fa8 tempest-GroupSnapshotsTest-1320333608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:10:40 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-fe8ffb47-1917-4772-b58d-3500b1191fa8 tempest-GroupSnapshotsTest-1320333608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:10:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-fe8ffb47-1917-4772-b58d-3500b1191fa8 tempest-GroupSnapshotsTest-1320333608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:10:40 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-fe8ffb47-1917-4772-b58d-3500b1191fa8 tempest-GroupSnapshotsTest-1320333608 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:10:40 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-fe8ffb47-1917-4772-b58d-3500b1191fa8 tempest-GroupSnapshotsTest-1320333608 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:10:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-fe8ffb47-1917-4772-b58d-3500b1191fa8 tempest-GroupSnapshotsTest-1320333608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9d59b300-4865-4b2c-9315-c3edfa32038c 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:40 devstack sudo[95377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9d59b300-4865-4b2c-9315-c3edfa32038c 1073741824
Jul 03 01:10:40 devstack sudo[95377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:41 devstack cinder-volume[86891]: INFO cinder.volume.manager [req-97748a89-d568-4b2f-93f2-e191525d2df5 req-1827254c-d517-4e01-b677-fd4e44e21077 tempest-AttachVolumeNegativeTest-1781307442 None] Terminate volume connection completed successfully.
Jul 03 01:10:41 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [req-97748a89-d568-4b2f-93f2-e191525d2df5 req-1827254c-d517-4e01-b677-fd4e44e21077 tempest-AttachVolumeNegativeTest-1781307442 None] Deleting attachment 9918fc20-6f4b-4489-8581-03e0cd9bdf31. {{(pid=86891) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 01:10:41 devstack sudo[95364]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-95100c26-4c79-4df5-a126-f556ddbd23ac tempest-VolumesGetTest-1596674288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_65cceacb-879b-4111-919c-966899666f55_4eve5hgtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-262811a6-edbd-4071-8662-9ffc3d761029" returned: 0 in 2.409s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:41 devstack cinder-volume[86891]: DEBUG cinder.image.image_utils [None req-95100c26-4c79-4df5-a126-f556ddbd23ac tempest-VolumesGetTest-1596674288 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_65cceacb-879b-4111-919c-966899666f55_4eve5hgtdevstack@QuobyteHD, size 112.00 MB, duration 2.41 sec, destination /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-262811a6-edbd-4071-8662-9ffc3d761029 {{(pid=86891) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 03 01:10:41 devstack cinder-volume[86891]: INFO cinder.image.image_utils [None req-95100c26-4c79-4df5-a126-f556ddbd23ac tempest-VolumesGetTest-1596674288 None] Converted 112.00 MB image at 46.48 MB/s
Jul 03 01:10:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-95100c26-4c79-4df5-a126-f556ddbd23ac tempest-VolumesGetTest-1596674288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-262811a6-edbd-4071-8662-9ffc3d761029 1G {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:41 devstack sudo[95409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-262811a6-edbd-4071-8662-9ffc3d761029 1G
Jul 03 01:10:41 devstack sudo[95409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:41 devstack sudo[95377]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-fe8ffb47-1917-4772-b58d-3500b1191fa8 tempest-GroupSnapshotsTest-1320333608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9d59b300-4865-4b2c-9315-c3edfa32038c 1073741824" returned: 0 in 1.062s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-fe8ffb47-1917-4772-b58d-3500b1191fa8 tempest-GroupSnapshotsTest-1320333608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9d59b300-4865-4b2c-9315-c3edfa32038c {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:42 devstack sudo[95411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9d59b300-4865-4b2c-9315-c3edfa32038c
Jul 03 01:10:42 devstack sudo[95411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:42 devstack sudo[95409]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-95100c26-4c79-4df5-a126-f556ddbd23ac tempest-VolumesGetTest-1596674288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-262811a6-edbd-4071-8662-9ffc3d761029 1G" returned: 0 in 0.786s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:42 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c99b14-f792-419a-a9c0-a6ddabeb228b]: (4, 'raw') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:10:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-95100c26-4c79-4df5-a126-f556ddbd23ac tempest-VolumesGetTest-1596674288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-262811a6-edbd-4071-8662-9ffc3d761029 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:42 devstack sudo[95416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-262811a6-edbd-4071-8662-9ffc3d761029
Jul 03 01:10:42 devstack sudo[95416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:42 devstack sudo[95411]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-fe8ffb47-1917-4772-b58d-3500b1191fa8 tempest-GroupSnapshotsTest-1320333608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9d59b300-4865-4b2c-9315-c3edfa32038c" returned: 0 in 0.766s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:42 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-fe8ffb47-1917-4772-b58d-3500b1191fa8 tempest-GroupSnapshotsTest-1320333608 None] <== create_volume: return (1887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:10:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-fe8ffb47-1917-4772-b58d-3500b1191fa8 tempest-GroupSnapshotsTest-1320333608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.891s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:10:42 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fe8ffb47-1917-4772-b58d-3500b1191fa8 tempest-GroupSnapshotsTest-1320333608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bd7a115-466d-40cc-b399-14148dc10893) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d59b300-4865-4b2c-9315-c3edfa32038c', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:10:42 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fe8ffb47-1917-4772-b58d-3500b1191fa8 tempest-GroupSnapshotsTest-1320333608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c08694a2-1c1f-468e-876c-c1fbfb0462d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:10:42 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-fe8ffb47-1917-4772-b58d-3500b1191fa8 tempest-GroupSnapshotsTest-1320333608 None] Volume volume-9d59b300-4865-4b2c-9315-c3edfa32038c (9d59b300-4865-4b2c-9315-c3edfa32038c): created successfully
Jul 03 01:10:42 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fe8ffb47-1917-4772-b58d-3500b1191fa8 tempest-GroupSnapshotsTest-1320333608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c08694a2-1c1f-468e-876c-c1fbfb0462d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:10:42 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fe8ffb47-1917-4772-b58d-3500b1191fa8 tempest-GroupSnapshotsTest-1320333608 None] Flow 'volume_create_manager' (f2a06ea1-282f-4f6c-85e4-313af5963d42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:10:42 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-fe8ffb47-1917-4772-b58d-3500b1191fa8 tempest-GroupSnapshotsTest-1320333608 None] Created volume successfully.
Jul 03 01:10:43 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-22f85be3-109b-454a-ae17-b026ffbfa489 tempest-GroupsV320Test-14070509 None] Group tempest-GroupsV320Test-Group-2142171720: creating
Jul 03 01:10:43 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-22f85be3-109b-454a-ae17-b026ffbfa489 tempest-GroupsV320Test-14070509 None] Group tempest-GroupsV320Test-Group-2142171720: created successfully
Jul 03 01:10:43 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-22f85be3-109b-454a-ae17-b026ffbfa489 tempest-GroupsV320Test-14070509 None] Create group completed successfully.
Jul 03 01:10:43 devstack sudo[95416]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-95100c26-4c79-4df5-a126-f556ddbd23ac tempest-VolumesGetTest-1596674288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-262811a6-edbd-4071-8662-9ffc3d761029" returned: 0 in 0.804s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-95100c26-4c79-4df5-a126-f556ddbd23ac tempest-VolumesGetTest-1596674288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-262811a6-edbd-4071-8662-9ffc3d761029 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:43 devstack sudo[95421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-262811a6-edbd-4071-8662-9ffc3d761029
Jul 03 01:10:43 devstack sudo[95421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:43 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-6c2695fd-2afa-4f3c-83a8-19e1c73a39ca tempest-GroupSnapshotsTest-1320333608 None] GroupSnapshot ca6a7c33-e8eb-437c-bfb0-c662b12422ea: creating.
Jul 03 01:10:43 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-6c2695fd-2afa-4f3c-83a8-19e1c73a39ca tempest-GroupSnapshotsTest-1320333608 None] Group snapshot ca6a7c33-e8eb-437c-bfb0-c662b12422ea: creating. {{(pid=86891) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 03 01:10:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-6c2695fd-2afa-4f3c-83a8-19e1c73a39ca tempest-GroupSnapshotsTest-1320333608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:10:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-6c2695fd-2afa-4f3c-83a8-19e1c73a39ca tempest-GroupSnapshotsTest-1320333608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:10:43 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-6c2695fd-2afa-4f3c-83a8-19e1c73a39ca tempest-GroupSnapshotsTest-1320333608 None] Creating offline snapshot fb8f97bc-dbca-4a7a-ac25-d685e012536f of volume 9d59b300-4865-4b2c-9315-c3edfa32038c {{(pid=86891) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 01:10:43 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a4d2339-31e8-43c0-9713-8af895dc344b]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:10:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6c2695fd-2afa-4f3c-83a8-19e1c73a39ca tempest-GroupSnapshotsTest-1320333608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9d59b300-4865-4b2c-9315-c3edfa32038c {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:43 devstack sudo[95423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9d59b300-4865-4b2c-9315-c3edfa32038c
Jul 03 01:10:43 devstack sudo[95423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:44 devstack sudo[95421]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-95100c26-4c79-4df5-a126-f556ddbd23ac tempest-VolumesGetTest-1596674288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-262811a6-edbd-4071-8662-9ffc3d761029" returned: 1 in 0.834s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-95100c26-4c79-4df5-a126-f556ddbd23ac tempest-VolumesGetTest-1596674288 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-262811a6-edbd-4071-8662-9ffc3d761029' failed. Not Retrying. {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 01:10:44 devstack cinder-volume[86891]: DEBUG cinder.volume.volume_utils [None req-95100c26-4c79-4df5-a126-f556ddbd23ac tempest-VolumesGetTest-1596674288 None] Downloaded image 65cceacb-879b-4111-919c-966899666f55 ((None, [{'url': 'file:///opt/stack/data/glance/images/65cceacb-879b-4111-919c-966899666f55', 'metadata': {}}])) to volume 262811a6-edbd-4071-8662-9ffc3d761029 successfully. {{(pid=86891) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 03 01:10:44 devstack cinder-volume[86891]: DEBUG cinder.image.image_utils [None req-95100c26-4c79-4df5-a126-f556ddbd23ac tempest-VolumesGetTest-1596674288 None] Temporary image 65cceacb-879b-4111-919c-966899666f55 for user 6bacac4e0d924409b6e00e085cc5dc25 is deleted. {{(pid=86891) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 03 01:10:44 devstack cinder-volume[86891]: DEBUG cinder.volume.volume_utils [None req-95100c26-4c79-4df5-a126-f556ddbd23ac tempest-VolumesGetTest-1596674288 None] Marking volume 262811a6-edbd-4071-8662-9ffc3d761029 as bootable. {{(pid=86891) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 03 01:10:44 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-95100c26-4c79-4df5-a126-f556ddbd23ac tempest-VolumesGetTest-1596674288 None] Copying metadata from image 65cceacb-879b-4111-919c-966899666f55 to 262811a6-edbd-4071-8662-9ffc3d761029. {{(pid=86891) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 03 01:10:44 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-95100c26-4c79-4df5-a126-f556ddbd23ac tempest-VolumesGetTest-1596674288 None] Creating volume glance metadata for volume 262811a6-edbd-4071-8662-9ffc3d761029 backed by image 65cceacb-879b-4111-919c-966899666f55 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '65cceacb-879b-4111-919c-966899666f55', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86891) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 03 01:10:44 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-95100c26-4c79-4df5-a126-f556ddbd23ac tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad7c8572-69cf-4fc9-81b1-8edfb592fd5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-262811a6-edbd-4071-8662-9ffc3d761029', 'volume_size': 1, 'image_id': '65cceacb-879b-4111-919c-966899666f55', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/65cceacb-879b-4111-919c-966899666f55', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0d33e5361cf145ffa2791b827e46aea8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '65cceacb-879b-4111-919c-966899666f55', 'created_at': datetime.datetime(2026, 7, 2, 22, 57, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 22, 57, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/65cceacb-879b-4111-919c-966899666f55/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7c5b35182b10>}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:10:44 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-95100c26-4c79-4df5-a126-f556ddbd23ac tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc9130e8-69e5-4f79-8f14-2fb8fd881af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:10:44 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-95100c26-4c79-4df5-a126-f556ddbd23ac tempest-VolumesGetTest-1596674288 None] Volume volume-262811a6-edbd-4071-8662-9ffc3d761029 (262811a6-edbd-4071-8662-9ffc3d761029): created successfully
Jul 03 01:10:44 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-95100c26-4c79-4df5-a126-f556ddbd23ac tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc9130e8-69e5-4f79-8f14-2fb8fd881af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:10:44 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-95100c26-4c79-4df5-a126-f556ddbd23ac tempest-VolumesGetTest-1596674288 None] Flow 'volume_create_manager' (41bd3a08-0407-4cf7-9255-cb3aae87b2a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:10:44 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-95100c26-4c79-4df5-a126-f556ddbd23ac tempest-VolumesGetTest-1596674288 None] Created volume successfully.
Jul 03 01:10:44 devstack sudo[95423]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6c2695fd-2afa-4f3c-83a8-19e1c73a39ca tempest-GroupSnapshotsTest-1320333608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9d59b300-4865-4b2c-9315-c3edfa32038c" returned: 0 in 0.899s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6c2695fd-2afa-4f3c-83a8-19e1c73a39ca tempest-GroupSnapshotsTest-1320333608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9d59b300-4865-4b2c-9315-c3edfa32038c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9d59b300-4865-4b2c-9315-c3edfa32038c.fb8f97bc-dbca-4a7a-ac25-d685e012536f 1G {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:44 devstack sudo[95445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9d59b300-4865-4b2c-9315-c3edfa32038c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9d59b300-4865-4b2c-9315-c3edfa32038c.fb8f97bc-dbca-4a7a-ac25-d685e012536f 1G
Jul 03 01:10:44 devstack sudo[95445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:44 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-204e4ebd-3abb-46f0-b777-aed0f29003be tempest-GroupsV320Test-14070509 None] Created reservations ['988fe454-802d-48e3-9ac3-42b22d206afa'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:10:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-204e4ebd-3abb-46f0-b777-aed0f29003be tempest-GroupsV320Test-14070509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:10:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-204e4ebd-3abb-46f0-b777-aed0f29003be tempest-GroupsV320Test-14070509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:10:44 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-204e4ebd-3abb-46f0-b777-aed0f29003be tempest-GroupsV320Test-14070509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:10:44 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-204e4ebd-3abb-46f0-b777-aed0f29003be tempest-GroupsV320Test-14070509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:10:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-204e4ebd-3abb-46f0-b777-aed0f29003be tempest-GroupsV320Test-14070509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:10:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-204e4ebd-3abb-46f0-b777-aed0f29003be tempest-GroupsV320Test-14070509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:44 devstack sudo[95473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:10:45 devstack sudo[95473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:45 devstack sudo[95445]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6c2695fd-2afa-4f3c-83a8-19e1c73a39ca tempest-GroupSnapshotsTest-1320333608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9d59b300-4865-4b2c-9315-c3edfa32038c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9d59b300-4865-4b2c-9315-c3edfa32038c.fb8f97bc-dbca-4a7a-ac25-d685e012536f 1G" returned: 0 in 1.186s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6c2695fd-2afa-4f3c-83a8-19e1c73a39ca tempest-GroupSnapshotsTest-1320333608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d59b300-4865-4b2c-9315-c3edfa32038c -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9d59b300-4865-4b2c-9315-c3edfa32038c.fb8f97bc-dbca-4a7a-ac25-d685e012536f {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:45 devstack sudo[95480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d59b300-4865-4b2c-9315-c3edfa32038c -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9d59b300-4865-4b2c-9315-c3edfa32038c.fb8f97bc-dbca-4a7a-ac25-d685e012536f
Jul 03 01:10:45 devstack sudo[95480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:45 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a99b928-8b71-4d02-a6f8-d834c9ae216f tempest-VolumesGetTest-1596674288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:10:45 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7a99b928-8b71-4d02-a6f8-d834c9ae216f tempest-VolumesGetTest-1596674288 None] Flow 'volume_create_manager' (55609770-d1bb-4b88-bc38-139337a4df80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:10:45 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7a99b928-8b71-4d02-a6f8-d834c9ae216f tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64bcd1a2-2277-4232-ad4e-f587d3259168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:10:45 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7a99b928-8b71-4d02-a6f8-d834c9ae216f tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64bcd1a2-2277-4232-ad4e-f587d3259168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:10:45Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-918546117',display_name='tempest-VolumesGetTest-Volume-1502274078',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0182a997-f17f-4e41-bd70-830c56134349,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='087effcc09294d31b1aa60c2a1ea3b65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:10:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:10:46Z,use_quota=True,user_id='6bacac4e0d924409b6e00e085cc5dc25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:10:45 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7a99b928-8b71-4d02-a6f8-d834c9ae216f tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cbc5b9f-1f74-49b0-8c70-46d8f9d49a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:10:45 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7a99b928-8b71-4d02-a6f8-d834c9ae216f tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cbc5b9f-1f74-49b0-8c70-46d8f9d49a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:10:45 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7a99b928-8b71-4d02-a6f8-d834c9ae216f tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb726456-d440-4659-95b0-6a8cc0599e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:10:45 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7a99b928-8b71-4d02-a6f8-d834c9ae216f tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb726456-d440-4659-95b0-6a8cc0599e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0182a997-f17f-4e41-bd70-830c56134349', 'volume_name': 'volume-0182a997-f17f-4e41-bd70-830c56134349', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:10:45 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7a99b928-8b71-4d02-a6f8-d834c9ae216f tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3646f768-b679-48bd-b5da-28185c4949f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:10:45 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7a99b928-8b71-4d02-a6f8-d834c9ae216f tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3646f768-b679-48bd-b5da-28185c4949f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:10:45 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7a99b928-8b71-4d02-a6f8-d834c9ae216f tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27356753-3acf-4466-85ec-d9daca8d84d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:10:45 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-7a99b928-8b71-4d02-a6f8-d834c9ae216f tempest-VolumesGetTest-1596674288 None] Volume 0182a997-f17f-4e41-bd70-830c56134349: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0182a997-f17f-4e41-bd70-830c56134349', 'volume_size': 1}
Jul 03 01:10:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-7a99b928-8b71-4d02-a6f8-d834c9ae216f tempest-VolumesGetTest-1596674288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:10:45 devstack sudo[95473]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-204e4ebd-3abb-46f0-b777-aed0f29003be tempest-GroupsV320Test-14070509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.958s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:45 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-204e4ebd-3abb-46f0-b777-aed0f29003be tempest-GroupsV320Test-14070509 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:10:45 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-204e4ebd-3abb-46f0-b777-aed0f29003be tempest-GroupsV320Test-14070509 None] Delete group completed successfully.
Jul 03 01:10:46 devstack sudo[95480]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6c2695fd-2afa-4f3c-83a8-19e1c73a39ca tempest-GroupSnapshotsTest-1320333608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d59b300-4865-4b2c-9315-c3edfa32038c -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9d59b300-4865-4b2c-9315-c3edfa32038c.fb8f97bc-dbca-4a7a-ac25-d685e012536f" returned: 0 in 0.869s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:46 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-6c2695fd-2afa-4f3c-83a8-19e1c73a39ca tempest-GroupSnapshotsTest-1320333608 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9d59b300-4865-4b2c-9315-c3edfa32038c.fb8f97bc-dbca-4a7a-ac25-d685e012536f is being set with open permissions: ugo+rw: NotImplementedError
Jul 03 01:10:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6c2695fd-2afa-4f3c-83a8-19e1c73a39ca tempest-GroupSnapshotsTest-1320333608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9d59b300-4865-4b2c-9315-c3edfa32038c.fb8f97bc-dbca-4a7a-ac25-d685e012536f {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:46 devstack sudo[95488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9d59b300-4865-4b2c-9315-c3edfa32038c.fb8f97bc-dbca-4a7a-ac25-d685e012536f
Jul 03 01:10:46 devstack sudo[95488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:47 devstack sudo[95488]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6c2695fd-2afa-4f3c-83a8-19e1c73a39ca tempest-GroupSnapshotsTest-1320333608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9d59b300-4865-4b2c-9315-c3edfa32038c.fb8f97bc-dbca-4a7a-ac25-d685e012536f" returned: 0 in 0.768s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6c2695fd-2afa-4f3c-83a8-19e1c73a39ca tempest-GroupSnapshotsTest-1320333608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9d59b300-4865-4b2c-9315-c3edfa32038c.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:47 devstack sudo[95492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9d59b300-4865-4b2c-9315-c3edfa32038c.info
Jul 03 01:10:47 devstack sudo[95492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:48 devstack sudo[95492]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6c2695fd-2afa-4f3c-83a8-19e1c73a39ca tempest-GroupSnapshotsTest-1320333608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9d59b300-4865-4b2c-9315-c3edfa32038c.info" returned: 0 in 0.727s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:48 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-6c2695fd-2afa-4f3c-83a8-19e1c73a39ca tempest-GroupSnapshotsTest-1320333608 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9d59b300-4865-4b2c-9315-c3edfa32038c.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 03 01:10:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6c2695fd-2afa-4f3c-83a8-19e1c73a39ca tempest-GroupSnapshotsTest-1320333608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9d59b300-4865-4b2c-9315-c3edfa32038c.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:48 devstack sudo[95496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9d59b300-4865-4b2c-9315-c3edfa32038c.info
Jul 03 01:10:48 devstack sudo[95496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:48 devstack sudo[95496]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6c2695fd-2afa-4f3c-83a8-19e1c73a39ca tempest-GroupSnapshotsTest-1320333608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9d59b300-4865-4b2c-9315-c3edfa32038c.info" returned: 0 in 0.730s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-6c2695fd-2afa-4f3c-83a8-19e1c73a39ca tempest-GroupSnapshotsTest-1320333608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.293s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:10:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-7a99b928-8b71-4d02-a6f8-d834c9ae216f tempest-VolumesGetTest-1596674288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.996s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:10:48 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-7a99b928-8b71-4d02-a6f8-d834c9ae216f tempest-VolumesGetTest-1596674288 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:10:45Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-918546117',display_name='tempest-VolumesGetTest-Volume-1502274078',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0182a997-f17f-4e41-bd70-830c56134349,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='087effcc09294d31b1aa60c2a1ea3b65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:10:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:10:46Z,use_quota=True,user_id='6bacac4e0d924409b6e00e085cc5dc25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:10:48 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-7a99b928-8b71-4d02-a6f8-d834c9ae216f tempest-VolumesGetTest-1596674288 None] Creating volume 0182a997-f17f-4e41-bd70-830c56134349 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:10:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-7a99b928-8b71-4d02-a6f8-d834c9ae216f tempest-VolumesGetTest-1596674288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:10:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-7a99b928-8b71-4d02-a6f8-d834c9ae216f tempest-VolumesGetTest-1596674288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:10:48 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-7a99b928-8b71-4d02-a6f8-d834c9ae216f tempest-VolumesGetTest-1596674288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:10:48 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-7a99b928-8b71-4d02-a6f8-d834c9ae216f tempest-VolumesGetTest-1596674288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:10:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-7a99b928-8b71-4d02-a6f8-d834c9ae216f tempest-VolumesGetTest-1596674288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:10:48 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-7a99b928-8b71-4d02-a6f8-d834c9ae216f tempest-VolumesGetTest-1596674288 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:10:48 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-7a99b928-8b71-4d02-a6f8-d834c9ae216f tempest-VolumesGetTest-1596674288 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:10:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-7a99b928-8b71-4d02-a6f8-d834c9ae216f tempest-VolumesGetTest-1596674288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0182a997-f17f-4e41-bd70-830c56134349 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:48 devstack sudo[95499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0182a997-f17f-4e41-bd70-830c56134349 1073741824
Jul 03 01:10:48 devstack sudo[95499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:48 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-6c2695fd-2afa-4f3c-83a8-19e1c73a39ca tempest-GroupSnapshotsTest-1320333608 None] group_snapshot ca6a7c33-e8eb-437c-bfb0-c662b12422ea: created successfully
Jul 03 01:10:49 devstack sudo[95499]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-7a99b928-8b71-4d02-a6f8-d834c9ae216f tempest-VolumesGetTest-1596674288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0182a997-f17f-4e41-bd70-830c56134349 1073741824" returned: 0 in 0.902s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-7a99b928-8b71-4d02-a6f8-d834c9ae216f tempest-VolumesGetTest-1596674288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0182a997-f17f-4e41-bd70-830c56134349 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:49 devstack sudo[95505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0182a997-f17f-4e41-bd70-830c56134349
Jul 03 01:10:49 devstack sudo[95505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:50 devstack sudo[95505]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-7a99b928-8b71-4d02-a6f8-d834c9ae216f tempest-VolumesGetTest-1596674288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0182a997-f17f-4e41-bd70-830c56134349" returned: 0 in 0.780s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:50 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-7a99b928-8b71-4d02-a6f8-d834c9ae216f tempest-VolumesGetTest-1596674288 None] <== create_volume: return (1732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:10:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-7a99b928-8b71-4d02-a6f8-d834c9ae216f tempest-VolumesGetTest-1596674288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.735s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:10:50 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7a99b928-8b71-4d02-a6f8-d834c9ae216f tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27356753-3acf-4466-85ec-d9daca8d84d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0182a997-f17f-4e41-bd70-830c56134349', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:10:50 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7a99b928-8b71-4d02-a6f8-d834c9ae216f tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d0fe3e9-c147-4253-97e0-cf03a70fcaa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:10:50 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-7a99b928-8b71-4d02-a6f8-d834c9ae216f tempest-VolumesGetTest-1596674288 None] Volume volume-0182a997-f17f-4e41-bd70-830c56134349 (0182a997-f17f-4e41-bd70-830c56134349): created successfully
Jul 03 01:10:50 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7a99b928-8b71-4d02-a6f8-d834c9ae216f tempest-VolumesGetTest-1596674288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d0fe3e9-c147-4253-97e0-cf03a70fcaa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:10:50 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7a99b928-8b71-4d02-a6f8-d834c9ae216f tempest-VolumesGetTest-1596674288 None] Flow 'volume_create_manager' (55609770-d1bb-4b88-bc38-139337a4df80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:10:50 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-7a99b928-8b71-4d02-a6f8-d834c9ae216f tempest-VolumesGetTest-1596674288 None] Created volume successfully.
Jul 03 01:10:51 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-90b5431b-d885-4601-8e5e-b6b2062ead84 tempest-GroupSnapshotsTest-1320333608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:10:51 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-90b5431b-d885-4601-8e5e-b6b2062ead84 tempest-GroupSnapshotsTest-1320333608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:10:51 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-90b5431b-d885-4601-8e5e-b6b2062ead84 tempest-GroupSnapshotsTest-1320333608 None] Acquiring lock "cinder-quobyte-fb8f97bc-dbca-4a7a-ac25-d685e012536f-29ed97cd-cfe9-4712-ad69-e35d0afbb3d2" by "_create_volume_from_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:10:51 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-90b5431b-d885-4601-8e5e-b6b2062ead84 tempest-GroupSnapshotsTest-1320333608 None] Lock "cinder-quobyte-fb8f97bc-dbca-4a7a-ac25-d685e012536f-29ed97cd-cfe9-4712-ad69-e35d0afbb3d2" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:10:51 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-90b5431b-d885-4601-8e5e-b6b2062ead84 tempest-GroupSnapshotsTest-1320333608 None] Creating volume 29ed97cd-cfe9-4712-ad69-e35d0afbb3d2 from snapshot fb8f97bc-dbca-4a7a-ac25-d685e012536f {{(pid=86891) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 03 01:10:51 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-90b5431b-d885-4601-8e5e-b6b2062ead84 tempest-GroupSnapshotsTest-1320333608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:10:51 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-90b5431b-d885-4601-8e5e-b6b2062ead84 tempest-GroupSnapshotsTest-1320333608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:10:51 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-90b5431b-d885-4601-8e5e-b6b2062ead84 tempest-GroupSnapshotsTest-1320333608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:10:51 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-90b5431b-d885-4601-8e5e-b6b2062ead84 tempest-GroupSnapshotsTest-1320333608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:10:51 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-90b5431b-d885-4601-8e5e-b6b2062ead84 tempest-GroupSnapshotsTest-1320333608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:10:51 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-90b5431b-d885-4601-8e5e-b6b2062ead84 tempest-GroupSnapshotsTest-1320333608 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:10:51 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-90b5431b-d885-4601-8e5e-b6b2062ead84 tempest-GroupSnapshotsTest-1320333608 None] Acquiring lock "cinder-quobyte-29ed97cd-cfe9-4712-ad69-e35d0afbb3d2" by "_copy_volume_from_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:10:51 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-90b5431b-d885-4601-8e5e-b6b2062ead84 tempest-GroupSnapshotsTest-1320333608 None] Lock "cinder-quobyte-29ed97cd-cfe9-4712-ad69-e35d0afbb3d2" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:10:51 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-90b5431b-d885-4601-8e5e-b6b2062ead84 tempest-GroupSnapshotsTest-1320333608 None] snapshot: fb8f97bc-dbca-4a7a-ac25-d685e012536f, volume: 29ed97cd-cfe9-4712-ad69-e35d0afbb3d2,  {{(pid=86891) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 03 01:10:51 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-90b5431b-d885-4601-8e5e-b6b2062ead84 tempest-GroupSnapshotsTest-1320333608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:10:51 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-90b5431b-d885-4601-8e5e-b6b2062ead84 tempest-GroupSnapshotsTest-1320333608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:10:51 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-90b5431b-d885-4601-8e5e-b6b2062ead84 tempest-GroupSnapshotsTest-1320333608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:10:51 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-90b5431b-d885-4601-8e5e-b6b2062ead84 tempest-GroupSnapshotsTest-1320333608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:10:51 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-90b5431b-d885-4601-8e5e-b6b2062ead84 tempest-GroupSnapshotsTest-1320333608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:10:51 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eaeffd9-1af8-4e35-ac8a-16cfefd4ff60]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:10:51 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-90b5431b-d885-4601-8e5e-b6b2062ead84 tempest-GroupSnapshotsTest-1320333608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9d59b300-4865-4b2c-9315-c3edfa32038c.fb8f97bc-dbca-4a7a-ac25-d685e012536f {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:51 devstack sudo[95508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9d59b300-4865-4b2c-9315-c3edfa32038c.fb8f97bc-dbca-4a7a-ac25-d685e012536f
Jul 03 01:10:51 devstack sudo[95508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:51 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-f2223695-2bab-4428-a360-9f69c5fa9d3d tempest-VolumesGetTest-1596674288 None] Acquiring lock "cinder-0182a997-f17f-4e41-bd70-830c56134349-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:10:51 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-f2223695-2bab-4428-a360-9f69c5fa9d3d tempest-VolumesGetTest-1596674288 None] Lock "cinder-0182a997-f17f-4e41-bd70-830c56134349-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:10:51 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-f2223695-2bab-4428-a360-9f69c5fa9d3d tempest-VolumesGetTest-1596674288 None] Acquiring lock "cinder-quobyte-0182a997-f17f-4e41-bd70-830c56134349" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:10:51 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-f2223695-2bab-4428-a360-9f69c5fa9d3d tempest-VolumesGetTest-1596674288 None] Lock "cinder-quobyte-0182a997-f17f-4e41-bd70-830c56134349" acquired by "delete_volume" :: waited 0.023s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:10:51 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5e7dc6-27da-40b2-bc69-88d56e69d0a6]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:10:51 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f2223695-2bab-4428-a360-9f69c5fa9d3d tempest-VolumesGetTest-1596674288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0182a997-f17f-4e41-bd70-830c56134349 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:51 devstack sudo[95510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0182a997-f17f-4e41-bd70-830c56134349
Jul 03 01:10:51 devstack sudo[95510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:52 devstack sudo[95508]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-90b5431b-d885-4601-8e5e-b6b2062ead84 tempest-GroupSnapshotsTest-1320333608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9d59b300-4865-4b2c-9315-c3edfa32038c.fb8f97bc-dbca-4a7a-ac25-d685e012536f" returned: 0 in 1.000s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:52 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-90b5431b-d885-4601-8e5e-b6b2062ead84 tempest-GroupSnapshotsTest-1320333608 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d59b300-4865-4b2c-9315-c3edfa32038c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:10:52 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-90b5431b-d885-4601-8e5e-b6b2062ead84 tempest-GroupSnapshotsTest-1320333608 None] will copy from snapshot at /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9d59b300-4865-4b2c-9315-c3edfa32038c {{(pid=86891) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 03 01:10:52 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-90b5431b-d885-4601-8e5e-b6b2062ead84 tempest-GroupSnapshotsTest-1320333608 None] Creating direct copy from snapshot {{(pid=86891) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 03 01:10:52 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[327be821-54f8-4cef-b5a7-fa2a5adc76e6]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:10:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-90b5431b-d885-4601-8e5e-b6b2062ead84 tempest-GroupSnapshotsTest-1320333608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9d59b300-4865-4b2c-9315-c3edfa32038c {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:52 devstack sudo[95515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9d59b300-4865-4b2c-9315-c3edfa32038c
Jul 03 01:10:52 devstack sudo[95515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:52 devstack sudo[95510]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f2223695-2bab-4428-a360-9f69c5fa9d3d tempest-VolumesGetTest-1596674288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0182a997-f17f-4e41-bd70-830c56134349" returned: 0 in 1.043s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f2223695-2bab-4428-a360-9f69c5fa9d3d tempest-VolumesGetTest-1596674288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0182a997-f17f-4e41-bd70-830c56134349 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:52 devstack sudo[95520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0182a997-f17f-4e41-bd70-830c56134349
Jul 03 01:10:52 devstack sudo[95520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:53 devstack sudo[95515]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-90b5431b-d885-4601-8e5e-b6b2062ead84 tempest-GroupSnapshotsTest-1320333608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9d59b300-4865-4b2c-9315-c3edfa32038c" returned: 0 in 0.869s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:53 devstack cinder-volume[86891]: DEBUG cinder.utils [None req-90b5431b-d885-4601-8e5e-b6b2062ead84 tempest-GroupSnapshotsTest-1320333608 None] Path /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-29ed97cd-cfe9-4712-ad69-e35d0afbb3d2 not found in is_blk_device check {{(pid=86891) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 03 01:10:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-90b5431b-d885-4601-8e5e-b6b2062ead84 tempest-GroupSnapshotsTest-1320333608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9d59b300-4865-4b2c-9315-c3edfa32038c /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-29ed97cd-cfe9-4712-ad69-e35d0afbb3d2 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:53 devstack sudo[95525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9d59b300-4865-4b2c-9315-c3edfa32038c /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-29ed97cd-cfe9-4712-ad69-e35d0afbb3d2
Jul 03 01:10:53 devstack sudo[95525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:53 devstack sudo[95520]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f2223695-2bab-4428-a360-9f69c5fa9d3d tempest-VolumesGetTest-1596674288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0182a997-f17f-4e41-bd70-830c56134349" returned: 0 in 0.889s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:53 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-f2223695-2bab-4428-a360-9f69c5fa9d3d tempest-VolumesGetTest-1596674288 None] Lock "cinder-quobyte-0182a997-f17f-4e41-bd70-830c56134349" released by "delete_volume" :: held 2.002s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:10:53 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:SELECT=118,cinder:INSERT=38,cinder:UPDATE=119,cinder:DELETE=6 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:10:53 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:DELETE=11,cinder:SELECT=99,cinder:INSERT=26,cinder:UPDATE=108 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:10:53 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-f2223695-2bab-4428-a360-9f69c5fa9d3d tempest-VolumesGetTest-1596674288 None] Created reservations ['52290b73-7d4b-4765-a855-7769615e090b', 'd6d6a825-14f4-448c-bd6f-cd945571aa6b', '6da56fb5-b749-481b-8dea-a48504b0e457', '37096c28-bf07-4c43-bbfb-a130ee2fef47'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:10:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f2223695-2bab-4428-a360-9f69c5fa9d3d tempest-VolumesGetTest-1596674288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:10:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f2223695-2bab-4428-a360-9f69c5fa9d3d tempest-VolumesGetTest-1596674288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:10:53 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-f2223695-2bab-4428-a360-9f69c5fa9d3d tempest-VolumesGetTest-1596674288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:10:53 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-f2223695-2bab-4428-a360-9f69c5fa9d3d tempest-VolumesGetTest-1596674288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:10:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f2223695-2bab-4428-a360-9f69c5fa9d3d tempest-VolumesGetTest-1596674288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:10:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f2223695-2bab-4428-a360-9f69c5fa9d3d tempest-VolumesGetTest-1596674288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:53 devstack sudo[95528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:10:53 devstack sudo[95528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:54 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-a8b2d2a9-aecc-47bb-abd2-a2d69197cf74 tempest-VolumesGetTest-1596674288 None] Acquiring lock "cinder-262811a6-edbd-4071-8662-9ffc3d761029-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:10:54 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-a8b2d2a9-aecc-47bb-abd2-a2d69197cf74 tempest-VolumesGetTest-1596674288 None] Lock "cinder-262811a6-edbd-4071-8662-9ffc3d761029-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:10:54 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-a8b2d2a9-aecc-47bb-abd2-a2d69197cf74 tempest-VolumesGetTest-1596674288 None] Acquiring lock "cinder-quobyte-262811a6-edbd-4071-8662-9ffc3d761029" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:10:54 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-a8b2d2a9-aecc-47bb-abd2-a2d69197cf74 tempest-VolumesGetTest-1596674288 None] Lock "cinder-quobyte-262811a6-edbd-4071-8662-9ffc3d761029" acquired by "delete_volume" :: waited 0.042s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:10:55 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0c6e44-0022-47f9-bf0d-91ce0b8d2bc7]: (4, 'raw') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:10:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a8b2d2a9-aecc-47bb-abd2-a2d69197cf74 tempest-VolumesGetTest-1596674288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-262811a6-edbd-4071-8662-9ffc3d761029 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:55 devstack sudo[95528]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f2223695-2bab-4428-a360-9f69c5fa9d3d tempest-VolumesGetTest-1596674288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 1.653s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:55 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-f2223695-2bab-4428-a360-9f69c5fa9d3d tempest-VolumesGetTest-1596674288 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:10:55 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-f2223695-2bab-4428-a360-9f69c5fa9d3d tempest-VolumesGetTest-1596674288 None] Deleted volume successfully.
Jul 03 01:10:55 devstack sudo[95541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-262811a6-edbd-4071-8662-9ffc3d761029
Jul 03 01:10:55 devstack sudo[95541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:55 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-f2223695-2bab-4428-a360-9f69c5fa9d3d tempest-VolumesGetTest-1596674288 None] Lock "cinder-0182a997-f17f-4e41-bd70-830c56134349-delete_volume" released by "delete_volume" :: held 4.041s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:10:57 devstack sudo[95541]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a8b2d2a9-aecc-47bb-abd2-a2d69197cf74 tempest-VolumesGetTest-1596674288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-262811a6-edbd-4071-8662-9ffc3d761029" returned: 0 in 2.295s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a8b2d2a9-aecc-47bb-abd2-a2d69197cf74 tempest-VolumesGetTest-1596674288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-262811a6-edbd-4071-8662-9ffc3d761029 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:57 devstack sudo[95546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-262811a6-edbd-4071-8662-9ffc3d761029
Jul 03 01:10:57 devstack sudo[95546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:59 devstack sudo[95546]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a8b2d2a9-aecc-47bb-abd2-a2d69197cf74 tempest-VolumesGetTest-1596674288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-262811a6-edbd-4071-8662-9ffc3d761029" returned: 1 in 1.639s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a8b2d2a9-aecc-47bb-abd2-a2d69197cf74 tempest-VolumesGetTest-1596674288 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-262811a6-edbd-4071-8662-9ffc3d761029' failed. Not Retrying. {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 01:10:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a8b2d2a9-aecc-47bb-abd2-a2d69197cf74 tempest-VolumesGetTest-1596674288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-262811a6-edbd-4071-8662-9ffc3d761029 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:10:59 devstack sudo[95552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-262811a6-edbd-4071-8662-9ffc3d761029
Jul 03 01:10:59 devstack sudo[95552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:10:59 devstack sudo[95552]: pam_unix(sudo:session): session closed for user root
Jul 03 01:10:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a8b2d2a9-aecc-47bb-abd2-a2d69197cf74 tempest-VolumesGetTest-1596674288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-262811a6-edbd-4071-8662-9ffc3d761029" returned: 0 in 0.896s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:10:59 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-a8b2d2a9-aecc-47bb-abd2-a2d69197cf74 tempest-VolumesGetTest-1596674288 None] Lock "cinder-quobyte-262811a6-edbd-4071-8662-9ffc3d761029" released by "delete_volume" :: held 5.051s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:11:00 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-a8b2d2a9-aecc-47bb-abd2-a2d69197cf74 tempest-VolumesGetTest-1596674288 None] Created reservations ['b7c4de20-708b-46b7-9f8a-2762db8e6265', '319278f7-48cc-4628-b72d-70b51d9c4baa', 'edd6ee1b-39f8-4304-b047-5316c320d492', '59b4181a-42e7-4cc3-a3f2-ca13d8c60f9b'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:11:00 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-90b5431b-d885-4601-8e5e-b6b2062ead84 tempest-GroupSnapshotsTest-1320333608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9d59b300-4865-4b2c-9315-c3edfa32038c /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-29ed97cd-cfe9-4712-ad69-e35d0afbb3d2" returned: 0 in 7.048s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:00 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a8b2d2a9-aecc-47bb-abd2-a2d69197cf74 tempest-VolumesGetTest-1596674288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:11:00 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a8b2d2a9-aecc-47bb-abd2-a2d69197cf74 tempest-VolumesGetTest-1596674288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:11:00 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-a8b2d2a9-aecc-47bb-abd2-a2d69197cf74 tempest-VolumesGetTest-1596674288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:11:00 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-a8b2d2a9-aecc-47bb-abd2-a2d69197cf74 tempest-VolumesGetTest-1596674288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:11:00 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a8b2d2a9-aecc-47bb-abd2-a2d69197cf74 tempest-VolumesGetTest-1596674288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:11:00 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a8b2d2a9-aecc-47bb-abd2-a2d69197cf74 tempest-VolumesGetTest-1596674288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:00 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01afa3f-f5f1-4132-a77b-cc85a796d146]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:11:00 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-90b5431b-d885-4601-8e5e-b6b2062ead84 tempest-GroupSnapshotsTest-1320333608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9d59b300-4865-4b2c-9315-c3edfa32038c {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:00 devstack sudo[95558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:11:00 devstack sudo[95558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:00 devstack sudo[95559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9d59b300-4865-4b2c-9315-c3edfa32038c
Jul 03 01:11:00 devstack sudo[95559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a8b2d2a9-aecc-47bb-abd2-a2d69197cf74 tempest-VolumesGetTest-1596674288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.982s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:01 devstack sudo[95558]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:01 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-a8b2d2a9-aecc-47bb-abd2-a2d69197cf74 tempest-VolumesGetTest-1596674288 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:11:01 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-a8b2d2a9-aecc-47bb-abd2-a2d69197cf74 tempest-VolumesGetTest-1596674288 None] Deleted volume successfully.
Jul 03 01:11:01 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-a8b2d2a9-aecc-47bb-abd2-a2d69197cf74 tempest-VolumesGetTest-1596674288 None] Lock "cinder-262811a6-edbd-4071-8662-9ffc3d761029-delete_volume" released by "delete_volume" :: held 6.450s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:11:01 devstack sudo[95559]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-90b5431b-d885-4601-8e5e-b6b2062ead84 tempest-GroupSnapshotsTest-1320333608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9d59b300-4865-4b2c-9315-c3edfa32038c" returned: 0 in 1.473s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:01 devstack cinder-volume[86891]: DEBUG cinder.image.image_utils [None req-90b5431b-d885-4601-8e5e-b6b2062ead84 tempest-GroupSnapshotsTest-1320333608 None] Image conversion details: src /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9d59b300-4865-4b2c-9315-c3edfa32038c, size 1024.00 MB, duration 7.05 sec, destination /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-29ed97cd-cfe9-4712-ad69-e35d0afbb3d2 {{(pid=86891) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 03 01:11:01 devstack cinder-volume[86891]: INFO cinder.image.image_utils [None req-90b5431b-d885-4601-8e5e-b6b2062ead84 tempest-GroupSnapshotsTest-1320333608 None] Converted 1024.00 MB image at 145.26 MB/s
Jul 03 01:11:01 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-90b5431b-d885-4601-8e5e-b6b2062ead84 tempest-GroupSnapshotsTest-1320333608 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-29ed97cd-cfe9-4712-ad69-e35d0afbb3d2 is being set with open permissions: ugo+rw: NotImplementedError
Jul 03 01:11:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-90b5431b-d885-4601-8e5e-b6b2062ead84 tempest-GroupSnapshotsTest-1320333608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-29ed97cd-cfe9-4712-ad69-e35d0afbb3d2 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:01 devstack sudo[95568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-29ed97cd-cfe9-4712-ad69-e35d0afbb3d2
Jul 03 01:11:01 devstack sudo[95568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:01 devstack cinder-volume[86891]: DEBUG oslo_service.periodic_task [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86891) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 01:11:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:11:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:11:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:11:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:11:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:11:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:01 devstack sudo[95570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:11:01 devstack sudo[95570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:02 devstack sudo[95568]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-90b5431b-d885-4601-8e5e-b6b2062ead84 tempest-GroupSnapshotsTest-1320333608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-29ed97cd-cfe9-4712-ad69-e35d0afbb3d2" returned: 0 in 1.080s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:02 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-90b5431b-d885-4601-8e5e-b6b2062ead84 tempest-GroupSnapshotsTest-1320333608 None] Lock "cinder-quobyte-29ed97cd-cfe9-4712-ad69-e35d0afbb3d2" released by "_copy_volume_from_snapshot" :: held 11.625s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:11:02 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-90b5431b-d885-4601-8e5e-b6b2062ead84 tempest-GroupSnapshotsTest-1320333608 None] Lock "cinder-quobyte-fb8f97bc-dbca-4a7a-ac25-d685e012536f-29ed97cd-cfe9-4712-ad69-e35d0afbb3d2" released by "_create_volume_from_snapshot" :: held 11.666s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:11:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-90b5431b-d885-4601-8e5e-b6b2062ead84 tempest-GroupSnapshotsTest-1320333608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.687s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:11:02 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-90b5431b-d885-4601-8e5e-b6b2062ead84 tempest-GroupSnapshotsTest-1320333608 None] Create group from source-snapshot-ca6a7c33-e8eb-437c-bfb0-c662b12422ea completed successfully.
Jul 03 01:11:02 devstack sudo[95570]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 1.030s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:02 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:11:02 devstack cinder-volume[86891]: DEBUG oslo_service.periodic_task [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running periodic task VolumeManager._thread_info {{(pid=86891) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 01:11:02 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] thread count: 28 {{(pid=86891) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 01:11:02 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] thread info: [<_MainThread(MainThread, started 136731296534656)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136731184953280)>, <Thread(Thread-3 (stat_writer), started daemon 136731184058816)>, <Thread(Rabbit-heartbeat, started daemon 136731184846080)>, <Thread(Thread-5 (_runner), started daemon 136731182936576)>, <Thread(Thread-7 (_runner), started daemon 136731182954944)>, <Thread(fd_logger, started daemon 136731181916416)>, <Thread(privsep_reader, started daemon 136731180942208)>, <Thread(tpool_thread_0, started daemon 136731172161216)>, <Thread(tpool_thread_1, started daemon 136731163768512)>, <Thread(tpool_thread_2, started daemon 136731155375808)>, <Thread(tpool_thread_3, started daemon 136731146983104)>, <Thread(tpool_thread_4, started daemon 136731138590400)>, <Thread(tpool_thread_5, started daemon 136731130197696)>, <Thread(tpool_thread_6, started daemon 136731121804992)>, <Thread(tpool_thread_7, started daemon 136731113412288)>, <Thread(tpool_thread_8, started daemon 136731105003200)>, <Thread(tpool_thread_9, started daemon 136731096594112)>, <Thread(tpool_thread_10, started daemon 136731088185024)>, <Thread(tpool_thread_11, started daemon 136731079775936)>, <Thread(tpool_thread_12, started daemon 136731071366848)>, <Thread(tpool_thread_13, started daemon 136731062957760)>, <Thread(tpool_thread_14, started daemon 136731054548672)>, <Thread(tpool_thread_15, started daemon 136731046139584)>, <Thread(tpool_thread_16, started daemon 136731037730496)>, <Thread(tpool_thread_17, started daemon 136731029321408)>, <Thread(tpool_thread_18, started daemon 136731020912320)>, <Thread(tpool_thread_19, started daemon 136731012503232)>] {{(pid=86891) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 01:11:04 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-64d34582-09ab-495d-a691-6e0c9158b12e tempest-GroupSnapshotsTest-1320333608 None] Acquiring lock "cinder-quobyte-29ed97cd-cfe9-4712-ad69-e35d0afbb3d2" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:11:04 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-64d34582-09ab-495d-a691-6e0c9158b12e tempest-GroupSnapshotsTest-1320333608 None] Lock "cinder-quobyte-29ed97cd-cfe9-4712-ad69-e35d0afbb3d2" acquired by "delete_volume" :: waited 0.027s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:11:04 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3d5d39-ec01-44ae-9d32-320a3b9d185a]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:11:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-64d34582-09ab-495d-a691-6e0c9158b12e tempest-GroupSnapshotsTest-1320333608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-29ed97cd-cfe9-4712-ad69-e35d0afbb3d2 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:04 devstack sudo[95574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-29ed97cd-cfe9-4712-ad69-e35d0afbb3d2
Jul 03 01:11:04 devstack sudo[95574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:04 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-77ff16ce-db72-4172-b9e3-32719ea6b90f tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:11:04 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-77ff16ce-db72-4172-b9e3-32719ea6b90f tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Flow 'volume_create_manager' (ab620563-0e27-4bdf-ac96-62a493c9bc02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:11:04 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-77ff16ce-db72-4172-b9e3-32719ea6b90f tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3e2ee31-f24c-4f38-8d16-8a3c31d16dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:11:04 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-77ff16ce-db72-4172-b9e3-32719ea6b90f tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3e2ee31-f24c-4f38-8d16-8a3c31d16dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:11:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-331942288',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3988a0d8-8d22-4c82-8db0-604687679aa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='386085c6d81a4833a338ea1e9d0dedff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:11:05Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:11:05Z,use_quota=True,user_id='bd8728889aeb42789f5952d1dba123f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:11:04 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-77ff16ce-db72-4172-b9e3-32719ea6b90f tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (291c1e6a-d5f4-4b73-bdc1-f9ccb3a4f2c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:11:04 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-77ff16ce-db72-4172-b9e3-32719ea6b90f tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (291c1e6a-d5f4-4b73-bdc1-f9ccb3a4f2c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:11:04 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-77ff16ce-db72-4172-b9e3-32719ea6b90f tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0991d0fc-061e-4616-91d5-0cdca91a36c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:11:04 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-77ff16ce-db72-4172-b9e3-32719ea6b90f tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0991d0fc-061e-4616-91d5-0cdca91a36c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3988a0d8-8d22-4c82-8db0-604687679aa5', 'volume_name': 'volume-3988a0d8-8d22-4c82-8db0-604687679aa5', 'volume_size': 2}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:11:04 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-77ff16ce-db72-4172-b9e3-32719ea6b90f tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66278f7d-785e-40d6-920a-50b2acd69506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:11:04 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-77ff16ce-db72-4172-b9e3-32719ea6b90f tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66278f7d-785e-40d6-920a-50b2acd69506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:11:04 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-77ff16ce-db72-4172-b9e3-32719ea6b90f tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79816cec-4835-4569-8ed4-2bbc511eb414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:11:04 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-77ff16ce-db72-4172-b9e3-32719ea6b90f tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Volume 3988a0d8-8d22-4c82-8db0-604687679aa5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3988a0d8-8d22-4c82-8db0-604687679aa5', 'volume_size': 2}
Jul 03 01:11:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-77ff16ce-db72-4172-b9e3-32719ea6b90f tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:11:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-77ff16ce-db72-4172-b9e3-32719ea6b90f tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:11:04 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-77ff16ce-db72-4172-b9e3-32719ea6b90f tempest-VolumesSnapshotNegativeTestJSON-922751671 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:11:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-331942288',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3988a0d8-8d22-4c82-8db0-604687679aa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='386085c6d81a4833a338ea1e9d0dedff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:11:05Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:11:05Z,use_quota=True,user_id='bd8728889aeb42789f5952d1dba123f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:11:04 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-77ff16ce-db72-4172-b9e3-32719ea6b90f tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Creating volume 3988a0d8-8d22-4c82-8db0-604687679aa5 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:11:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-77ff16ce-db72-4172-b9e3-32719ea6b90f tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:11:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-77ff16ce-db72-4172-b9e3-32719ea6b90f tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:11:04 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-77ff16ce-db72-4172-b9e3-32719ea6b90f tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:11:04 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-77ff16ce-db72-4172-b9e3-32719ea6b90f tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:11:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-77ff16ce-db72-4172-b9e3-32719ea6b90f tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:11:04 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-77ff16ce-db72-4172-b9e3-32719ea6b90f tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:11:04 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-77ff16ce-db72-4172-b9e3-32719ea6b90f tempest-VolumesSnapshotNegativeTestJSON-922751671 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:11:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-77ff16ce-db72-4172-b9e3-32719ea6b90f tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3988a0d8-8d22-4c82-8db0-604687679aa5 2147483648 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:04 devstack sudo[95576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3988a0d8-8d22-4c82-8db0-604687679aa5 2147483648
Jul 03 01:11:04 devstack sudo[95576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:05 devstack sudo[95574]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:05 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-64d34582-09ab-495d-a691-6e0c9158b12e tempest-GroupSnapshotsTest-1320333608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-29ed97cd-cfe9-4712-ad69-e35d0afbb3d2" returned: 0 in 0.941s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:05 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-64d34582-09ab-495d-a691-6e0c9158b12e tempest-GroupSnapshotsTest-1320333608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-29ed97cd-cfe9-4712-ad69-e35d0afbb3d2 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:05 devstack sudo[95581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-29ed97cd-cfe9-4712-ad69-e35d0afbb3d2
Jul 03 01:11:05 devstack sudo[95581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:05 devstack sudo[95576]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:05 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-77ff16ce-db72-4172-b9e3-32719ea6b90f tempest-VolumesSnapshotNegativeTestJSON-922751671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3988a0d8-8d22-4c82-8db0-604687679aa5 2147483648" returned: 0 in 1.019s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-77ff16ce-db72-4172-b9e3-32719ea6b90f tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3988a0d8-8d22-4c82-8db0-604687679aa5 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:06 devstack sudo[95588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3988a0d8-8d22-4c82-8db0-604687679aa5
Jul 03 01:11:06 devstack sudo[95588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:06 devstack sudo[95581]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-64d34582-09ab-495d-a691-6e0c9158b12e tempest-GroupSnapshotsTest-1320333608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-29ed97cd-cfe9-4712-ad69-e35d0afbb3d2" returned: 0 in 0.814s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:06 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-64d34582-09ab-495d-a691-6e0c9158b12e tempest-GroupSnapshotsTest-1320333608 None] Lock "cinder-quobyte-29ed97cd-cfe9-4712-ad69-e35d0afbb3d2" released by "delete_volume" :: held 1.813s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:11:06 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-64d34582-09ab-495d-a691-6e0c9158b12e tempest-GroupSnapshotsTest-1320333608 None] Created reservations ['7438bbd1-4068-4d04-aa0e-2c0cb7e839a6'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:11:06 devstack cinder-volume[86891]: WARNING cinder.quota [None req-64d34582-09ab-495d-a691-6e0c9158b12e tempest-GroupSnapshotsTest-1320333608 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1926851449 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1926851449, it is now deprecated. Please use the default quota class for default quota.
Jul 03 01:11:06 devstack cinder-volume[86891]: WARNING cinder.quota [None req-64d34582-09ab-495d-a691-6e0c9158b12e tempest-GroupSnapshotsTest-1320333608 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1926851449 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1926851449, it is now deprecated. Please use the default quota class for default quota.
Jul 03 01:11:06 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-64d34582-09ab-495d-a691-6e0c9158b12e tempest-GroupSnapshotsTest-1320333608 None] Created reservations ['b7f8ba44-2bce-4091-8aea-c468ee51bf54', 'fee581a6-0e93-4d62-a82a-94b58078d503', '190a36cd-0efe-4483-898e-061b452f759e', '55c12089-ba6b-4562-968f-05d7cfbac591'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:11:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-64d34582-09ab-495d-a691-6e0c9158b12e tempest-GroupSnapshotsTest-1320333608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:11:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-64d34582-09ab-495d-a691-6e0c9158b12e tempest-GroupSnapshotsTest-1320333608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:11:06 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-64d34582-09ab-495d-a691-6e0c9158b12e tempest-GroupSnapshotsTest-1320333608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:11:06 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-64d34582-09ab-495d-a691-6e0c9158b12e tempest-GroupSnapshotsTest-1320333608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:11:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-64d34582-09ab-495d-a691-6e0c9158b12e tempest-GroupSnapshotsTest-1320333608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:11:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-64d34582-09ab-495d-a691-6e0c9158b12e tempest-GroupSnapshotsTest-1320333608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:06 devstack sudo[95590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:11:06 devstack sudo[95590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:06 devstack sudo[95588]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-77ff16ce-db72-4172-b9e3-32719ea6b90f tempest-VolumesSnapshotNegativeTestJSON-922751671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3988a0d8-8d22-4c82-8db0-604687679aa5" returned: 0 in 0.800s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:06 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-77ff16ce-db72-4172-b9e3-32719ea6b90f tempest-VolumesSnapshotNegativeTestJSON-922751671 None] <== create_volume: return (1904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:11:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-77ff16ce-db72-4172-b9e3-32719ea6b90f tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.906s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:11:06 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-77ff16ce-db72-4172-b9e3-32719ea6b90f tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79816cec-4835-4569-8ed4-2bbc511eb414) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3988a0d8-8d22-4c82-8db0-604687679aa5', 'volume_size': 2}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:11:06 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-77ff16ce-db72-4172-b9e3-32719ea6b90f tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96d71910-adea-431b-aa73-294011e16f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:11:06 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-77ff16ce-db72-4172-b9e3-32719ea6b90f tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Volume volume-3988a0d8-8d22-4c82-8db0-604687679aa5 (3988a0d8-8d22-4c82-8db0-604687679aa5): created successfully
Jul 03 01:11:06 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-77ff16ce-db72-4172-b9e3-32719ea6b90f tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96d71910-adea-431b-aa73-294011e16f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:11:06 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-77ff16ce-db72-4172-b9e3-32719ea6b90f tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Flow 'volume_create_manager' (ab620563-0e27-4bdf-ac96-62a493c9bc02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:11:06 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-77ff16ce-db72-4172-b9e3-32719ea6b90f tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Created volume successfully.
Jul 03 01:11:06 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-31f1ec73-bce1-4b19-8367-368ce6fb5ed1 tempest-GroupSnapshotsTest-1320333608 None] group_snapshot ca6a7c33-e8eb-437c-bfb0-c662b12422ea: deleting
Jul 03 01:11:07 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-31f1ec73-bce1-4b19-8367-368ce6fb5ed1 tempest-GroupSnapshotsTest-1320333608 None] group_snapshot ca6a7c33-e8eb-437c-bfb0-c662b12422ea: deleting {{(pid=86891) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 03 01:11:07 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-31f1ec73-bce1-4b19-8367-368ce6fb5ed1 tempest-GroupSnapshotsTest-1320333608 None] Acquiring lock "cinder-quobyte-9d59b300-4865-4b2c-9315-c3edfa32038c" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:11:07 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-31f1ec73-bce1-4b19-8367-368ce6fb5ed1 tempest-GroupSnapshotsTest-1320333608 None] Lock "cinder-quobyte-9d59b300-4865-4b2c-9315-c3edfa32038c" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:11:07 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-31f1ec73-bce1-4b19-8367-368ce6fb5ed1 tempest-GroupSnapshotsTest-1320333608 None] Acquiring lock "cinder-quobyte-fb8f97bc-dbca-4a7a-ac25-d685e012536f" by "_delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:11:07 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-31f1ec73-bce1-4b19-8367-368ce6fb5ed1 tempest-GroupSnapshotsTest-1320333608 None] Lock "cinder-quobyte-fb8f97bc-dbca-4a7a-ac25-d685e012536f" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:11:07 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-31f1ec73-bce1-4b19-8367-368ce6fb5ed1 tempest-GroupSnapshotsTest-1320333608 None] Deleting offline snapshot fb8f97bc-dbca-4a7a-ac25-d685e012536f of volume 9d59b300-4865-4b2c-9315-c3edfa32038c {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 01:11:07 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-31f1ec73-bce1-4b19-8367-368ce6fb5ed1 tempest-GroupSnapshotsTest-1320333608 None] snapshot_file for this snap is: volume-9d59b300-4865-4b2c-9315-c3edfa32038c.fb8f97bc-dbca-4a7a-ac25-d685e012536f {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 01:11:07 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f785c4d-afcd-4388-93d3-f808158bc57d]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:11:07 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-31f1ec73-bce1-4b19-8367-368ce6fb5ed1 tempest-GroupSnapshotsTest-1320333608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9d59b300-4865-4b2c-9315-c3edfa32038c.fb8f97bc-dbca-4a7a-ac25-d685e012536f {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:07 devstack sudo[95590]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:07 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-64d34582-09ab-495d-a691-6e0c9158b12e tempest-GroupSnapshotsTest-1320333608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.902s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:07 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-64d34582-09ab-495d-a691-6e0c9158b12e tempest-GroupSnapshotsTest-1320333608 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:11:07 devstack sudo[95593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9d59b300-4865-4b2c-9315-c3edfa32038c.fb8f97bc-dbca-4a7a-ac25-d685e012536f
Jul 03 01:11:07 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-64d34582-09ab-495d-a691-6e0c9158b12e tempest-GroupSnapshotsTest-1320333608 None] Delete group completed successfully.
Jul 03 01:11:07 devstack sudo[95593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:08 devstack sudo[95593]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:08 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-31f1ec73-bce1-4b19-8367-368ce6fb5ed1 tempest-GroupSnapshotsTest-1320333608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9d59b300-4865-4b2c-9315-c3edfa32038c.fb8f97bc-dbca-4a7a-ac25-d685e012536f" returned: 0 in 1.109s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:08 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-31f1ec73-bce1-4b19-8367-368ce6fb5ed1 tempest-GroupSnapshotsTest-1320333608 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d59b300-4865-4b2c-9315-c3edfa32038c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:11:08 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[821c680b-0902-4c18-abac-8b8cd3485cda]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:11:08 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-31f1ec73-bce1-4b19-8367-368ce6fb5ed1 tempest-GroupSnapshotsTest-1320333608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9d59b300-4865-4b2c-9315-c3edfa32038c {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:08 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a5164e92-a613-4f4a-81fa-1a6736d5ff50 tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:11:08 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a5164e92-a613-4f4a-81fa-1a6736d5ff50 tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:11:08 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-a5164e92-a613-4f4a-81fa-1a6736d5ff50 tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Creating offline snapshot d1378f0b-1990-4c95-806b-958ef3296707 of volume 3988a0d8-8d22-4c82-8db0-604687679aa5 {{(pid=86891) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 01:11:08 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[062e4c95-0383-456b-986f-9469f6f45a2b]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:11:08 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a5164e92-a613-4f4a-81fa-1a6736d5ff50 tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3988a0d8-8d22-4c82-8db0-604687679aa5 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:08 devstack sudo[95601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9d59b300-4865-4b2c-9315-c3edfa32038c
Jul 03 01:11:08 devstack sudo[95601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:08 devstack sudo[95602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3988a0d8-8d22-4c82-8db0-604687679aa5
Jul 03 01:11:08 devstack sudo[95602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:09 devstack sudo[95601]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-31f1ec73-bce1-4b19-8367-368ce6fb5ed1 tempest-GroupSnapshotsTest-1320333608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9d59b300-4865-4b2c-9315-c3edfa32038c" returned: 0 in 1.313s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-31f1ec73-bce1-4b19-8367-368ce6fb5ed1 tempest-GroupSnapshotsTest-1320333608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9d59b300-4865-4b2c-9315-c3edfa32038c.fb8f97bc-dbca-4a7a-ac25-d685e012536f {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:09 devstack sudo[95602]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a5164e92-a613-4f4a-81fa-1a6736d5ff50 tempest-VolumesSnapshotNegativeTestJSON-922751671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3988a0d8-8d22-4c82-8db0-604687679aa5" returned: 0 in 1.191s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a5164e92-a613-4f4a-81fa-1a6736d5ff50 tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3988a0d8-8d22-4c82-8db0-604687679aa5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3988a0d8-8d22-4c82-8db0-604687679aa5.d1378f0b-1990-4c95-806b-958ef3296707 2G {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:09 devstack sudo[95631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9d59b300-4865-4b2c-9315-c3edfa32038c.fb8f97bc-dbca-4a7a-ac25-d685e012536f
Jul 03 01:11:09 devstack sudo[95631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:09 devstack sudo[95632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3988a0d8-8d22-4c82-8db0-604687679aa5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3988a0d8-8d22-4c82-8db0-604687679aa5.d1378f0b-1990-4c95-806b-958ef3296707 2G
Jul 03 01:11:09 devstack sudo[95632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:10 devstack sudo[95631]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:10 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-31f1ec73-bce1-4b19-8367-368ce6fb5ed1 tempest-GroupSnapshotsTest-1320333608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9d59b300-4865-4b2c-9315-c3edfa32038c.fb8f97bc-dbca-4a7a-ac25-d685e012536f" returned: 0 in 0.895s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:10 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-31f1ec73-bce1-4b19-8367-368ce6fb5ed1 tempest-GroupSnapshotsTest-1320333608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9d59b300-4865-4b2c-9315-c3edfa32038c.fb8f97bc-dbca-4a7a-ac25-d685e012536f {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:10 devstack sudo[95643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9d59b300-4865-4b2c-9315-c3edfa32038c.fb8f97bc-dbca-4a7a-ac25-d685e012536f
Jul 03 01:11:10 devstack sudo[95643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:10 devstack sudo[95632]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:10 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a5164e92-a613-4f4a-81fa-1a6736d5ff50 tempest-VolumesSnapshotNegativeTestJSON-922751671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3988a0d8-8d22-4c82-8db0-604687679aa5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3988a0d8-8d22-4c82-8db0-604687679aa5.d1378f0b-1990-4c95-806b-958ef3296707 2G" returned: 0 in 0.997s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:10 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a5164e92-a613-4f4a-81fa-1a6736d5ff50 tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3988a0d8-8d22-4c82-8db0-604687679aa5 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3988a0d8-8d22-4c82-8db0-604687679aa5.d1378f0b-1990-4c95-806b-958ef3296707 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:10 devstack sudo[95645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3988a0d8-8d22-4c82-8db0-604687679aa5 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3988a0d8-8d22-4c82-8db0-604687679aa5.d1378f0b-1990-4c95-806b-958ef3296707
Jul 03 01:11:10 devstack sudo[95645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:11 devstack sudo[95643]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:11 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-31f1ec73-bce1-4b19-8367-368ce6fb5ed1 tempest-GroupSnapshotsTest-1320333608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9d59b300-4865-4b2c-9315-c3edfa32038c.fb8f97bc-dbca-4a7a-ac25-d685e012536f" returned: 0 in 0.737s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:11 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-31f1ec73-bce1-4b19-8367-368ce6fb5ed1 tempest-GroupSnapshotsTest-1320333608 None] Lock "cinder-quobyte-fb8f97bc-dbca-4a7a-ac25-d685e012536f" released by "_delete_snapshot" :: held 4.221s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:11:11 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-31f1ec73-bce1-4b19-8367-368ce6fb5ed1 tempest-GroupSnapshotsTest-1320333608 None] Lock "cinder-quobyte-9d59b300-4865-4b2c-9315-c3edfa32038c" released by "delete_snapshot" :: held 4.251s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:11:11 devstack cinder-volume[86891]: WARNING cinder.quota [None req-31f1ec73-bce1-4b19-8367-368ce6fb5ed1 tempest-GroupSnapshotsTest-1320333608 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1926851449 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1926851449, it is now deprecated. Please use the default quota class for default quota.
Jul 03 01:11:11 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-31f1ec73-bce1-4b19-8367-368ce6fb5ed1 tempest-GroupSnapshotsTest-1320333608 None] Created reservations ['dcfcdd38-90ed-440f-9816-9abef9659d74', '8cbc4014-6472-44d2-98e1-b5fb909d5040', '8d462b54-13e3-4033-b8f1-e503135d3b52', '8b320615-792d-4f84-b7d7-71d93ada72d9'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:11:11 devstack sudo[95645]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:11 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a5164e92-a613-4f4a-81fa-1a6736d5ff50 tempest-VolumesSnapshotNegativeTestJSON-922751671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3988a0d8-8d22-4c82-8db0-604687679aa5 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3988a0d8-8d22-4c82-8db0-604687679aa5.d1378f0b-1990-4c95-806b-958ef3296707" returned: 0 in 0.831s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:11 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-a5164e92-a613-4f4a-81fa-1a6736d5ff50 tempest-VolumesSnapshotNegativeTestJSON-922751671 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3988a0d8-8d22-4c82-8db0-604687679aa5.d1378f0b-1990-4c95-806b-958ef3296707 is being set with open permissions: ugo+rw
Jul 03 01:11:11 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a5164e92-a613-4f4a-81fa-1a6736d5ff50 tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3988a0d8-8d22-4c82-8db0-604687679aa5.d1378f0b-1990-4c95-806b-958ef3296707 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:11 devstack sudo[95652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3988a0d8-8d22-4c82-8db0-604687679aa5.d1378f0b-1990-4c95-806b-958ef3296707
Jul 03 01:11:11 devstack sudo[95652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:11 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-31f1ec73-bce1-4b19-8367-368ce6fb5ed1 tempest-GroupSnapshotsTest-1320333608 None] group_snapshot ca6a7c33-e8eb-437c-bfb0-c662b12422ea: deleted successfully
Jul 03 01:11:11 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-b6d513fd-4acf-424e-aa2f-c0e1be5e88d9 tempest-GroupSnapshotsTest-1320333608 None] Acquiring lock "cinder-quobyte-9d59b300-4865-4b2c-9315-c3edfa32038c" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:11:12 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-b6d513fd-4acf-424e-aa2f-c0e1be5e88d9 tempest-GroupSnapshotsTest-1320333608 None] Lock "cinder-quobyte-9d59b300-4865-4b2c-9315-c3edfa32038c" acquired by "delete_volume" :: waited 0.030s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:11:12 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[46bc04c3-aefc-4cde-983c-7d5e7c48902e]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:11:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b6d513fd-4acf-424e-aa2f-c0e1be5e88d9 tempest-GroupSnapshotsTest-1320333608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9d59b300-4865-4b2c-9315-c3edfa32038c {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:12 devstack sudo[95654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9d59b300-4865-4b2c-9315-c3edfa32038c
Jul 03 01:11:12 devstack sudo[95654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:12 devstack sudo[95652]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a5164e92-a613-4f4a-81fa-1a6736d5ff50 tempest-VolumesSnapshotNegativeTestJSON-922751671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3988a0d8-8d22-4c82-8db0-604687679aa5.d1378f0b-1990-4c95-806b-958ef3296707" returned: 0 in 0.833s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a5164e92-a613-4f4a-81fa-1a6736d5ff50 tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3988a0d8-8d22-4c82-8db0-604687679aa5.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:12 devstack sudo[95657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3988a0d8-8d22-4c82-8db0-604687679aa5.info
Jul 03 01:11:12 devstack sudo[95657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:12 devstack sudo[95654]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b6d513fd-4acf-424e-aa2f-c0e1be5e88d9 tempest-GroupSnapshotsTest-1320333608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9d59b300-4865-4b2c-9315-c3edfa32038c" returned: 0 in 0.923s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b6d513fd-4acf-424e-aa2f-c0e1be5e88d9 tempest-GroupSnapshotsTest-1320333608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9d59b300-4865-4b2c-9315-c3edfa32038c {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:13 devstack sudo[95662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9d59b300-4865-4b2c-9315-c3edfa32038c
Jul 03 01:11:13 devstack sudo[95662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:13 devstack sudo[95657]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a5164e92-a613-4f4a-81fa-1a6736d5ff50 tempest-VolumesSnapshotNegativeTestJSON-922751671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3988a0d8-8d22-4c82-8db0-604687679aa5.info" returned: 0 in 0.748s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:13 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-a5164e92-a613-4f4a-81fa-1a6736d5ff50 tempest-VolumesSnapshotNegativeTestJSON-922751671 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3988a0d8-8d22-4c82-8db0-604687679aa5.info is being set with open permissions: ugo+rw
Jul 03 01:11:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a5164e92-a613-4f4a-81fa-1a6736d5ff50 tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3988a0d8-8d22-4c82-8db0-604687679aa5.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:13 devstack sudo[95665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3988a0d8-8d22-4c82-8db0-604687679aa5.info
Jul 03 01:11:13 devstack sudo[95665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:13 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e0300b0-6fcc-4823-ba3e-17cf0abe5b36 tempest-VolumeQuotasNegativeTestJSON-669291124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:11:13 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-6e0300b0-6fcc-4823-ba3e-17cf0abe5b36 tempest-VolumeQuotasNegativeTestJSON-669291124 None] Flow 'volume_create_manager' (8d1a48ac-c571-44c5-9c09-87e673a8b326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:11:13 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-6e0300b0-6fcc-4823-ba3e-17cf0abe5b36 tempest-VolumeQuotasNegativeTestJSON-669291124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (357a8b94-df6f-433c-92db-fb1d33268674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:11:13 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-6e0300b0-6fcc-4823-ba3e-17cf0abe5b36 tempest-VolumeQuotasNegativeTestJSON-669291124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (357a8b94-df6f-433c-92db-fb1d33268674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:11:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1259351033',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfbf823e-a910-4e53-bebe-b1c42d9503cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e0cc89513c84e7fb808796798c3573e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:11:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:11:14Z,use_quota=True,user_id='8c77fa902b134974955223ae87f2e0b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:11:13 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-6e0300b0-6fcc-4823-ba3e-17cf0abe5b36 tempest-VolumeQuotasNegativeTestJSON-669291124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13b97a54-cc8f-48bc-80ff-f5f39ebbcb37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:11:13 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-6e0300b0-6fcc-4823-ba3e-17cf0abe5b36 tempest-VolumeQuotasNegativeTestJSON-669291124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13b97a54-cc8f-48bc-80ff-f5f39ebbcb37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:11:13 devstack sudo[95662]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:13 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-6e0300b0-6fcc-4823-ba3e-17cf0abe5b36 tempest-VolumeQuotasNegativeTestJSON-669291124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0530372c-5bc8-4ed7-a15a-f59f6ad46db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:11:13 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-6e0300b0-6fcc-4823-ba3e-17cf0abe5b36 tempest-VolumeQuotasNegativeTestJSON-669291124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0530372c-5bc8-4ed7-a15a-f59f6ad46db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfbf823e-a910-4e53-bebe-b1c42d9503cf', 'volume_name': 'volume-cfbf823e-a910-4e53-bebe-b1c42d9503cf', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:11:13 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-6e0300b0-6fcc-4823-ba3e-17cf0abe5b36 tempest-VolumeQuotasNegativeTestJSON-669291124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cdfc949-b9c7-4063-aaa8-17fb881fbb88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:11:13 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-6e0300b0-6fcc-4823-ba3e-17cf0abe5b36 tempest-VolumeQuotasNegativeTestJSON-669291124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cdfc949-b9c7-4063-aaa8-17fb881fbb88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:11:13 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-6e0300b0-6fcc-4823-ba3e-17cf0abe5b36 tempest-VolumeQuotasNegativeTestJSON-669291124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba8e588d-b477-414f-b9a3-c9c9388003cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:11:13 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-6e0300b0-6fcc-4823-ba3e-17cf0abe5b36 tempest-VolumeQuotasNegativeTestJSON-669291124 None] Volume cfbf823e-a910-4e53-bebe-b1c42d9503cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfbf823e-a910-4e53-bebe-b1c42d9503cf', 'volume_size': 1}
Jul 03 01:11:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-6e0300b0-6fcc-4823-ba3e-17cf0abe5b36 tempest-VolumeQuotasNegativeTestJSON-669291124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:11:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b6d513fd-4acf-424e-aa2f-c0e1be5e88d9 tempest-GroupSnapshotsTest-1320333608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9d59b300-4865-4b2c-9315-c3edfa32038c" returned: 0 in 0.854s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:13 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-b6d513fd-4acf-424e-aa2f-c0e1be5e88d9 tempest-GroupSnapshotsTest-1320333608 None] Lock "cinder-quobyte-9d59b300-4865-4b2c-9315-c3edfa32038c" released by "delete_volume" :: held 1.865s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:11:13 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-b6d513fd-4acf-424e-aa2f-c0e1be5e88d9 tempest-GroupSnapshotsTest-1320333608 None] Created reservations ['0933a73f-b382-4b22-9f9c-96b04e1aa7ef'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:11:13 devstack cinder-volume[86891]: WARNING cinder.db.api [None req-b6d513fd-4acf-424e-aa2f-c0e1be5e88d9 tempest-GroupSnapshotsTest-1320333608 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1926851449']
Jul 03 01:11:13 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-b6d513fd-4acf-424e-aa2f-c0e1be5e88d9 tempest-GroupSnapshotsTest-1320333608 None] Created reservations ['a58a5770-e5ac-4e2c-ba4e-14a91b584525', '88cc7b3a-2bef-44b8-a8cd-74af487fac8f', '1a20a5e7-7aa0-42c4-ab92-c6d5ab49599d', 'b7fef59a-42ff-46dc-b604-2b81c4327392'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:11:14 devstack sudo[95665]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a5164e92-a613-4f4a-81fa-1a6736d5ff50 tempest-VolumesSnapshotNegativeTestJSON-922751671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3988a0d8-8d22-4c82-8db0-604687679aa5.info" returned: 0 in 0.836s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a5164e92-a613-4f4a-81fa-1a6736d5ff50 tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.599s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:11:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-6e0300b0-6fcc-4823-ba3e-17cf0abe5b36 tempest-VolumeQuotasNegativeTestJSON-669291124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.178s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:11:14 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-6e0300b0-6fcc-4823-ba3e-17cf0abe5b36 tempest-VolumeQuotasNegativeTestJSON-669291124 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:11:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1259351033',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfbf823e-a910-4e53-bebe-b1c42d9503cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e0cc89513c84e7fb808796798c3573e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:11:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:11:14Z,use_quota=True,user_id='8c77fa902b134974955223ae87f2e0b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:11:14 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-6e0300b0-6fcc-4823-ba3e-17cf0abe5b36 tempest-VolumeQuotasNegativeTestJSON-669291124 None] Creating volume cfbf823e-a910-4e53-bebe-b1c42d9503cf {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:11:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-6e0300b0-6fcc-4823-ba3e-17cf0abe5b36 tempest-VolumeQuotasNegativeTestJSON-669291124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:11:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-6e0300b0-6fcc-4823-ba3e-17cf0abe5b36 tempest-VolumeQuotasNegativeTestJSON-669291124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:11:14 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-6e0300b0-6fcc-4823-ba3e-17cf0abe5b36 tempest-VolumeQuotasNegativeTestJSON-669291124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:11:14 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-6e0300b0-6fcc-4823-ba3e-17cf0abe5b36 tempest-VolumeQuotasNegativeTestJSON-669291124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:11:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-6e0300b0-6fcc-4823-ba3e-17cf0abe5b36 tempest-VolumeQuotasNegativeTestJSON-669291124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:11:14 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-6e0300b0-6fcc-4823-ba3e-17cf0abe5b36 tempest-VolumeQuotasNegativeTestJSON-669291124 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:11:14 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-6e0300b0-6fcc-4823-ba3e-17cf0abe5b36 tempest-VolumeQuotasNegativeTestJSON-669291124 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:11:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6e0300b0-6fcc-4823-ba3e-17cf0abe5b36 tempest-VolumeQuotasNegativeTestJSON-669291124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cfbf823e-a910-4e53-bebe-b1c42d9503cf 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:14 devstack sudo[95672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cfbf823e-a910-4e53-bebe-b1c42d9503cf 1073741824
Jul 03 01:11:14 devstack sudo[95672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:14 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-a5164e92-a613-4f4a-81fa-1a6736d5ff50 tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Create snapshot completed successfully
Jul 03 01:11:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b6d513fd-4acf-424e-aa2f-c0e1be5e88d9 tempest-GroupSnapshotsTest-1320333608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:11:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b6d513fd-4acf-424e-aa2f-c0e1be5e88d9 tempest-GroupSnapshotsTest-1320333608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:11:14 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-b6d513fd-4acf-424e-aa2f-c0e1be5e88d9 tempest-GroupSnapshotsTest-1320333608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:11:14 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-b6d513fd-4acf-424e-aa2f-c0e1be5e88d9 tempest-GroupSnapshotsTest-1320333608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:11:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b6d513fd-4acf-424e-aa2f-c0e1be5e88d9 tempest-GroupSnapshotsTest-1320333608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:11:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b6d513fd-4acf-424e-aa2f-c0e1be5e88d9 tempest-GroupSnapshotsTest-1320333608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:14 devstack sudo[95674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:11:14 devstack sudo[95674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:14 devstack sudo[95674]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b6d513fd-4acf-424e-aa2f-c0e1be5e88d9 tempest-GroupSnapshotsTest-1320333608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.784s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:14 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-b6d513fd-4acf-424e-aa2f-c0e1be5e88d9 tempest-GroupSnapshotsTest-1320333608 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:11:14 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-b6d513fd-4acf-424e-aa2f-c0e1be5e88d9 tempest-GroupSnapshotsTest-1320333608 None] Delete group completed successfully.
Jul 03 01:11:14 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-77a5e753-b267-4b62-b578-5ebd33d1e949 tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Acquiring lock "cinder-d1378f0b-1990-4c95-806b-958ef3296707-delete_snapshot" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:11:14 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-a11b4898-ec2f-449f-995c-42a1a5f3efe8 tempest-GroupSnapshotsTest-1320333608 None] Group tempest-GroupSnapshotsTest-Group-1007770002: creating
Jul 03 01:11:14 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-77a5e753-b267-4b62-b578-5ebd33d1e949 tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Lock "cinder-d1378f0b-1990-4c95-806b-958ef3296707-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:11:14 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-77a5e753-b267-4b62-b578-5ebd33d1e949 tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Acquiring lock "cinder-quobyte-3988a0d8-8d22-4c82-8db0-604687679aa5" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:11:15 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-a11b4898-ec2f-449f-995c-42a1a5f3efe8 tempest-GroupSnapshotsTest-1320333608 None] Group tempest-GroupSnapshotsTest-Group-1007770002: created successfully
Jul 03 01:11:15 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-77a5e753-b267-4b62-b578-5ebd33d1e949 tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Lock "cinder-quobyte-3988a0d8-8d22-4c82-8db0-604687679aa5" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:11:15 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-77a5e753-b267-4b62-b578-5ebd33d1e949 tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Acquiring lock "cinder-quobyte-d1378f0b-1990-4c95-806b-958ef3296707" by "_delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:11:15 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-a11b4898-ec2f-449f-995c-42a1a5f3efe8 tempest-GroupSnapshotsTest-1320333608 None] Create group completed successfully.
Jul 03 01:11:15 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-77a5e753-b267-4b62-b578-5ebd33d1e949 tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Lock "cinder-quobyte-d1378f0b-1990-4c95-806b-958ef3296707" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:11:15 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-77a5e753-b267-4b62-b578-5ebd33d1e949 tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Deleting offline snapshot d1378f0b-1990-4c95-806b-958ef3296707 of volume 3988a0d8-8d22-4c82-8db0-604687679aa5 {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 01:11:15 devstack sudo[95672]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:15 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-77a5e753-b267-4b62-b578-5ebd33d1e949 tempest-VolumesSnapshotNegativeTestJSON-922751671 None] snapshot_file for this snap is: volume-3988a0d8-8d22-4c82-8db0-604687679aa5.d1378f0b-1990-4c95-806b-958ef3296707 {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 01:11:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6e0300b0-6fcc-4823-ba3e-17cf0abe5b36 tempest-VolumeQuotasNegativeTestJSON-669291124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cfbf823e-a910-4e53-bebe-b1c42d9503cf 1073741824" returned: 0 in 1.108s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:15 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[76413577-b515-4fae-b527-9cd679ca150b]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:11:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-77a5e753-b267-4b62-b578-5ebd33d1e949 tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3988a0d8-8d22-4c82-8db0-604687679aa5.d1378f0b-1990-4c95-806b-958ef3296707 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6e0300b0-6fcc-4823-ba3e-17cf0abe5b36 tempest-VolumeQuotasNegativeTestJSON-669291124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cfbf823e-a910-4e53-bebe-b1c42d9503cf {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:15 devstack sudo[95705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cfbf823e-a910-4e53-bebe-b1c42d9503cf
Jul 03 01:11:15 devstack sudo[95705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:15 devstack sudo[95701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3988a0d8-8d22-4c82-8db0-604687679aa5.d1378f0b-1990-4c95-806b-958ef3296707
Jul 03 01:11:15 devstack sudo[95701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:16 devstack sudo[95705]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6e0300b0-6fcc-4823-ba3e-17cf0abe5b36 tempest-VolumeQuotasNegativeTestJSON-669291124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cfbf823e-a910-4e53-bebe-b1c42d9503cf" returned: 0 in 1.035s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:16 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-6e0300b0-6fcc-4823-ba3e-17cf0abe5b36 tempest-VolumeQuotasNegativeTestJSON-669291124 None] <== create_volume: return (2233ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:11:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-6e0300b0-6fcc-4823-ba3e-17cf0abe5b36 tempest-VolumeQuotasNegativeTestJSON-669291124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.239s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:11:16 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-6e0300b0-6fcc-4823-ba3e-17cf0abe5b36 tempest-VolumeQuotasNegativeTestJSON-669291124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba8e588d-b477-414f-b9a3-c9c9388003cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfbf823e-a910-4e53-bebe-b1c42d9503cf', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:11:16 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-6e0300b0-6fcc-4823-ba3e-17cf0abe5b36 tempest-VolumeQuotasNegativeTestJSON-669291124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3ec459b-ac60-41be-9225-8b97b233ea21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:11:16 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-6e0300b0-6fcc-4823-ba3e-17cf0abe5b36 tempest-VolumeQuotasNegativeTestJSON-669291124 None] Volume volume-cfbf823e-a910-4e53-bebe-b1c42d9503cf (cfbf823e-a910-4e53-bebe-b1c42d9503cf): created successfully
Jul 03 01:11:16 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-6e0300b0-6fcc-4823-ba3e-17cf0abe5b36 tempest-VolumeQuotasNegativeTestJSON-669291124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3ec459b-ac60-41be-9225-8b97b233ea21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:11:16 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-6e0300b0-6fcc-4823-ba3e-17cf0abe5b36 tempest-VolumeQuotasNegativeTestJSON-669291124 None] Flow 'volume_create_manager' (8d1a48ac-c571-44c5-9c09-87e673a8b326) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:11:16 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-6e0300b0-6fcc-4823-ba3e-17cf0abe5b36 tempest-VolumeQuotasNegativeTestJSON-669291124 None] Created volume successfully.
Jul 03 01:11:16 devstack sudo[95701]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-77a5e753-b267-4b62-b578-5ebd33d1e949 tempest-VolumesSnapshotNegativeTestJSON-922751671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3988a0d8-8d22-4c82-8db0-604687679aa5.d1378f0b-1990-4c95-806b-958ef3296707" returned: 0 in 1.518s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:16 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-77a5e753-b267-4b62-b578-5ebd33d1e949 tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3988a0d8-8d22-4c82-8db0-604687679aa5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:11:16 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dbd34fd-9dc4-4688-9423-e3488377263d]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:11:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-77a5e753-b267-4b62-b578-5ebd33d1e949 tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3988a0d8-8d22-4c82-8db0-604687679aa5 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:16 devstack sudo[95758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3988a0d8-8d22-4c82-8db0-604687679aa5
Jul 03 01:11:16 devstack sudo[95758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:16 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-1833a677-01ab-415f-aeef-02b8cb01409a tempest-GroupSnapshotsTest-1320333608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:11:16 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1833a677-01ab-415f-aeef-02b8cb01409a tempest-GroupSnapshotsTest-1320333608 None] Flow 'volume_create_manager' (e08d8a85-8ec4-448d-a5a7-e546023d7f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:11:16 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1833a677-01ab-415f-aeef-02b8cb01409a tempest-GroupSnapshotsTest-1320333608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf15b9ca-1574-4dc7-849d-83d331efab5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:11:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1833a677-01ab-415f-aeef-02b8cb01409a tempest-GroupSnapshotsTest-1320333608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf15b9ca-1574-4dc7-849d-83d331efab5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:11:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1241464333',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=41c837f3-3064-42ef-a990-74734704e8ed,host='devstack@QuobyteHD#QuobyteHD',id=4bd4b78b-d55a-4130-8d5d-1c0a57551f57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='605b15a8b401420c832ed398e7a562bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:11:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:11:17Z,use_quota=True,user_id='aee26ffd1cc24952b7327629329664f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b20456c0-5671-476a-9a77-ece364938c8b),volume_type_id=b20456c0-5671-476a-9a77-ece364938c8b)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:11:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1833a677-01ab-415f-aeef-02b8cb01409a tempest-GroupSnapshotsTest-1320333608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (747fff2f-337b-4fad-ae19-4143939439bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:11:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1833a677-01ab-415f-aeef-02b8cb01409a tempest-GroupSnapshotsTest-1320333608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (747fff2f-337b-4fad-ae19-4143939439bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:11:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1833a677-01ab-415f-aeef-02b8cb01409a tempest-GroupSnapshotsTest-1320333608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b03e219-7bd1-42b9-8691-73966dc1356a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:11:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1833a677-01ab-415f-aeef-02b8cb01409a tempest-GroupSnapshotsTest-1320333608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b03e219-7bd1-42b9-8691-73966dc1356a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bd4b78b-d55a-4130-8d5d-1c0a57551f57', 'volume_name': 'volume-4bd4b78b-d55a-4130-8d5d-1c0a57551f57', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:11:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1833a677-01ab-415f-aeef-02b8cb01409a tempest-GroupSnapshotsTest-1320333608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51fc9991-ac88-4f2a-a7a7-5b1463d7efdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:11:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1833a677-01ab-415f-aeef-02b8cb01409a tempest-GroupSnapshotsTest-1320333608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51fc9991-ac88-4f2a-a7a7-5b1463d7efdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:11:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1833a677-01ab-415f-aeef-02b8cb01409a tempest-GroupSnapshotsTest-1320333608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3958205-671f-48bf-908f-aa2a179ce69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:11:17 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-1833a677-01ab-415f-aeef-02b8cb01409a tempest-GroupSnapshotsTest-1320333608 None] Volume 4bd4b78b-d55a-4130-8d5d-1c0a57551f57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bd4b78b-d55a-4130-8d5d-1c0a57551f57', 'volume_size': 1}
Jul 03 01:11:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1833a677-01ab-415f-aeef-02b8cb01409a tempest-GroupSnapshotsTest-1320333608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:11:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1833a677-01ab-415f-aeef-02b8cb01409a tempest-GroupSnapshotsTest-1320333608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:11:17 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-1833a677-01ab-415f-aeef-02b8cb01409a tempest-GroupSnapshotsTest-1320333608 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=41c837f3-3064-42ef-a990-74734704e8ed,created_at=2026-07-02T23:11:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1241464333',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=41c837f3-3064-42ef-a990-74734704e8ed,host='devstack@QuobyteHD#QuobyteHD',id=4bd4b78b-d55a-4130-8d5d-1c0a57551f57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='605b15a8b401420c832ed398e7a562bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:11:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:11:17Z,use_quota=True,user_id='aee26ffd1cc24952b7327629329664f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b20456c0-5671-476a-9a77-ece364938c8b),volume_type_id=b20456c0-5671-476a-9a77-ece364938c8b)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:11:17 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-1833a677-01ab-415f-aeef-02b8cb01409a tempest-GroupSnapshotsTest-1320333608 None] Creating volume 4bd4b78b-d55a-4130-8d5d-1c0a57551f57 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:11:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1833a677-01ab-415f-aeef-02b8cb01409a tempest-GroupSnapshotsTest-1320333608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:11:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1833a677-01ab-415f-aeef-02b8cb01409a tempest-GroupSnapshotsTest-1320333608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:11:17 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-1833a677-01ab-415f-aeef-02b8cb01409a tempest-GroupSnapshotsTest-1320333608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:11:17 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-1833a677-01ab-415f-aeef-02b8cb01409a tempest-GroupSnapshotsTest-1320333608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:11:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1833a677-01ab-415f-aeef-02b8cb01409a tempest-GroupSnapshotsTest-1320333608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:11:17 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-1833a677-01ab-415f-aeef-02b8cb01409a tempest-GroupSnapshotsTest-1320333608 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:11:17 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-1833a677-01ab-415f-aeef-02b8cb01409a tempest-GroupSnapshotsTest-1320333608 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:11:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1833a677-01ab-415f-aeef-02b8cb01409a tempest-GroupSnapshotsTest-1320333608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4bd4b78b-d55a-4130-8d5d-1c0a57551f57 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:17 devstack sudo[95760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4bd4b78b-d55a-4130-8d5d-1c0a57551f57 1073741824
Jul 03 01:11:17 devstack sudo[95760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:18 devstack sudo[95758]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-77a5e753-b267-4b62-b578-5ebd33d1e949 tempest-VolumesSnapshotNegativeTestJSON-922751671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3988a0d8-8d22-4c82-8db0-604687679aa5" returned: 0 in 1.402s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-77a5e753-b267-4b62-b578-5ebd33d1e949 tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3988a0d8-8d22-4c82-8db0-604687679aa5.d1378f0b-1990-4c95-806b-958ef3296707 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:18 devstack sudo[95767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3988a0d8-8d22-4c82-8db0-604687679aa5.d1378f0b-1990-4c95-806b-958ef3296707
Jul 03 01:11:18 devstack sudo[95767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:18 devstack sudo[95760]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1833a677-01ab-415f-aeef-02b8cb01409a tempest-GroupSnapshotsTest-1320333608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4bd4b78b-d55a-4130-8d5d-1c0a57551f57 1073741824" returned: 0 in 1.598s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1833a677-01ab-415f-aeef-02b8cb01409a tempest-GroupSnapshotsTest-1320333608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4bd4b78b-d55a-4130-8d5d-1c0a57551f57 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:18 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-db12b617-9f67-4bd2-b815-8aa6a90ba0ba tempest-VolumeQuotasNegativeTestJSON-669291124 None] Acquiring lock "cinder-cfbf823e-a910-4e53-bebe-b1c42d9503cf-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:11:18 devstack sudo[95772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4bd4b78b-d55a-4130-8d5d-1c0a57551f57
Jul 03 01:11:18 devstack sudo[95772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:18 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-db12b617-9f67-4bd2-b815-8aa6a90ba0ba tempest-VolumeQuotasNegativeTestJSON-669291124 None] Lock "cinder-cfbf823e-a910-4e53-bebe-b1c42d9503cf-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:11:18 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-db12b617-9f67-4bd2-b815-8aa6a90ba0ba tempest-VolumeQuotasNegativeTestJSON-669291124 None] Acquiring lock "cinder-quobyte-cfbf823e-a910-4e53-bebe-b1c42d9503cf" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:11:18 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-db12b617-9f67-4bd2-b815-8aa6a90ba0ba tempest-VolumeQuotasNegativeTestJSON-669291124 None] Lock "cinder-quobyte-cfbf823e-a910-4e53-bebe-b1c42d9503cf" acquired by "delete_volume" :: waited 0.027s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:11:18 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[8745a513-b784-4025-b2d3-6accb104533c]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:11:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-db12b617-9f67-4bd2-b815-8aa6a90ba0ba tempest-VolumeQuotasNegativeTestJSON-669291124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cfbf823e-a910-4e53-bebe-b1c42d9503cf {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:19 devstack sudo[95780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cfbf823e-a910-4e53-bebe-b1c42d9503cf
Jul 03 01:11:19 devstack sudo[95780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:19 devstack sudo[95767]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:19 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-77a5e753-b267-4b62-b578-5ebd33d1e949 tempest-VolumesSnapshotNegativeTestJSON-922751671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3988a0d8-8d22-4c82-8db0-604687679aa5.d1378f0b-1990-4c95-806b-958ef3296707" returned: 0 in 1.044s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:19 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-77a5e753-b267-4b62-b578-5ebd33d1e949 tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3988a0d8-8d22-4c82-8db0-604687679aa5.d1378f0b-1990-4c95-806b-958ef3296707 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:19 devstack sudo[95782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3988a0d8-8d22-4c82-8db0-604687679aa5.d1378f0b-1990-4c95-806b-958ef3296707
Jul 03 01:11:19 devstack sudo[95782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:19 devstack sudo[95772]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:19 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1833a677-01ab-415f-aeef-02b8cb01409a tempest-GroupSnapshotsTest-1320333608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4bd4b78b-d55a-4130-8d5d-1c0a57551f57" returned: 0 in 0.986s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:19 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-1833a677-01ab-415f-aeef-02b8cb01409a tempest-GroupSnapshotsTest-1320333608 None] <== create_volume: return (2651ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:11:19 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1833a677-01ab-415f-aeef-02b8cb01409a tempest-GroupSnapshotsTest-1320333608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.656s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:11:19 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1833a677-01ab-415f-aeef-02b8cb01409a tempest-GroupSnapshotsTest-1320333608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3958205-671f-48bf-908f-aa2a179ce69a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bd4b78b-d55a-4130-8d5d-1c0a57551f57', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:11:19 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1833a677-01ab-415f-aeef-02b8cb01409a tempest-GroupSnapshotsTest-1320333608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (513d3071-740e-4cd4-90f2-3e5c6c9e5f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:11:19 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-1833a677-01ab-415f-aeef-02b8cb01409a tempest-GroupSnapshotsTest-1320333608 None] Volume volume-4bd4b78b-d55a-4130-8d5d-1c0a57551f57 (4bd4b78b-d55a-4130-8d5d-1c0a57551f57): created successfully
Jul 03 01:11:19 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1833a677-01ab-415f-aeef-02b8cb01409a tempest-GroupSnapshotsTest-1320333608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (513d3071-740e-4cd4-90f2-3e5c6c9e5f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:11:19 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1833a677-01ab-415f-aeef-02b8cb01409a tempest-GroupSnapshotsTest-1320333608 None] Flow 'volume_create_manager' (e08d8a85-8ec4-448d-a5a7-e546023d7f7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:11:19 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-1833a677-01ab-415f-aeef-02b8cb01409a tempest-GroupSnapshotsTest-1320333608 None] Created volume successfully.
Jul 03 01:11:20 devstack sudo[95780]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-db12b617-9f67-4bd2-b815-8aa6a90ba0ba tempest-VolumeQuotasNegativeTestJSON-669291124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cfbf823e-a910-4e53-bebe-b1c42d9503cf" returned: 0 in 1.227s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-db12b617-9f67-4bd2-b815-8aa6a90ba0ba tempest-VolumeQuotasNegativeTestJSON-669291124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cfbf823e-a910-4e53-bebe-b1c42d9503cf {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:20 devstack sudo[95782]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-77a5e753-b267-4b62-b578-5ebd33d1e949 tempest-VolumesSnapshotNegativeTestJSON-922751671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3988a0d8-8d22-4c82-8db0-604687679aa5.d1378f0b-1990-4c95-806b-958ef3296707" returned: 0 in 1.058s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:20 devstack sudo[95791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cfbf823e-a910-4e53-bebe-b1c42d9503cf
Jul 03 01:11:20 devstack sudo[95791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:20 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-77a5e753-b267-4b62-b578-5ebd33d1e949 tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Lock "cinder-quobyte-d1378f0b-1990-4c95-806b-958ef3296707" released by "_delete_snapshot" :: held 5.243s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:11:20 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-77a5e753-b267-4b62-b578-5ebd33d1e949 tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Lock "cinder-quobyte-3988a0d8-8d22-4c82-8db0-604687679aa5" released by "delete_snapshot" :: held 5.298s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:11:20 devstack cinder-volume[86891]: WARNING cinder.quota [None req-77a5e753-b267-4b62-b578-5ebd33d1e949 tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jul 03 01:11:20 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-77a5e753-b267-4b62-b578-5ebd33d1e949 tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Created reservations ['7663d403-11aa-4b29-b123-788e06a75dd5', '55637610-3ee4-4bf6-bcd4-d139cf7d7076', 'd7422dc0-7968-4dc8-8b92-208f6dbeabcb', '4320ac6b-1bf5-48ae-afb2-0be46f3ab1ce'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:11:20 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-77a5e753-b267-4b62-b578-5ebd33d1e949 tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Delete snapshot completed successfully.
Jul 03 01:11:20 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-77a5e753-b267-4b62-b578-5ebd33d1e949 tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Lock "cinder-d1378f0b-1990-4c95-806b-958ef3296707-delete_snapshot" released by "delete_snapshot" :: held 5.480s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:11:20 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-65dc5a81-4ada-40af-93c7-d06dd074e9d4 tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Acquiring lock "cinder-3988a0d8-8d22-4c82-8db0-604687679aa5-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:11:20 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-65dc5a81-4ada-40af-93c7-d06dd074e9d4 tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Lock "cinder-3988a0d8-8d22-4c82-8db0-604687679aa5-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:11:20 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-65dc5a81-4ada-40af-93c7-d06dd074e9d4 tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Acquiring lock "cinder-quobyte-3988a0d8-8d22-4c82-8db0-604687679aa5" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:11:20 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-65dc5a81-4ada-40af-93c7-d06dd074e9d4 tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Lock "cinder-quobyte-3988a0d8-8d22-4c82-8db0-604687679aa5" acquired by "delete_volume" :: waited 0.030s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:11:20 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b0de1de-ea6e-470e-93a3-ff777a82ed63]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:11:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-65dc5a81-4ada-40af-93c7-d06dd074e9d4 tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3988a0d8-8d22-4c82-8db0-604687679aa5 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:20 devstack sudo[95791]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-db12b617-9f67-4bd2-b815-8aa6a90ba0ba tempest-VolumeQuotasNegativeTestJSON-669291124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cfbf823e-a910-4e53-bebe-b1c42d9503cf" returned: 0 in 0.776s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:21 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-db12b617-9f67-4bd2-b815-8aa6a90ba0ba tempest-VolumeQuotasNegativeTestJSON-669291124 None] Lock "cinder-quobyte-cfbf823e-a910-4e53-bebe-b1c42d9503cf" released by "delete_volume" :: held 2.068s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:11:21 devstack sudo[95797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3988a0d8-8d22-4c82-8db0-604687679aa5
Jul 03 01:11:21 devstack sudo[95797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:21 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-db12b617-9f67-4bd2-b815-8aa6a90ba0ba tempest-VolumeQuotasNegativeTestJSON-669291124 None] Created reservations ['2fe2e4d7-09d6-4623-8113-7bddbc0a1a54', '5b595816-0830-4398-814b-5189d64433cb', '80d58a43-14ca-4296-822b-f1eb7952e9ae', 'c092d8b2-38ea-4478-817b-9e02289d1080'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:11:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-db12b617-9f67-4bd2-b815-8aa6a90ba0ba tempest-VolumeQuotasNegativeTestJSON-669291124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:11:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-db12b617-9f67-4bd2-b815-8aa6a90ba0ba tempest-VolumeQuotasNegativeTestJSON-669291124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:11:21 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-db12b617-9f67-4bd2-b815-8aa6a90ba0ba tempest-VolumeQuotasNegativeTestJSON-669291124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:11:21 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-db12b617-9f67-4bd2-b815-8aa6a90ba0ba tempest-VolumeQuotasNegativeTestJSON-669291124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:11:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-db12b617-9f67-4bd2-b815-8aa6a90ba0ba tempest-VolumeQuotasNegativeTestJSON-669291124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:11:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-db12b617-9f67-4bd2-b815-8aa6a90ba0ba tempest-VolumeQuotasNegativeTestJSON-669291124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:21 devstack sudo[95799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:11:21 devstack sudo[95799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:22 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-07743df8-f20a-4430-a9b9-2b35d98d7fb1 tempest-GroupSnapshotsTest-1320333608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:11:22 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-07743df8-f20a-4430-a9b9-2b35d98d7fb1 tempest-GroupSnapshotsTest-1320333608 None] Flow 'volume_create_manager' (3c8dd2a8-54a0-4c7f-9939-c17bde9f11d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:11:22 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-07743df8-f20a-4430-a9b9-2b35d98d7fb1 tempest-GroupSnapshotsTest-1320333608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3ba50d0-b9a8-4190-85cb-b9902c903030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:11:22 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-07743df8-f20a-4430-a9b9-2b35d98d7fb1 tempest-GroupSnapshotsTest-1320333608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3ba50d0-b9a8-4190-85cb-b9902c903030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:11:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-827818869',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=41c837f3-3064-42ef-a990-74734704e8ed,host='devstack@QuobyteHD#QuobyteHD',id=e2bea568-7bd3-47de-9f47-9a4641195915,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='605b15a8b401420c832ed398e7a562bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:11:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:11:22Z,use_quota=True,user_id='aee26ffd1cc24952b7327629329664f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b20456c0-5671-476a-9a77-ece364938c8b),volume_type_id=b20456c0-5671-476a-9a77-ece364938c8b)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:11:22 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-07743df8-f20a-4430-a9b9-2b35d98d7fb1 tempest-GroupSnapshotsTest-1320333608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37e5ddd4-9d84-4a22-a81e-6e745ba5e36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:11:22 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-07743df8-f20a-4430-a9b9-2b35d98d7fb1 tempest-GroupSnapshotsTest-1320333608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37e5ddd4-9d84-4a22-a81e-6e745ba5e36b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:11:22 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-07743df8-f20a-4430-a9b9-2b35d98d7fb1 tempest-GroupSnapshotsTest-1320333608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f467f267-01ca-4f3e-b620-5d8f9b3f604a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:11:22 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-07743df8-f20a-4430-a9b9-2b35d98d7fb1 tempest-GroupSnapshotsTest-1320333608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f467f267-01ca-4f3e-b620-5d8f9b3f604a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2bea568-7bd3-47de-9f47-9a4641195915', 'volume_name': 'volume-e2bea568-7bd3-47de-9f47-9a4641195915', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:11:22 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-07743df8-f20a-4430-a9b9-2b35d98d7fb1 tempest-GroupSnapshotsTest-1320333608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c29404a9-8c16-49df-934c-c52779abd603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:11:22 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-07743df8-f20a-4430-a9b9-2b35d98d7fb1 tempest-GroupSnapshotsTest-1320333608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c29404a9-8c16-49df-934c-c52779abd603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:11:22 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-07743df8-f20a-4430-a9b9-2b35d98d7fb1 tempest-GroupSnapshotsTest-1320333608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a283590e-e25d-409c-a313-66aefe3fe019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:11:22 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-07743df8-f20a-4430-a9b9-2b35d98d7fb1 tempest-GroupSnapshotsTest-1320333608 None] Volume e2bea568-7bd3-47de-9f47-9a4641195915: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2bea568-7bd3-47de-9f47-9a4641195915', 'volume_size': 1}
Jul 03 01:11:22 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-07743df8-f20a-4430-a9b9-2b35d98d7fb1 tempest-GroupSnapshotsTest-1320333608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:11:22 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-07743df8-f20a-4430-a9b9-2b35d98d7fb1 tempest-GroupSnapshotsTest-1320333608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:11:22 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-07743df8-f20a-4430-a9b9-2b35d98d7fb1 tempest-GroupSnapshotsTest-1320333608 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=41c837f3-3064-42ef-a990-74734704e8ed,created_at=2026-07-02T23:11:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-827818869',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=41c837f3-3064-42ef-a990-74734704e8ed,host='devstack@QuobyteHD#QuobyteHD',id=e2bea568-7bd3-47de-9f47-9a4641195915,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='605b15a8b401420c832ed398e7a562bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:11:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:11:22Z,use_quota=True,user_id='aee26ffd1cc24952b7327629329664f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b20456c0-5671-476a-9a77-ece364938c8b),volume_type_id=b20456c0-5671-476a-9a77-ece364938c8b)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:11:22 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-07743df8-f20a-4430-a9b9-2b35d98d7fb1 tempest-GroupSnapshotsTest-1320333608 None] Creating volume e2bea568-7bd3-47de-9f47-9a4641195915 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:11:22 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-07743df8-f20a-4430-a9b9-2b35d98d7fb1 tempest-GroupSnapshotsTest-1320333608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:11:22 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-07743df8-f20a-4430-a9b9-2b35d98d7fb1 tempest-GroupSnapshotsTest-1320333608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:11:22 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-07743df8-f20a-4430-a9b9-2b35d98d7fb1 tempest-GroupSnapshotsTest-1320333608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:11:22 devstack sudo[95797]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:22 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-07743df8-f20a-4430-a9b9-2b35d98d7fb1 tempest-GroupSnapshotsTest-1320333608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:11:22 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-07743df8-f20a-4430-a9b9-2b35d98d7fb1 tempest-GroupSnapshotsTest-1320333608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:11:22 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-07743df8-f20a-4430-a9b9-2b35d98d7fb1 tempest-GroupSnapshotsTest-1320333608 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:11:22 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-07743df8-f20a-4430-a9b9-2b35d98d7fb1 tempest-GroupSnapshotsTest-1320333608 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:11:22 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-07743df8-f20a-4430-a9b9-2b35d98d7fb1 tempest-GroupSnapshotsTest-1320333608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2bea568-7bd3-47de-9f47-9a4641195915 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:22 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-65dc5a81-4ada-40af-93c7-d06dd074e9d4 tempest-VolumesSnapshotNegativeTestJSON-922751671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3988a0d8-8d22-4c82-8db0-604687679aa5" returned: 0 in 1.386s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:22 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-65dc5a81-4ada-40af-93c7-d06dd074e9d4 tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3988a0d8-8d22-4c82-8db0-604687679aa5 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:22 devstack sudo[95799]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:22 devstack sudo[95820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2bea568-7bd3-47de-9f47-9a4641195915 1073741824
Jul 03 01:11:22 devstack sudo[95820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:22 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-db12b617-9f67-4bd2-b815-8aa6a90ba0ba tempest-VolumeQuotasNegativeTestJSON-669291124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 1.105s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:22 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-db12b617-9f67-4bd2-b815-8aa6a90ba0ba tempest-VolumeQuotasNegativeTestJSON-669291124 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:11:22 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-db12b617-9f67-4bd2-b815-8aa6a90ba0ba tempest-VolumeQuotasNegativeTestJSON-669291124 None] Deleted volume successfully.
Jul 03 01:11:22 devstack sudo[95821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3988a0d8-8d22-4c82-8db0-604687679aa5
Jul 03 01:11:22 devstack sudo[95821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:22 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-db12b617-9f67-4bd2-b815-8aa6a90ba0ba tempest-VolumeQuotasNegativeTestJSON-669291124 None] Lock "cinder-cfbf823e-a910-4e53-bebe-b1c42d9503cf-delete_volume" released by "delete_volume" :: held 3.524s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:11:23 devstack sudo[95821]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-65dc5a81-4ada-40af-93c7-d06dd074e9d4 tempest-VolumesSnapshotNegativeTestJSON-922751671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3988a0d8-8d22-4c82-8db0-604687679aa5" returned: 0 in 1.182s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:23 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-65dc5a81-4ada-40af-93c7-d06dd074e9d4 tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Lock "cinder-quobyte-3988a0d8-8d22-4c82-8db0-604687679aa5" released by "delete_volume" :: held 2.651s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:11:23 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-65dc5a81-4ada-40af-93c7-d06dd074e9d4 tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Created reservations ['5429ccff-1b8f-4b7b-8d0f-026552ea8d78', '4bd987ca-5561-4c41-bfee-fb48867be34f', '71ca4c7c-f549-4855-ac42-83228b5667e2', 'cf5352e7-32aa-4a45-be42-79483f195f23'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:11:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-65dc5a81-4ada-40af-93c7-d06dd074e9d4 tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:11:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-65dc5a81-4ada-40af-93c7-d06dd074e9d4 tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:11:23 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-65dc5a81-4ada-40af-93c7-d06dd074e9d4 tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:11:23 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-65dc5a81-4ada-40af-93c7-d06dd074e9d4 tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:11:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-65dc5a81-4ada-40af-93c7-d06dd074e9d4 tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:11:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-65dc5a81-4ada-40af-93c7-d06dd074e9d4 tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:23 devstack sudo[95852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:11:23 devstack sudo[95852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:23 devstack sudo[95820]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-07743df8-f20a-4430-a9b9-2b35d98d7fb1 tempest-GroupSnapshotsTest-1320333608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2bea568-7bd3-47de-9f47-9a4641195915 1073741824" returned: 0 in 1.653s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-07743df8-f20a-4430-a9b9-2b35d98d7fb1 tempest-GroupSnapshotsTest-1320333608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2bea568-7bd3-47de-9f47-9a4641195915 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:23 devstack sudo[95854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2bea568-7bd3-47de-9f47-9a4641195915
Jul 03 01:11:23 devstack sudo[95854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:24 devstack sudo[95854]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-07743df8-f20a-4430-a9b9-2b35d98d7fb1 tempest-GroupSnapshotsTest-1320333608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2bea568-7bd3-47de-9f47-9a4641195915" returned: 0 in 0.974s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:24 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-07743df8-f20a-4430-a9b9-2b35d98d7fb1 tempest-GroupSnapshotsTest-1320333608 None] <== create_volume: return (2688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:11:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-07743df8-f20a-4430-a9b9-2b35d98d7fb1 tempest-GroupSnapshotsTest-1320333608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.693s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:11:24 devstack sudo[95852]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-65dc5a81-4ada-40af-93c7-d06dd074e9d4 tempest-VolumesSnapshotNegativeTestJSON-922751671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 1.233s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:24 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-65dc5a81-4ada-40af-93c7-d06dd074e9d4 tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:11:24 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-07743df8-f20a-4430-a9b9-2b35d98d7fb1 tempest-GroupSnapshotsTest-1320333608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a283590e-e25d-409c-a313-66aefe3fe019) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2bea568-7bd3-47de-9f47-9a4641195915', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:11:24 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-07743df8-f20a-4430-a9b9-2b35d98d7fb1 tempest-GroupSnapshotsTest-1320333608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3508626c-f52a-4967-95fa-705111cc5667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:11:24 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-65dc5a81-4ada-40af-93c7-d06dd074e9d4 tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Deleted volume successfully.
Jul 03 01:11:25 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-07743df8-f20a-4430-a9b9-2b35d98d7fb1 tempest-GroupSnapshotsTest-1320333608 None] Volume volume-e2bea568-7bd3-47de-9f47-9a4641195915 (e2bea568-7bd3-47de-9f47-9a4641195915): created successfully
Jul 03 01:11:25 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-07743df8-f20a-4430-a9b9-2b35d98d7fb1 tempest-GroupSnapshotsTest-1320333608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3508626c-f52a-4967-95fa-705111cc5667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:11:25 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-07743df8-f20a-4430-a9b9-2b35d98d7fb1 tempest-GroupSnapshotsTest-1320333608 None] Flow 'volume_create_manager' (3c8dd2a8-54a0-4c7f-9939-c17bde9f11d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:11:25 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-07743df8-f20a-4430-a9b9-2b35d98d7fb1 tempest-GroupSnapshotsTest-1320333608 None] Created volume successfully.
Jul 03 01:11:25 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-65dc5a81-4ada-40af-93c7-d06dd074e9d4 tempest-VolumesSnapshotNegativeTestJSON-922751671 None] Lock "cinder-3988a0d8-8d22-4c82-8db0-604687679aa5-delete_volume" released by "delete_volume" :: held 4.302s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:11:26 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-9d884cfb-aefe-408b-affa-1166602983d1 tempest-GroupSnapshotsTest-1320333608 None] Update group completed successfully.
Jul 03 01:11:27 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-3773d027-570f-4a3f-9291-624a54d58d61 tempest-GroupSnapshotsTest-1320333608 None] Update group completed successfully.
Jul 03 01:11:28 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-1f3098fd-1324-4b67-92da-add1932938dd tempest-GroupSnapshotsTest-1320333608 None] Update group completed successfully.
Jul 03 01:11:29 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-f04f3987-d16a-44e6-8dbb-128881738a78 tempest-GroupSnapshotsTest-1320333608 None] Update group completed successfully.
Jul 03 01:11:30 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-e84d1580-5663-43ac-aeff-f8b630350545 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:11:30 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e84d1580-5663-43ac-aeff-f8b630350545 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Flow 'volume_create_manager' (4065ed7a-80ba-4030-a8a1-4f26a269c89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:11:30 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e84d1580-5663-43ac-aeff-f8b630350545 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27067e01-7753-4267-9950-a73a090d27de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:11:30 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e84d1580-5663-43ac-aeff-f8b630350545 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27067e01-7753-4267-9950-a73a090d27de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:11:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-486224571',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71dd02e3-75aa-4587-9a96-ff4dfedf2c20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c19df770a854021a7e1e4662094c47e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:11:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:11:30Z,use_quota=True,user_id='bde0311116e241cbba3726b807c68ff6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:11:30 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e84d1580-5663-43ac-aeff-f8b630350545 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17bf4360-4976-4dc4-8b9f-3919dea13a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:11:30 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e84d1580-5663-43ac-aeff-f8b630350545 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17bf4360-4976-4dc4-8b9f-3919dea13a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:11:30 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e84d1580-5663-43ac-aeff-f8b630350545 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c3e62fe-c817-4908-9a98-78f3a7f57aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:11:30 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e84d1580-5663-43ac-aeff-f8b630350545 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c3e62fe-c817-4908-9a98-78f3a7f57aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71dd02e3-75aa-4587-9a96-ff4dfedf2c20', 'volume_name': 'volume-71dd02e3-75aa-4587-9a96-ff4dfedf2c20', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:11:30 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e84d1580-5663-43ac-aeff-f8b630350545 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e8c18de-7dfa-4a49-ba72-0e21553ec478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:11:30 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e84d1580-5663-43ac-aeff-f8b630350545 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e8c18de-7dfa-4a49-ba72-0e21553ec478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:11:30 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e84d1580-5663-43ac-aeff-f8b630350545 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af5a90ae-d6e5-43f0-9453-bc635955d8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:11:30 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-e84d1580-5663-43ac-aeff-f8b630350545 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Volume 71dd02e3-75aa-4587-9a96-ff4dfedf2c20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71dd02e3-75aa-4587-9a96-ff4dfedf2c20', 'volume_size': 1}
Jul 03 01:11:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e84d1580-5663-43ac-aeff-f8b630350545 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:11:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e84d1580-5663-43ac-aeff-f8b630350545 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:11:30 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-e84d1580-5663-43ac-aeff-f8b630350545 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:11:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-486224571',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71dd02e3-75aa-4587-9a96-ff4dfedf2c20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c19df770a854021a7e1e4662094c47e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:11:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:11:30Z,use_quota=True,user_id='bde0311116e241cbba3726b807c68ff6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:11:30 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-e84d1580-5663-43ac-aeff-f8b630350545 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Creating volume 71dd02e3-75aa-4587-9a96-ff4dfedf2c20 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:11:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e84d1580-5663-43ac-aeff-f8b630350545 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:11:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e84d1580-5663-43ac-aeff-f8b630350545 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:11:30 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-e84d1580-5663-43ac-aeff-f8b630350545 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:11:30 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-e84d1580-5663-43ac-aeff-f8b630350545 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:11:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e84d1580-5663-43ac-aeff-f8b630350545 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:11:30 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-e84d1580-5663-43ac-aeff-f8b630350545 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:11:30 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-e84d1580-5663-43ac-aeff-f8b630350545 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:11:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e84d1580-5663-43ac-aeff-f8b630350545 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-71dd02e3-75aa-4587-9a96-ff4dfedf2c20 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:30 devstack sudo[95874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-71dd02e3-75aa-4587-9a96-ff4dfedf2c20 1073741824
Jul 03 01:11:30 devstack sudo[95874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:31 devstack sudo[95874]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:31 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e84d1580-5663-43ac-aeff-f8b630350545 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-71dd02e3-75aa-4587-9a96-ff4dfedf2c20 1073741824" returned: 0 in 0.876s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:31 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e84d1580-5663-43ac-aeff-f8b630350545 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-71dd02e3-75aa-4587-9a96-ff4dfedf2c20 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:31 devstack sudo[95880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-71dd02e3-75aa-4587-9a96-ff4dfedf2c20
Jul 03 01:11:31 devstack sudo[95880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:31 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-088f0d9e-41ab-4cfa-ab3e-97ee8a6ea4b0 tempest-GroupSnapshotsTest-1320333608 None] GroupSnapshot db59af74-41fe-46d7-824b-36c6e6422e74: creating.
Jul 03 01:11:31 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-088f0d9e-41ab-4cfa-ab3e-97ee8a6ea4b0 tempest-GroupSnapshotsTest-1320333608 None] Group snapshot db59af74-41fe-46d7-824b-36c6e6422e74: creating. {{(pid=86891) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 03 01:11:31 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-088f0d9e-41ab-4cfa-ab3e-97ee8a6ea4b0 tempest-GroupSnapshotsTest-1320333608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:11:31 devstack sudo[95880]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:31 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e84d1580-5663-43ac-aeff-f8b630350545 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-71dd02e3-75aa-4587-9a96-ff4dfedf2c20" returned: 0 in 0.736s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:31 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-e84d1580-5663-43ac-aeff-f8b630350545 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] <== create_volume: return (1657ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:11:31 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e84d1580-5663-43ac-aeff-f8b630350545 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.660s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:11:31 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-088f0d9e-41ab-4cfa-ab3e-97ee8a6ea4b0 tempest-GroupSnapshotsTest-1320333608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.322s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:11:31 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-088f0d9e-41ab-4cfa-ab3e-97ee8a6ea4b0 tempest-GroupSnapshotsTest-1320333608 None] Creating offline snapshot cda7712b-6926-491b-b1b5-5acdb980b68a of volume e2bea568-7bd3-47de-9f47-9a4641195915 {{(pid=86891) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 01:11:31 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e84d1580-5663-43ac-aeff-f8b630350545 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af5a90ae-d6e5-43f0-9453-bc635955d8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71dd02e3-75aa-4587-9a96-ff4dfedf2c20', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:11:31 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e84d1580-5663-43ac-aeff-f8b630350545 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3893ca7e-6d51-4340-8f19-d0c889bf5b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:11:31 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa094655-7e83-41ad-96e7-340295ccbf47]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:11:31 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-088f0d9e-41ab-4cfa-ab3e-97ee8a6ea4b0 tempest-GroupSnapshotsTest-1320333608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2bea568-7bd3-47de-9f47-9a4641195915 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:31 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-e84d1580-5663-43ac-aeff-f8b630350545 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Volume volume-71dd02e3-75aa-4587-9a96-ff4dfedf2c20 (71dd02e3-75aa-4587-9a96-ff4dfedf2c20): created successfully
Jul 03 01:11:31 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e84d1580-5663-43ac-aeff-f8b630350545 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3893ca7e-6d51-4340-8f19-d0c889bf5b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:11:31 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e84d1580-5663-43ac-aeff-f8b630350545 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Flow 'volume_create_manager' (4065ed7a-80ba-4030-a8a1-4f26a269c89e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:11:31 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-e84d1580-5663-43ac-aeff-f8b630350545 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Created volume successfully.
Jul 03 01:11:32 devstack sudo[95883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2bea568-7bd3-47de-9f47-9a4641195915
Jul 03 01:11:32 devstack sudo[95883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-afd51fa0-0375-48cb-8c8b-4b4781e611c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:11:32 devstack sudo[95883]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-088f0d9e-41ab-4cfa-ab3e-97ee8a6ea4b0 tempest-GroupSnapshotsTest-1320333608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2bea568-7bd3-47de-9f47-9a4641195915" returned: 0 in 0.847s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-088f0d9e-41ab-4cfa-ab3e-97ee8a6ea4b0 tempest-GroupSnapshotsTest-1320333608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2bea568-7bd3-47de-9f47-9a4641195915,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2bea568-7bd3-47de-9f47-9a4641195915.cda7712b-6926-491b-b1b5-5acdb980b68a 1G {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:32 devstack sudo[95888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2bea568-7bd3-47de-9f47-9a4641195915,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2bea568-7bd3-47de-9f47-9a4641195915.cda7712b-6926-491b-b1b5-5acdb980b68a 1G
Jul 03 01:11:32 devstack sudo[95888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-088f0d9e-41ab-4cfa-ab3e-97ee8a6ea4b0 tempest-GroupSnapshotsTest-1320333608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2bea568-7bd3-47de-9f47-9a4641195915,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2bea568-7bd3-47de-9f47-9a4641195915.cda7712b-6926-491b-b1b5-5acdb980b68a 1G" returned: 0 in 0.817s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-088f0d9e-41ab-4cfa-ab3e-97ee8a6ea4b0 tempest-GroupSnapshotsTest-1320333608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2bea568-7bd3-47de-9f47-9a4641195915 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2bea568-7bd3-47de-9f47-9a4641195915.cda7712b-6926-491b-b1b5-5acdb980b68a {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:33 devstack sudo[95888]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:33 devstack sudo[95893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2bea568-7bd3-47de-9f47-9a4641195915 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2bea568-7bd3-47de-9f47-9a4641195915.cda7712b-6926-491b-b1b5-5acdb980b68a
Jul 03 01:11:33 devstack sudo[95893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:34 devstack sudo[95893]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-088f0d9e-41ab-4cfa-ab3e-97ee8a6ea4b0 tempest-GroupSnapshotsTest-1320333608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2bea568-7bd3-47de-9f47-9a4641195915 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2bea568-7bd3-47de-9f47-9a4641195915.cda7712b-6926-491b-b1b5-5acdb980b68a" returned: 0 in 0.815s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:34 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-088f0d9e-41ab-4cfa-ab3e-97ee8a6ea4b0 tempest-GroupSnapshotsTest-1320333608 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2bea568-7bd3-47de-9f47-9a4641195915.cda7712b-6926-491b-b1b5-5acdb980b68a is being set with open permissions: ugo+rw: NotImplementedError
Jul 03 01:11:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-088f0d9e-41ab-4cfa-ab3e-97ee8a6ea4b0 tempest-GroupSnapshotsTest-1320333608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2bea568-7bd3-47de-9f47-9a4641195915.cda7712b-6926-491b-b1b5-5acdb980b68a {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:34 devstack sudo[95899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2bea568-7bd3-47de-9f47-9a4641195915.cda7712b-6926-491b-b1b5-5acdb980b68a
Jul 03 01:11:34 devstack sudo[95899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:35 devstack sudo[95899]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-088f0d9e-41ab-4cfa-ab3e-97ee8a6ea4b0 tempest-GroupSnapshotsTest-1320333608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2bea568-7bd3-47de-9f47-9a4641195915.cda7712b-6926-491b-b1b5-5acdb980b68a" returned: 0 in 0.716s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-088f0d9e-41ab-4cfa-ab3e-97ee8a6ea4b0 tempest-GroupSnapshotsTest-1320333608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2bea568-7bd3-47de-9f47-9a4641195915.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:35 devstack sudo[95902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2bea568-7bd3-47de-9f47-9a4641195915.info
Jul 03 01:11:35 devstack sudo[95902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:35 devstack sudo[95902]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-088f0d9e-41ab-4cfa-ab3e-97ee8a6ea4b0 tempest-GroupSnapshotsTest-1320333608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2bea568-7bd3-47de-9f47-9a4641195915.info" returned: 0 in 0.785s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:35 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-088f0d9e-41ab-4cfa-ab3e-97ee8a6ea4b0 tempest-GroupSnapshotsTest-1320333608 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2bea568-7bd3-47de-9f47-9a4641195915.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 03 01:11:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-088f0d9e-41ab-4cfa-ab3e-97ee8a6ea4b0 tempest-GroupSnapshotsTest-1320333608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2bea568-7bd3-47de-9f47-9a4641195915.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:35 devstack sudo[95905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2bea568-7bd3-47de-9f47-9a4641195915.info
Jul 03 01:11:35 devstack sudo[95905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:36 devstack sudo[95905]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-088f0d9e-41ab-4cfa-ab3e-97ee8a6ea4b0 tempest-GroupSnapshotsTest-1320333608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2bea568-7bd3-47de-9f47-9a4641195915.info" returned: 0 in 0.692s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-088f0d9e-41ab-4cfa-ab3e-97ee8a6ea4b0 tempest-GroupSnapshotsTest-1320333608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.762s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:11:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-088f0d9e-41ab-4cfa-ab3e-97ee8a6ea4b0 tempest-GroupSnapshotsTest-1320333608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:11:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-088f0d9e-41ab-4cfa-ab3e-97ee8a6ea4b0 tempest-GroupSnapshotsTest-1320333608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:11:36 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-088f0d9e-41ab-4cfa-ab3e-97ee8a6ea4b0 tempest-GroupSnapshotsTest-1320333608 None] Creating offline snapshot d2895403-c319-452b-8eb5-a0bd71e68b66 of volume 4bd4b78b-d55a-4130-8d5d-1c0a57551f57 {{(pid=86891) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 01:11:36 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9b5366-5255-4b04-a700-6e32177af895]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:11:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-088f0d9e-41ab-4cfa-ab3e-97ee8a6ea4b0 tempest-GroupSnapshotsTest-1320333608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4bd4b78b-d55a-4130-8d5d-1c0a57551f57 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:36 devstack sudo[95908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4bd4b78b-d55a-4130-8d5d-1c0a57551f57
Jul 03 01:11:36 devstack sudo[95908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:37 devstack sudo[95908]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-088f0d9e-41ab-4cfa-ab3e-97ee8a6ea4b0 tempest-GroupSnapshotsTest-1320333608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4bd4b78b-d55a-4130-8d5d-1c0a57551f57" returned: 0 in 0.880s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-088f0d9e-41ab-4cfa-ab3e-97ee8a6ea4b0 tempest-GroupSnapshotsTest-1320333608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4bd4b78b-d55a-4130-8d5d-1c0a57551f57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4bd4b78b-d55a-4130-8d5d-1c0a57551f57.d2895403-c319-452b-8eb5-a0bd71e68b66 1G {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:37 devstack sudo[95913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4bd4b78b-d55a-4130-8d5d-1c0a57551f57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4bd4b78b-d55a-4130-8d5d-1c0a57551f57.d2895403-c319-452b-8eb5-a0bd71e68b66 1G
Jul 03 01:11:37 devstack sudo[95913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:38 devstack sudo[95913]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-088f0d9e-41ab-4cfa-ab3e-97ee8a6ea4b0 tempest-GroupSnapshotsTest-1320333608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4bd4b78b-d55a-4130-8d5d-1c0a57551f57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4bd4b78b-d55a-4130-8d5d-1c0a57551f57.d2895403-c319-452b-8eb5-a0bd71e68b66 1G" returned: 0 in 1.075s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-088f0d9e-41ab-4cfa-ab3e-97ee8a6ea4b0 tempest-GroupSnapshotsTest-1320333608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bd4b78b-d55a-4130-8d5d-1c0a57551f57 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4bd4b78b-d55a-4130-8d5d-1c0a57551f57.d2895403-c319-452b-8eb5-a0bd71e68b66 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:38 devstack sudo[95920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bd4b78b-d55a-4130-8d5d-1c0a57551f57 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4bd4b78b-d55a-4130-8d5d-1c0a57551f57.d2895403-c319-452b-8eb5-a0bd71e68b66
Jul 03 01:11:38 devstack sudo[95920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:39 devstack sudo[95920]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-088f0d9e-41ab-4cfa-ab3e-97ee8a6ea4b0 tempest-GroupSnapshotsTest-1320333608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bd4b78b-d55a-4130-8d5d-1c0a57551f57 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4bd4b78b-d55a-4130-8d5d-1c0a57551f57.d2895403-c319-452b-8eb5-a0bd71e68b66" returned: 0 in 0.832s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:39 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-088f0d9e-41ab-4cfa-ab3e-97ee8a6ea4b0 tempest-GroupSnapshotsTest-1320333608 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4bd4b78b-d55a-4130-8d5d-1c0a57551f57.d2895403-c319-452b-8eb5-a0bd71e68b66 is being set with open permissions: ugo+rw: NotImplementedError
Jul 03 01:11:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-088f0d9e-41ab-4cfa-ab3e-97ee8a6ea4b0 tempest-GroupSnapshotsTest-1320333608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4bd4b78b-d55a-4130-8d5d-1c0a57551f57.d2895403-c319-452b-8eb5-a0bd71e68b66 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:39 devstack sudo[95932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4bd4b78b-d55a-4130-8d5d-1c0a57551f57.d2895403-c319-452b-8eb5-a0bd71e68b66
Jul 03 01:11:39 devstack sudo[95932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:40 devstack sudo[95932]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-088f0d9e-41ab-4cfa-ab3e-97ee8a6ea4b0 tempest-GroupSnapshotsTest-1320333608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4bd4b78b-d55a-4130-8d5d-1c0a57551f57.d2895403-c319-452b-8eb5-a0bd71e68b66" returned: 0 in 0.723s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-088f0d9e-41ab-4cfa-ab3e-97ee8a6ea4b0 tempest-GroupSnapshotsTest-1320333608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4bd4b78b-d55a-4130-8d5d-1c0a57551f57.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:40 devstack sudo[95935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4bd4b78b-d55a-4130-8d5d-1c0a57551f57.info
Jul 03 01:11:40 devstack sudo[95935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:40 devstack sudo[95935]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-088f0d9e-41ab-4cfa-ab3e-97ee8a6ea4b0 tempest-GroupSnapshotsTest-1320333608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4bd4b78b-d55a-4130-8d5d-1c0a57551f57.info" returned: 0 in 0.655s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:40 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-088f0d9e-41ab-4cfa-ab3e-97ee8a6ea4b0 tempest-GroupSnapshotsTest-1320333608 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4bd4b78b-d55a-4130-8d5d-1c0a57551f57.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 03 01:11:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-088f0d9e-41ab-4cfa-ab3e-97ee8a6ea4b0 tempest-GroupSnapshotsTest-1320333608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4bd4b78b-d55a-4130-8d5d-1c0a57551f57.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:40 devstack sudo[95938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4bd4b78b-d55a-4130-8d5d-1c0a57551f57.info
Jul 03 01:11:40 devstack sudo[95938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:41 devstack sudo[95938]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-088f0d9e-41ab-4cfa-ab3e-97ee8a6ea4b0 tempest-GroupSnapshotsTest-1320333608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4bd4b78b-d55a-4130-8d5d-1c0a57551f57.info" returned: 0 in 0.700s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-088f0d9e-41ab-4cfa-ab3e-97ee8a6ea4b0 tempest-GroupSnapshotsTest-1320333608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.976s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:11:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-afd51fa0-0375-48cb-8c8b-4b4781e611c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.087s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:11:41 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-afd51fa0-0375-48cb-8c8b-4b4781e611c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Creating offline snapshot cf49a005-e483-44d3-982d-ccc6de277842 of volume 71dd02e3-75aa-4587-9a96-ff4dfedf2c20 {{(pid=86891) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 01:11:41 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[20862cf3-cc75-4c80-86c5-bde122c6991f]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:11:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-afd51fa0-0375-48cb-8c8b-4b4781e611c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-71dd02e3-75aa-4587-9a96-ff4dfedf2c20 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:41 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf4aca4a-f7f2-4e1d-a071-07c39fc01e78 tempest-AttachVolumeNegativeTest-1781307442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:11:41 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bf4aca4a-f7f2-4e1d-a071-07c39fc01e78 tempest-AttachVolumeNegativeTest-1781307442 None] Flow 'volume_create_manager' (ba1bc1dd-186c-47fe-a6e3-b89afb84002a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:11:41 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bf4aca4a-f7f2-4e1d-a071-07c39fc01e78 tempest-AttachVolumeNegativeTest-1781307442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce869e7e-230d-488a-8048-e3f32b60aa03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:11:41 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bf4aca4a-f7f2-4e1d-a071-07c39fc01e78 tempest-AttachVolumeNegativeTest-1781307442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce869e7e-230d-488a-8048-e3f32b60aa03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:11:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2137655157',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62f555da-55ea-498d-81d2-bfe03541dd74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3348d2c85ae7402095c009310a1f3caa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:11:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:11:42Z,use_quota=True,user_id='aa6ba53dbdc145fba5e7c650aea77566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:11:41 devstack sudo[95943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-71dd02e3-75aa-4587-9a96-ff4dfedf2c20
Jul 03 01:11:41 devstack sudo[95943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:41 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bf4aca4a-f7f2-4e1d-a071-07c39fc01e78 tempest-AttachVolumeNegativeTest-1781307442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37284d43-4948-4796-a7cf-e24e8b57c60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:11:41 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bf4aca4a-f7f2-4e1d-a071-07c39fc01e78 tempest-AttachVolumeNegativeTest-1781307442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37284d43-4948-4796-a7cf-e24e8b57c60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:11:41 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bf4aca4a-f7f2-4e1d-a071-07c39fc01e78 tempest-AttachVolumeNegativeTest-1781307442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0203439-6caa-48dc-a18a-5df393c36f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:11:41 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bf4aca4a-f7f2-4e1d-a071-07c39fc01e78 tempest-AttachVolumeNegativeTest-1781307442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0203439-6caa-48dc-a18a-5df393c36f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62f555da-55ea-498d-81d2-bfe03541dd74', 'volume_name': 'volume-62f555da-55ea-498d-81d2-bfe03541dd74', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:11:41 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bf4aca4a-f7f2-4e1d-a071-07c39fc01e78 tempest-AttachVolumeNegativeTest-1781307442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee787796-a8f6-49f0-988d-f747ca50f4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:11:41 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bf4aca4a-f7f2-4e1d-a071-07c39fc01e78 tempest-AttachVolumeNegativeTest-1781307442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee787796-a8f6-49f0-988d-f747ca50f4ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:11:41 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bf4aca4a-f7f2-4e1d-a071-07c39fc01e78 tempest-AttachVolumeNegativeTest-1781307442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d57ae252-cccd-4b1a-9c43-94bff741d73f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:11:41 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-bf4aca4a-f7f2-4e1d-a071-07c39fc01e78 tempest-AttachVolumeNegativeTest-1781307442 None] Volume 62f555da-55ea-498d-81d2-bfe03541dd74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62f555da-55ea-498d-81d2-bfe03541dd74', 'volume_size': 1}
Jul 03 01:11:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-bf4aca4a-f7f2-4e1d-a071-07c39fc01e78 tempest-AttachVolumeNegativeTest-1781307442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:11:41 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-088f0d9e-41ab-4cfa-ab3e-97ee8a6ea4b0 tempest-GroupSnapshotsTest-1320333608 None] group_snapshot db59af74-41fe-46d7-824b-36c6e6422e74: created successfully
Jul 03 01:11:42 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-e68da7eb-c031-4606-b1de-f91c2e0e389d tempest-GroupSnapshotsTest-1320333608 None] group_snapshot db59af74-41fe-46d7-824b-36c6e6422e74: deleting
Jul 03 01:11:42 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e68da7eb-c031-4606-b1de-f91c2e0e389d tempest-GroupSnapshotsTest-1320333608 None] group_snapshot db59af74-41fe-46d7-824b-36c6e6422e74: deleting {{(pid=86891) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 03 01:11:42 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e68da7eb-c031-4606-b1de-f91c2e0e389d tempest-GroupSnapshotsTest-1320333608 None] Acquiring lock "cinder-quobyte-e2bea568-7bd3-47de-9f47-9a4641195915" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:11:42 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e68da7eb-c031-4606-b1de-f91c2e0e389d tempest-GroupSnapshotsTest-1320333608 None] Lock "cinder-quobyte-e2bea568-7bd3-47de-9f47-9a4641195915" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:11:42 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e68da7eb-c031-4606-b1de-f91c2e0e389d tempest-GroupSnapshotsTest-1320333608 None] Acquiring lock "cinder-quobyte-cda7712b-6926-491b-b1b5-5acdb980b68a" by "_delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:11:42 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e68da7eb-c031-4606-b1de-f91c2e0e389d tempest-GroupSnapshotsTest-1320333608 None] Lock "cinder-quobyte-cda7712b-6926-491b-b1b5-5acdb980b68a" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:11:42 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-e68da7eb-c031-4606-b1de-f91c2e0e389d tempest-GroupSnapshotsTest-1320333608 None] Deleting offline snapshot cda7712b-6926-491b-b1b5-5acdb980b68a of volume e2bea568-7bd3-47de-9f47-9a4641195915 {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 01:11:42 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-e68da7eb-c031-4606-b1de-f91c2e0e389d tempest-GroupSnapshotsTest-1320333608 None] snapshot_file for this snap is: volume-e2bea568-7bd3-47de-9f47-9a4641195915.cda7712b-6926-491b-b1b5-5acdb980b68a {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 01:11:42 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47698de-35eb-4892-ab0d-1110cf1590da]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:11:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e68da7eb-c031-4606-b1de-f91c2e0e389d tempest-GroupSnapshotsTest-1320333608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2bea568-7bd3-47de-9f47-9a4641195915.cda7712b-6926-491b-b1b5-5acdb980b68a {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:42 devstack sudo[95945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2bea568-7bd3-47de-9f47-9a4641195915.cda7712b-6926-491b-b1b5-5acdb980b68a
Jul 03 01:11:42 devstack sudo[95945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:42 devstack sudo[95943]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-afd51fa0-0375-48cb-8c8b-4b4781e611c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-71dd02e3-75aa-4587-9a96-ff4dfedf2c20" returned: 0 in 0.975s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-afd51fa0-0375-48cb-8c8b-4b4781e611c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-71dd02e3-75aa-4587-9a96-ff4dfedf2c20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-71dd02e3-75aa-4587-9a96-ff4dfedf2c20.cf49a005-e483-44d3-982d-ccc6de277842 1G {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:42 devstack sudo[95950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-71dd02e3-75aa-4587-9a96-ff4dfedf2c20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-71dd02e3-75aa-4587-9a96-ff4dfedf2c20.cf49a005-e483-44d3-982d-ccc6de277842 1G
Jul 03 01:11:42 devstack sudo[95950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:43 devstack sudo[95945]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e68da7eb-c031-4606-b1de-f91c2e0e389d tempest-GroupSnapshotsTest-1320333608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2bea568-7bd3-47de-9f47-9a4641195915.cda7712b-6926-491b-b1b5-5acdb980b68a" returned: 0 in 0.882s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:43 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-e68da7eb-c031-4606-b1de-f91c2e0e389d tempest-GroupSnapshotsTest-1320333608 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2bea568-7bd3-47de-9f47-9a4641195915(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:11:43 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d989e5-f6e0-4c1a-86fa-ae7f54cafb3b]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:11:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e68da7eb-c031-4606-b1de-f91c2e0e389d tempest-GroupSnapshotsTest-1320333608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2bea568-7bd3-47de-9f47-9a4641195915 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:43 devstack sudo[95959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2bea568-7bd3-47de-9f47-9a4641195915
Jul 03 01:11:43 devstack sudo[95959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-afd51fa0-0375-48cb-8c8b-4b4781e611c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-71dd02e3-75aa-4587-9a96-ff4dfedf2c20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-71dd02e3-75aa-4587-9a96-ff4dfedf2c20.cf49a005-e483-44d3-982d-ccc6de277842 1G" returned: 0 in 0.917s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:43 devstack sudo[95950]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-afd51fa0-0375-48cb-8c8b-4b4781e611c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71dd02e3-75aa-4587-9a96-ff4dfedf2c20 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-71dd02e3-75aa-4587-9a96-ff4dfedf2c20.cf49a005-e483-44d3-982d-ccc6de277842 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:43 devstack sudo[95961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71dd02e3-75aa-4587-9a96-ff4dfedf2c20 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-71dd02e3-75aa-4587-9a96-ff4dfedf2c20.cf49a005-e483-44d3-982d-ccc6de277842
Jul 03 01:11:43 devstack sudo[95961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:44 devstack sudo[95959]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e68da7eb-c031-4606-b1de-f91c2e0e389d tempest-GroupSnapshotsTest-1320333608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2bea568-7bd3-47de-9f47-9a4641195915" returned: 0 in 1.051s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e68da7eb-c031-4606-b1de-f91c2e0e389d tempest-GroupSnapshotsTest-1320333608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2bea568-7bd3-47de-9f47-9a4641195915.cda7712b-6926-491b-b1b5-5acdb980b68a {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:44 devstack sudo[95961]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-afd51fa0-0375-48cb-8c8b-4b4781e611c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71dd02e3-75aa-4587-9a96-ff4dfedf2c20 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-71dd02e3-75aa-4587-9a96-ff4dfedf2c20.cf49a005-e483-44d3-982d-ccc6de277842" returned: 0 in 0.882s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:44 devstack sudo[95969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2bea568-7bd3-47de-9f47-9a4641195915.cda7712b-6926-491b-b1b5-5acdb980b68a
Jul 03 01:11:44 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-afd51fa0-0375-48cb-8c8b-4b4781e611c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-71dd02e3-75aa-4587-9a96-ff4dfedf2c20.cf49a005-e483-44d3-982d-ccc6de277842 is being set with open permissions: ugo+rw
Jul 03 01:11:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-afd51fa0-0375-48cb-8c8b-4b4781e611c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-71dd02e3-75aa-4587-9a96-ff4dfedf2c20.cf49a005-e483-44d3-982d-ccc6de277842 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:44 devstack sudo[95969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:44 devstack sudo[95971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-71dd02e3-75aa-4587-9a96-ff4dfedf2c20.cf49a005-e483-44d3-982d-ccc6de277842
Jul 03 01:11:44 devstack sudo[95971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:45 devstack sudo[95971]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-afd51fa0-0375-48cb-8c8b-4b4781e611c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-71dd02e3-75aa-4587-9a96-ff4dfedf2c20.cf49a005-e483-44d3-982d-ccc6de277842" returned: 0 in 0.733s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-afd51fa0-0375-48cb-8c8b-4b4781e611c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-71dd02e3-75aa-4587-9a96-ff4dfedf2c20.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:45 devstack sudo[95978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-71dd02e3-75aa-4587-9a96-ff4dfedf2c20.info
Jul 03 01:11:45 devstack sudo[95978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:45 devstack sudo[95969]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e68da7eb-c031-4606-b1de-f91c2e0e389d tempest-GroupSnapshotsTest-1320333608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2bea568-7bd3-47de-9f47-9a4641195915.cda7712b-6926-491b-b1b5-5acdb980b68a" returned: 0 in 0.851s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e68da7eb-c031-4606-b1de-f91c2e0e389d tempest-GroupSnapshotsTest-1320333608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2bea568-7bd3-47de-9f47-9a4641195915.cda7712b-6926-491b-b1b5-5acdb980b68a {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:45 devstack sudo[95980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2bea568-7bd3-47de-9f47-9a4641195915.cda7712b-6926-491b-b1b5-5acdb980b68a
Jul 03 01:11:45 devstack sudo[95980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:46 devstack sudo[95978]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-afd51fa0-0375-48cb-8c8b-4b4781e611c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-71dd02e3-75aa-4587-9a96-ff4dfedf2c20.info" returned: 0 in 0.776s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:46 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-afd51fa0-0375-48cb-8c8b-4b4781e611c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-71dd02e3-75aa-4587-9a96-ff4dfedf2c20.info is being set with open permissions: ugo+rw
Jul 03 01:11:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-afd51fa0-0375-48cb-8c8b-4b4781e611c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-71dd02e3-75aa-4587-9a96-ff4dfedf2c20.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:46 devstack sudo[95984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-71dd02e3-75aa-4587-9a96-ff4dfedf2c20.info
Jul 03 01:11:46 devstack sudo[95984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:46 devstack sudo[95980]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e68da7eb-c031-4606-b1de-f91c2e0e389d tempest-GroupSnapshotsTest-1320333608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2bea568-7bd3-47de-9f47-9a4641195915.cda7712b-6926-491b-b1b5-5acdb980b68a" returned: 0 in 0.829s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:46 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e68da7eb-c031-4606-b1de-f91c2e0e389d tempest-GroupSnapshotsTest-1320333608 None] Lock "cinder-quobyte-cda7712b-6926-491b-b1b5-5acdb980b68a" released by "_delete_snapshot" :: held 3.765s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:11:46 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e68da7eb-c031-4606-b1de-f91c2e0e389d tempest-GroupSnapshotsTest-1320333608 None] Lock "cinder-quobyte-e2bea568-7bd3-47de-9f47-9a4641195915" released by "delete_snapshot" :: held 3.811s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:11:46 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e68da7eb-c031-4606-b1de-f91c2e0e389d tempest-GroupSnapshotsTest-1320333608 None] Acquiring lock "cinder-quobyte-4bd4b78b-d55a-4130-8d5d-1c0a57551f57" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:11:46 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e68da7eb-c031-4606-b1de-f91c2e0e389d tempest-GroupSnapshotsTest-1320333608 None] Lock "cinder-quobyte-4bd4b78b-d55a-4130-8d5d-1c0a57551f57" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:11:46 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e68da7eb-c031-4606-b1de-f91c2e0e389d tempest-GroupSnapshotsTest-1320333608 None] Acquiring lock "cinder-quobyte-d2895403-c319-452b-8eb5-a0bd71e68b66" by "_delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:11:46 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e68da7eb-c031-4606-b1de-f91c2e0e389d tempest-GroupSnapshotsTest-1320333608 None] Lock "cinder-quobyte-d2895403-c319-452b-8eb5-a0bd71e68b66" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:11:46 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-e68da7eb-c031-4606-b1de-f91c2e0e389d tempest-GroupSnapshotsTest-1320333608 None] Deleting offline snapshot d2895403-c319-452b-8eb5-a0bd71e68b66 of volume 4bd4b78b-d55a-4130-8d5d-1c0a57551f57 {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 01:11:46 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-e68da7eb-c031-4606-b1de-f91c2e0e389d tempest-GroupSnapshotsTest-1320333608 None] snapshot_file for this snap is: volume-4bd4b78b-d55a-4130-8d5d-1c0a57551f57.d2895403-c319-452b-8eb5-a0bd71e68b66 {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 01:11:46 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[49581d02-2404-490d-9727-063a8cbd9fc1]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:11:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e68da7eb-c031-4606-b1de-f91c2e0e389d tempest-GroupSnapshotsTest-1320333608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4bd4b78b-d55a-4130-8d5d-1c0a57551f57.d2895403-c319-452b-8eb5-a0bd71e68b66 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:46 devstack sudo[95986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4bd4b78b-d55a-4130-8d5d-1c0a57551f57.d2895403-c319-452b-8eb5-a0bd71e68b66
Jul 03 01:11:46 devstack sudo[95986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:46 devstack sudo[95984]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-afd51fa0-0375-48cb-8c8b-4b4781e611c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-71dd02e3-75aa-4587-9a96-ff4dfedf2c20.info" returned: 0 in 0.750s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-afd51fa0-0375-48cb-8c8b-4b4781e611c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.162s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:11:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-bf4aca4a-f7f2-4e1d-a071-07c39fc01e78 tempest-AttachVolumeNegativeTest-1781307442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.939s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:11:46 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-bf4aca4a-f7f2-4e1d-a071-07c39fc01e78 tempest-AttachVolumeNegativeTest-1781307442 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:11:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2137655157',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62f555da-55ea-498d-81d2-bfe03541dd74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3348d2c85ae7402095c009310a1f3caa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:11:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:11:42Z,use_quota=True,user_id='aa6ba53dbdc145fba5e7c650aea77566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:11:46 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-bf4aca4a-f7f2-4e1d-a071-07c39fc01e78 tempest-AttachVolumeNegativeTest-1781307442 None] Creating volume 62f555da-55ea-498d-81d2-bfe03541dd74 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:11:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-bf4aca4a-f7f2-4e1d-a071-07c39fc01e78 tempest-AttachVolumeNegativeTest-1781307442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:11:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-bf4aca4a-f7f2-4e1d-a071-07c39fc01e78 tempest-AttachVolumeNegativeTest-1781307442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:11:46 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-bf4aca4a-f7f2-4e1d-a071-07c39fc01e78 tempest-AttachVolumeNegativeTest-1781307442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:11:46 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-bf4aca4a-f7f2-4e1d-a071-07c39fc01e78 tempest-AttachVolumeNegativeTest-1781307442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:11:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-bf4aca4a-f7f2-4e1d-a071-07c39fc01e78 tempest-AttachVolumeNegativeTest-1781307442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:11:46 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-bf4aca4a-f7f2-4e1d-a071-07c39fc01e78 tempest-AttachVolumeNegativeTest-1781307442 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:11:46 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-bf4aca4a-f7f2-4e1d-a071-07c39fc01e78 tempest-AttachVolumeNegativeTest-1781307442 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:11:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bf4aca4a-f7f2-4e1d-a071-07c39fc01e78 tempest-AttachVolumeNegativeTest-1781307442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-62f555da-55ea-498d-81d2-bfe03541dd74 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:46 devstack sudo[95989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-62f555da-55ea-498d-81d2-bfe03541dd74 1073741824
Jul 03 01:11:46 devstack sudo[95989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:46 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-afd51fa0-0375-48cb-8c8b-4b4781e611c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Create snapshot completed successfully
Jul 03 01:11:47 devstack sudo[95986]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e68da7eb-c031-4606-b1de-f91c2e0e389d tempest-GroupSnapshotsTest-1320333608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4bd4b78b-d55a-4130-8d5d-1c0a57551f57.d2895403-c319-452b-8eb5-a0bd71e68b66" returned: 0 in 1.043s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:47 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-e68da7eb-c031-4606-b1de-f91c2e0e389d tempest-GroupSnapshotsTest-1320333608 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4bd4b78b-d55a-4130-8d5d-1c0a57551f57(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:11:47 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e6fa72-0544-485e-8d84-428cd0d98f84]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:11:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e68da7eb-c031-4606-b1de-f91c2e0e389d tempest-GroupSnapshotsTest-1320333608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4bd4b78b-d55a-4130-8d5d-1c0a57551f57 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:47 devstack sudo[95994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4bd4b78b-d55a-4130-8d5d-1c0a57551f57
Jul 03 01:11:47 devstack sudo[95994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:47 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-cd6cec60-df47-4662-9f0b-e822fa7fef53 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Acquiring lock "cinder-cf49a005-e483-44d3-982d-ccc6de277842-delete_snapshot" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:11:47 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-cd6cec60-df47-4662-9f0b-e822fa7fef53 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Lock "cinder-cf49a005-e483-44d3-982d-ccc6de277842-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:11:47 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-cd6cec60-df47-4662-9f0b-e822fa7fef53 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Acquiring lock "cinder-quobyte-71dd02e3-75aa-4587-9a96-ff4dfedf2c20" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:11:47 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-cd6cec60-df47-4662-9f0b-e822fa7fef53 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Lock "cinder-quobyte-71dd02e3-75aa-4587-9a96-ff4dfedf2c20" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:11:47 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-cd6cec60-df47-4662-9f0b-e822fa7fef53 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Acquiring lock "cinder-quobyte-cf49a005-e483-44d3-982d-ccc6de277842" by "_delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:11:47 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-cd6cec60-df47-4662-9f0b-e822fa7fef53 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Lock "cinder-quobyte-cf49a005-e483-44d3-982d-ccc6de277842" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:11:47 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-cd6cec60-df47-4662-9f0b-e822fa7fef53 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Deleting offline snapshot cf49a005-e483-44d3-982d-ccc6de277842 of volume 71dd02e3-75aa-4587-9a96-ff4dfedf2c20 {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 01:11:47 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-cd6cec60-df47-4662-9f0b-e822fa7fef53 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] snapshot_file for this snap is: volume-71dd02e3-75aa-4587-9a96-ff4dfedf2c20.cf49a005-e483-44d3-982d-ccc6de277842 {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 01:11:47 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f67a25-3414-4b2d-be2b-046dde5f8925]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:11:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-cd6cec60-df47-4662-9f0b-e822fa7fef53 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-71dd02e3-75aa-4587-9a96-ff4dfedf2c20.cf49a005-e483-44d3-982d-ccc6de277842 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:48 devstack sudo[96000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-71dd02e3-75aa-4587-9a96-ff4dfedf2c20.cf49a005-e483-44d3-982d-ccc6de277842
Jul 03 01:11:48 devstack sudo[96000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:48 devstack sudo[95989]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bf4aca4a-f7f2-4e1d-a071-07c39fc01e78 tempest-AttachVolumeNegativeTest-1781307442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-62f555da-55ea-498d-81d2-bfe03541dd74 1073741824" returned: 0 in 1.184s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bf4aca4a-f7f2-4e1d-a071-07c39fc01e78 tempest-AttachVolumeNegativeTest-1781307442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-62f555da-55ea-498d-81d2-bfe03541dd74 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:48 devstack sudo[96006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-62f555da-55ea-498d-81d2-bfe03541dd74
Jul 03 01:11:48 devstack sudo[96006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:48 devstack sudo[95994]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e68da7eb-c031-4606-b1de-f91c2e0e389d tempest-GroupSnapshotsTest-1320333608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4bd4b78b-d55a-4130-8d5d-1c0a57551f57" returned: 0 in 0.860s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e68da7eb-c031-4606-b1de-f91c2e0e389d tempest-GroupSnapshotsTest-1320333608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4bd4b78b-d55a-4130-8d5d-1c0a57551f57.d2895403-c319-452b-8eb5-a0bd71e68b66 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:48 devstack sudo[96008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4bd4b78b-d55a-4130-8d5d-1c0a57551f57.d2895403-c319-452b-8eb5-a0bd71e68b66
Jul 03 01:11:48 devstack sudo[96008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:48 devstack sudo[96000]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-cd6cec60-df47-4662-9f0b-e822fa7fef53 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-71dd02e3-75aa-4587-9a96-ff4dfedf2c20.cf49a005-e483-44d3-982d-ccc6de277842" returned: 0 in 1.049s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:48 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-cd6cec60-df47-4662-9f0b-e822fa7fef53 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71dd02e3-75aa-4587-9a96-ff4dfedf2c20(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:11:48 devstack sudo[96006]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bf4aca4a-f7f2-4e1d-a071-07c39fc01e78 tempest-AttachVolumeNegativeTest-1781307442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-62f555da-55ea-498d-81d2-bfe03541dd74" returned: 0 in 0.862s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:48 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-bf4aca4a-f7f2-4e1d-a071-07c39fc01e78 tempest-AttachVolumeNegativeTest-1781307442 None] <== create_volume: return (2117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:11:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-bf4aca4a-f7f2-4e1d-a071-07c39fc01e78 tempest-AttachVolumeNegativeTest-1781307442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.122s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:11:48 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[eebfecc3-9e88-4c1b-a3e0-b935b1f30494]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:11:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-cd6cec60-df47-4662-9f0b-e822fa7fef53 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-71dd02e3-75aa-4587-9a96-ff4dfedf2c20 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:48 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bf4aca4a-f7f2-4e1d-a071-07c39fc01e78 tempest-AttachVolumeNegativeTest-1781307442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d57ae252-cccd-4b1a-9c43-94bff741d73f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62f555da-55ea-498d-81d2-bfe03541dd74', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:11:49 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bf4aca4a-f7f2-4e1d-a071-07c39fc01e78 tempest-AttachVolumeNegativeTest-1781307442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69d4188a-5663-4fcc-8a9c-d7e499690c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:11:49 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-bf4aca4a-f7f2-4e1d-a071-07c39fc01e78 tempest-AttachVolumeNegativeTest-1781307442 None] Volume volume-62f555da-55ea-498d-81d2-bfe03541dd74 (62f555da-55ea-498d-81d2-bfe03541dd74): created successfully
Jul 03 01:11:49 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bf4aca4a-f7f2-4e1d-a071-07c39fc01e78 tempest-AttachVolumeNegativeTest-1781307442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69d4188a-5663-4fcc-8a9c-d7e499690c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:11:49 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bf4aca4a-f7f2-4e1d-a071-07c39fc01e78 tempest-AttachVolumeNegativeTest-1781307442 None] Flow 'volume_create_manager' (ba1bc1dd-186c-47fe-a6e3-b89afb84002a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:11:49 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-bf4aca4a-f7f2-4e1d-a071-07c39fc01e78 tempest-AttachVolumeNegativeTest-1781307442 None] Created volume successfully.
Jul 03 01:11:49 devstack sudo[96017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-71dd02e3-75aa-4587-9a96-ff4dfedf2c20
Jul 03 01:11:49 devstack sudo[96017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:49 devstack sudo[96008]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e68da7eb-c031-4606-b1de-f91c2e0e389d tempest-GroupSnapshotsTest-1320333608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4bd4b78b-d55a-4130-8d5d-1c0a57551f57.d2895403-c319-452b-8eb5-a0bd71e68b66" returned: 0 in 1.011s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e68da7eb-c031-4606-b1de-f91c2e0e389d tempest-GroupSnapshotsTest-1320333608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4bd4b78b-d55a-4130-8d5d-1c0a57551f57.d2895403-c319-452b-8eb5-a0bd71e68b66 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:49 devstack sudo[96021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4bd4b78b-d55a-4130-8d5d-1c0a57551f57.d2895403-c319-452b-8eb5-a0bd71e68b66
Jul 03 01:11:49 devstack sudo[96021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:49 devstack sudo[96017]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-cd6cec60-df47-4662-9f0b-e822fa7fef53 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-71dd02e3-75aa-4587-9a96-ff4dfedf2c20" returned: 0 in 0.867s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-cd6cec60-df47-4662-9f0b-e822fa7fef53 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-71dd02e3-75aa-4587-9a96-ff4dfedf2c20.cf49a005-e483-44d3-982d-ccc6de277842 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:49 devstack sudo[96030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-71dd02e3-75aa-4587-9a96-ff4dfedf2c20.cf49a005-e483-44d3-982d-ccc6de277842
Jul 03 01:11:49 devstack sudo[96030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:49 devstack sudo[96021]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e68da7eb-c031-4606-b1de-f91c2e0e389d tempest-GroupSnapshotsTest-1320333608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4bd4b78b-d55a-4130-8d5d-1c0a57551f57.d2895403-c319-452b-8eb5-a0bd71e68b66" returned: 0 in 0.728s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:49 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e68da7eb-c031-4606-b1de-f91c2e0e389d tempest-GroupSnapshotsTest-1320333608 None] Lock "cinder-quobyte-d2895403-c319-452b-8eb5-a0bd71e68b66" released by "_delete_snapshot" :: held 3.767s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:11:50 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e68da7eb-c031-4606-b1de-f91c2e0e389d tempest-GroupSnapshotsTest-1320333608 None] Lock "cinder-quobyte-4bd4b78b-d55a-4130-8d5d-1c0a57551f57" released by "delete_snapshot" :: held 3.794s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:11:50 devstack cinder-volume[86891]: WARNING cinder.quota [None req-e68da7eb-c031-4606-b1de-f91c2e0e389d tempest-GroupSnapshotsTest-1320333608 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1481883157 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1481883157, it is now deprecated. Please use the default quota class for default quota.
Jul 03 01:11:50 devstack cinder-volume[86891]: WARNING cinder.quota [None req-e68da7eb-c031-4606-b1de-f91c2e0e389d tempest-GroupSnapshotsTest-1320333608 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1481883157 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1481883157, it is now deprecated. Please use the default quota class for default quota.
Jul 03 01:11:50 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-e68da7eb-c031-4606-b1de-f91c2e0e389d tempest-GroupSnapshotsTest-1320333608 None] Created reservations ['1a841571-7a5c-4ce7-9e27-c772d1aedaf6', 'd946ac8c-bb76-4577-a445-ee7629b20dbf', '8dddb161-4e5b-4699-a96a-6355a7ed5747', 'd8157f95-aef0-4a3f-bc42-f1dcaf4480ae'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:11:50 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-e68da7eb-c031-4606-b1de-f91c2e0e389d tempest-GroupSnapshotsTest-1320333608 None] Created reservations ['469f0aaa-9217-4867-a63f-1357f01cd61c', 'e3c6deb6-b1fe-4ea0-bd8a-f2e1066b6412', 'b1c3ba52-3803-4344-a13e-6c72b9e46812', 'a950aa3a-4374-4d16-a300-b766925c7c54'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:11:50 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-e68da7eb-c031-4606-b1de-f91c2e0e389d tempest-GroupSnapshotsTest-1320333608 None] group_snapshot db59af74-41fe-46d7-824b-36c6e6422e74: deleted successfully
Jul 03 01:11:50 devstack sudo[96030]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-cd6cec60-df47-4662-9f0b-e822fa7fef53 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-71dd02e3-75aa-4587-9a96-ff4dfedf2c20.cf49a005-e483-44d3-982d-ccc6de277842" returned: 0 in 0.847s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-cd6cec60-df47-4662-9f0b-e822fa7fef53 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-71dd02e3-75aa-4587-9a96-ff4dfedf2c20.cf49a005-e483-44d3-982d-ccc6de277842 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:50 devstack sudo[96035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-71dd02e3-75aa-4587-9a96-ff4dfedf2c20.cf49a005-e483-44d3-982d-ccc6de277842
Jul 03 01:11:50 devstack sudo[96035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:51 devstack sudo[96035]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:51 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-cd6cec60-df47-4662-9f0b-e822fa7fef53 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-71dd02e3-75aa-4587-9a96-ff4dfedf2c20.cf49a005-e483-44d3-982d-ccc6de277842" returned: 0 in 0.692s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:51 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-cd6cec60-df47-4662-9f0b-e822fa7fef53 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Lock "cinder-quobyte-cf49a005-e483-44d3-982d-ccc6de277842" released by "_delete_snapshot" :: held 3.610s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:11:51 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-cd6cec60-df47-4662-9f0b-e822fa7fef53 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Lock "cinder-quobyte-71dd02e3-75aa-4587-9a96-ff4dfedf2c20" released by "delete_snapshot" :: held 3.645s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:11:51 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-cd6cec60-df47-4662-9f0b-e822fa7fef53 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Created reservations ['ae6fc474-fb3b-4af5-a76d-673640eb7a39', '3ed73eb4-f421-4589-88a5-025fe88aa525', 'd11bf7bb-22c4-4ddf-a083-8f9bbc890f23', '8075f71d-cce8-4148-b462-30bcbb72e45e'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:11:51 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-cd6cec60-df47-4662-9f0b-e822fa7fef53 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Delete snapshot completed successfully.
Jul 03 01:11:51 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-cd6cec60-df47-4662-9f0b-e822fa7fef53 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Lock "cinder-cf49a005-e483-44d3-982d-ccc6de277842-delete_snapshot" released by "delete_snapshot" :: held 3.877s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:11:51 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8016efd0-6a4e-436d-992e-bb1e62f6a78b tempest-GroupSnapshotsTest-1320333608 None] Acquiring lock "cinder-quobyte-4bd4b78b-d55a-4130-8d5d-1c0a57551f57" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:11:51 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8016efd0-6a4e-436d-992e-bb1e62f6a78b tempest-GroupSnapshotsTest-1320333608 None] Lock "cinder-quobyte-4bd4b78b-d55a-4130-8d5d-1c0a57551f57" acquired by "delete_volume" :: waited 0.025s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:11:51 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1646ab-bdd7-4eaf-80a4-361e21638f61]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:11:51 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8016efd0-6a4e-436d-992e-bb1e62f6a78b tempest-GroupSnapshotsTest-1320333608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4bd4b78b-d55a-4130-8d5d-1c0a57551f57 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:51 devstack sudo[96038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4bd4b78b-d55a-4130-8d5d-1c0a57551f57
Jul 03 01:11:51 devstack sudo[96038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:52 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-9c501cdc-7e2a-4b0e-88f9-bea2fd2c4d12 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Acquiring lock "cinder-71dd02e3-75aa-4587-9a96-ff4dfedf2c20-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:11:52 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-9c501cdc-7e2a-4b0e-88f9-bea2fd2c4d12 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Lock "cinder-71dd02e3-75aa-4587-9a96-ff4dfedf2c20-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:11:52 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-9c501cdc-7e2a-4b0e-88f9-bea2fd2c4d12 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Acquiring lock "cinder-quobyte-71dd02e3-75aa-4587-9a96-ff4dfedf2c20" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:11:52 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-9c501cdc-7e2a-4b0e-88f9-bea2fd2c4d12 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Lock "cinder-quobyte-71dd02e3-75aa-4587-9a96-ff4dfedf2c20" acquired by "delete_volume" :: waited 0.016s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:11:52 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[c878a103-c5a0-4a91-8f80-c69abd991f58]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:11:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9c501cdc-7e2a-4b0e-88f9-bea2fd2c4d12 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-71dd02e3-75aa-4587-9a96-ff4dfedf2c20 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:52 devstack sudo[96040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-71dd02e3-75aa-4587-9a96-ff4dfedf2c20
Jul 03 01:11:52 devstack sudo[96040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-545cdb21-a42a-4f3e-af0a-bc8e2b064cee req-ccddcf1b-5ce0-4cbb-9dc1-5c85882961da tempest-AttachVolumeNegativeTest-1781307442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:11:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-545cdb21-a42a-4f3e-af0a-bc8e2b064cee req-ccddcf1b-5ce0-4cbb-9dc1-5c85882961da tempest-AttachVolumeNegativeTest-1781307442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:11:52 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[4adf33c5-c554-4a6b-8939-c07a0b360069]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:11:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-545cdb21-a42a-4f3e-af0a-bc8e2b064cee req-ccddcf1b-5ce0-4cbb-9dc1-5c85882961da tempest-AttachVolumeNegativeTest-1781307442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-62f555da-55ea-498d-81d2-bfe03541dd74 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:52 devstack sudo[96038]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8016efd0-6a4e-436d-992e-bb1e62f6a78b tempest-GroupSnapshotsTest-1320333608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4bd4b78b-d55a-4130-8d5d-1c0a57551f57" returned: 0 in 1.004s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8016efd0-6a4e-436d-992e-bb1e62f6a78b tempest-GroupSnapshotsTest-1320333608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4bd4b78b-d55a-4130-8d5d-1c0a57551f57 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:52 devstack sudo[96054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4bd4b78b-d55a-4130-8d5d-1c0a57551f57
Jul 03 01:11:52 devstack sudo[96054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:52 devstack sudo[96053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-62f555da-55ea-498d-81d2-bfe03541dd74
Jul 03 01:11:52 devstack sudo[96053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:53 devstack sudo[96040]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9c501cdc-7e2a-4b0e-88f9-bea2fd2c4d12 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-71dd02e3-75aa-4587-9a96-ff4dfedf2c20" returned: 0 in 1.111s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9c501cdc-7e2a-4b0e-88f9-bea2fd2c4d12 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-71dd02e3-75aa-4587-9a96-ff4dfedf2c20 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:53 devstack sudo[96062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-71dd02e3-75aa-4587-9a96-ff4dfedf2c20
Jul 03 01:11:53 devstack sudo[96062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:53 devstack sudo[96054]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8016efd0-6a4e-436d-992e-bb1e62f6a78b tempest-GroupSnapshotsTest-1320333608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4bd4b78b-d55a-4130-8d5d-1c0a57551f57" returned: 0 in 0.734s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:53 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8016efd0-6a4e-436d-992e-bb1e62f6a78b tempest-GroupSnapshotsTest-1320333608 None] Lock "cinder-quobyte-4bd4b78b-d55a-4130-8d5d-1c0a57551f57" released by "delete_volume" :: held 1.841s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:11:53 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8016efd0-6a4e-436d-992e-bb1e62f6a78b tempest-GroupSnapshotsTest-1320333608 None] Acquiring lock "cinder-quobyte-e2bea568-7bd3-47de-9f47-9a4641195915" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:11:53 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8016efd0-6a4e-436d-992e-bb1e62f6a78b tempest-GroupSnapshotsTest-1320333608 None] Lock "cinder-quobyte-e2bea568-7bd3-47de-9f47-9a4641195915" acquired by "delete_volume" :: waited 0.027s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:11:53 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[f928b47f-40a0-413f-bba2-f01c6878204e]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:11:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8016efd0-6a4e-436d-992e-bb1e62f6a78b tempest-GroupSnapshotsTest-1320333608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2bea568-7bd3-47de-9f47-9a4641195915 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:53 devstack sudo[96065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2bea568-7bd3-47de-9f47-9a4641195915
Jul 03 01:11:53 devstack sudo[96065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:53 devstack sudo[96053]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-545cdb21-a42a-4f3e-af0a-bc8e2b064cee req-ccddcf1b-5ce0-4cbb-9dc1-5c85882961da tempest-AttachVolumeNegativeTest-1781307442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-62f555da-55ea-498d-81d2-bfe03541dd74" returned: 0 in 1.059s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-545cdb21-a42a-4f3e-af0a-bc8e2b064cee req-ccddcf1b-5ce0-4cbb-9dc1-5c85882961da tempest-AttachVolumeNegativeTest-1781307442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.087s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:11:53 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:INSERT=27,cinder:UPDATE=109,cinder:SELECT=100,cinder:DELETE=7 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:11:53 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:SELECT=115,cinder:INSERT=29,cinder:UPDATE=119,cinder:DELETE=5 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:11:53 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [req-545cdb21-a42a-4f3e-af0a-bc8e2b064cee req-ccddcf1b-5ce0-4cbb-9dc1-5c85882961da tempest-AttachVolumeNegativeTest-1781307442 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3', 'name': 'volume-62f555da-55ea-498d-81d2-bfe03541dd74', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e784a271-4d32-4aa9-9b04-15821fca3b6c', 'enforce_multipath': True} {{(pid=86891) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 01:11:53 devstack cinder-volume[86891]: INFO cinder.volume.manager [req-545cdb21-a42a-4f3e-af0a-bc8e2b064cee req-ccddcf1b-5ce0-4cbb-9dc1-5c85882961da tempest-AttachVolumeNegativeTest-1781307442 None] attachment_update completed successfully.
Jul 03 01:11:54 devstack sudo[96062]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:54 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9c501cdc-7e2a-4b0e-88f9-bea2fd2c4d12 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-71dd02e3-75aa-4587-9a96-ff4dfedf2c20" returned: 0 in 0.818s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:54 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-9c501cdc-7e2a-4b0e-88f9-bea2fd2c4d12 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Lock "cinder-quobyte-71dd02e3-75aa-4587-9a96-ff4dfedf2c20" released by "delete_volume" :: held 2.026s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:11:54 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-9c501cdc-7e2a-4b0e-88f9-bea2fd2c4d12 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Created reservations ['0623326c-fceb-43fb-a521-75ab4e058ec2', '32ecb887-c783-4b17-8de6-45bd48634d91', '5e881c5b-940d-47e8-a68f-36dafffd169b', '78a95f35-5298-42ca-88fe-0fe5a6b16bb7'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:11:54 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-9c501cdc-7e2a-4b0e-88f9-bea2fd2c4d12 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:11:54 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-9c501cdc-7e2a-4b0e-88f9-bea2fd2c4d12 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:11:54 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-9c501cdc-7e2a-4b0e-88f9-bea2fd2c4d12 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:11:54 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-9c501cdc-7e2a-4b0e-88f9-bea2fd2c4d12 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:11:54 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-9c501cdc-7e2a-4b0e-88f9-bea2fd2c4d12 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:11:54 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9c501cdc-7e2a-4b0e-88f9-bea2fd2c4d12 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:54 devstack sudo[96138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:11:54 devstack sudo[96138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:54 devstack sudo[96065]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:54 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8016efd0-6a4e-436d-992e-bb1e62f6a78b tempest-GroupSnapshotsTest-1320333608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2bea568-7bd3-47de-9f47-9a4641195915" returned: 0 in 1.069s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:54 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8016efd0-6a4e-436d-992e-bb1e62f6a78b tempest-GroupSnapshotsTest-1320333608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2bea568-7bd3-47de-9f47-9a4641195915 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:54 devstack sudo[96142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2bea568-7bd3-47de-9f47-9a4641195915
Jul 03 01:11:54 devstack sudo[96142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:55 devstack sudo[96138]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9c501cdc-7e2a-4b0e-88f9-bea2fd2c4d12 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.785s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:55 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-9c501cdc-7e2a-4b0e-88f9-bea2fd2c4d12 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:11:55 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-9c501cdc-7e2a-4b0e-88f9-bea2fd2c4d12 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Deleted volume successfully.
Jul 03 01:11:55 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-9c501cdc-7e2a-4b0e-88f9-bea2fd2c4d12 tempest-VolumeSnapshotQuotasNegativeTestJSON-616898446 None] Lock "cinder-71dd02e3-75aa-4587-9a96-ff4dfedf2c20-delete_volume" released by "delete_volume" :: held 3.118s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:11:55 devstack sudo[96142]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8016efd0-6a4e-436d-992e-bb1e62f6a78b tempest-GroupSnapshotsTest-1320333608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2bea568-7bd3-47de-9f47-9a4641195915" returned: 0 in 1.016s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:55 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8016efd0-6a4e-436d-992e-bb1e62f6a78b tempest-GroupSnapshotsTest-1320333608 None] Lock "cinder-quobyte-e2bea568-7bd3-47de-9f47-9a4641195915" released by "delete_volume" :: held 2.158s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:11:55 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-8016efd0-6a4e-436d-992e-bb1e62f6a78b tempest-GroupSnapshotsTest-1320333608 None] Created reservations ['a177e579-f0b4-43eb-bc12-9b0212ab078b'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:11:55 devstack cinder-volume[86891]: WARNING cinder.quota [None req-8016efd0-6a4e-436d-992e-bb1e62f6a78b tempest-GroupSnapshotsTest-1320333608 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1481883157 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1481883157, it is now deprecated. Please use the default quota class for default quota.
Jul 03 01:11:55 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-8016efd0-6a4e-436d-992e-bb1e62f6a78b tempest-GroupSnapshotsTest-1320333608 None] Created reservations ['977a8cbf-778c-4b8e-a36f-508b7f0d4bff', '3eabc225-87f2-4030-84b1-cd504773ea53', '1a86b69a-d7c2-4503-963e-a33e414a8eed', 'f27e020b-dd69-4549-9431-f3ff830e3b51'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:11:55 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-8016efd0-6a4e-436d-992e-bb1e62f6a78b tempest-GroupSnapshotsTest-1320333608 None] Created reservations ['806f0739-f225-4fd7-a980-2f166b97350f', 'd565b117-d0d8-404d-a8bc-2cb7d25d8766', 'f96387b6-0b83-432c-a63c-d721bcda8994', 'ca0778da-ad55-41f0-84e4-b674fa79e5ed'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:11:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-8016efd0-6a4e-436d-992e-bb1e62f6a78b tempest-GroupSnapshotsTest-1320333608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:11:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-8016efd0-6a4e-436d-992e-bb1e62f6a78b tempest-GroupSnapshotsTest-1320333608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:11:56 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-8016efd0-6a4e-436d-992e-bb1e62f6a78b tempest-GroupSnapshotsTest-1320333608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:11:56 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-8016efd0-6a4e-436d-992e-bb1e62f6a78b tempest-GroupSnapshotsTest-1320333608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:11:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-8016efd0-6a4e-436d-992e-bb1e62f6a78b tempest-GroupSnapshotsTest-1320333608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:11:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8016efd0-6a4e-436d-992e-bb1e62f6a78b tempest-GroupSnapshotsTest-1320333608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:56 devstack sudo[96464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:11:56 devstack sudo[96464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:11:56 devstack sudo[96464]: pam_unix(sudo:session): session closed for user root
Jul 03 01:11:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8016efd0-6a4e-436d-992e-bb1e62f6a78b tempest-GroupSnapshotsTest-1320333608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.787s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:11:56 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-8016efd0-6a4e-436d-992e-bb1e62f6a78b tempest-GroupSnapshotsTest-1320333608 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:11:56 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-8016efd0-6a4e-436d-992e-bb1e62f6a78b tempest-GroupSnapshotsTest-1320333608 None] Delete group completed successfully.
Jul 03 01:11:57 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-ab4bbb03-6dec-443a-bbf0-42c5d267a4f4 tempest-GroupSnapshotsTest-1320333608 None] Group tempest-GroupSnapshotsTest-Group-374304575: creating
Jul 03 01:11:57 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-ab4bbb03-6dec-443a-bbf0-42c5d267a4f4 tempest-GroupSnapshotsTest-1320333608 None] Group tempest-GroupSnapshotsTest-Group-374304575: created successfully
Jul 03 01:11:57 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-ab4bbb03-6dec-443a-bbf0-42c5d267a4f4 tempest-GroupSnapshotsTest-1320333608 None] Create group completed successfully.
Jul 03 01:11:58 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-0700b5ed-f097-4a90-b153-93b8de14976e tempest-GroupSnapshotsTest-1320333608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:11:59 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-0700b5ed-f097-4a90-b153-93b8de14976e tempest-GroupSnapshotsTest-1320333608 None] Flow 'volume_create_manager' (7a325fd1-55fa-41e6-929d-9e056728b8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:11:59 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-0700b5ed-f097-4a90-b153-93b8de14976e tempest-GroupSnapshotsTest-1320333608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b7faec7-b6ed-48dc-be68-951bdd6cf3b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:11:59 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-0700b5ed-f097-4a90-b153-93b8de14976e tempest-GroupSnapshotsTest-1320333608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b7faec7-b6ed-48dc-be68-951bdd6cf3b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:11:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-203404166',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=dfd9b9a6-755b-4f65-87b9-8f852d02b152,host='devstack@QuobyteHD#QuobyteHD',id=8c0929ce-7aa9-42bf-86d8-839708b454a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='605b15a8b401420c832ed398e7a562bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:11:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:11:59Z,use_quota=True,user_id='aee26ffd1cc24952b7327629329664f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(779c0e49-df3e-4a13-a6e6-bbbcbd27183f),volume_type_id=779c0e49-df3e-4a13-a6e6-bbbcbd27183f)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:11:59 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-0700b5ed-f097-4a90-b153-93b8de14976e tempest-GroupSnapshotsTest-1320333608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d86a5133-7fbe-4123-8446-9122d9e87886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:11:59 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-0700b5ed-f097-4a90-b153-93b8de14976e tempest-GroupSnapshotsTest-1320333608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d86a5133-7fbe-4123-8446-9122d9e87886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:11:59 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-0700b5ed-f097-4a90-b153-93b8de14976e tempest-GroupSnapshotsTest-1320333608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f20f1b6-304b-4925-8b68-16a5f54482a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:11:59 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-0700b5ed-f097-4a90-b153-93b8de14976e tempest-GroupSnapshotsTest-1320333608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f20f1b6-304b-4925-8b68-16a5f54482a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c0929ce-7aa9-42bf-86d8-839708b454a5', 'volume_name': 'volume-8c0929ce-7aa9-42bf-86d8-839708b454a5', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:11:59 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-0700b5ed-f097-4a90-b153-93b8de14976e tempest-GroupSnapshotsTest-1320333608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c6770e3-2ebe-42b6-a741-f386f876ab28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:11:59 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-0700b5ed-f097-4a90-b153-93b8de14976e tempest-GroupSnapshotsTest-1320333608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c6770e3-2ebe-42b6-a741-f386f876ab28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:11:59 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-0700b5ed-f097-4a90-b153-93b8de14976e tempest-GroupSnapshotsTest-1320333608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66b3d33b-36b1-4513-8610-967181d7e1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:11:59 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-0700b5ed-f097-4a90-b153-93b8de14976e tempest-GroupSnapshotsTest-1320333608 None] Volume 8c0929ce-7aa9-42bf-86d8-839708b454a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c0929ce-7aa9-42bf-86d8-839708b454a5', 'volume_size': 1}
Jul 03 01:11:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-0700b5ed-f097-4a90-b153-93b8de14976e tempest-GroupSnapshotsTest-1320333608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:11:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-0700b5ed-f097-4a90-b153-93b8de14976e tempest-GroupSnapshotsTest-1320333608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:11:59 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-0700b5ed-f097-4a90-b153-93b8de14976e tempest-GroupSnapshotsTest-1320333608 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=dfd9b9a6-755b-4f65-87b9-8f852d02b152,created_at=2026-07-02T23:11:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-203404166',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=dfd9b9a6-755b-4f65-87b9-8f852d02b152,host='devstack@QuobyteHD#QuobyteHD',id=8c0929ce-7aa9-42bf-86d8-839708b454a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='605b15a8b401420c832ed398e7a562bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:11:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:11:59Z,use_quota=True,user_id='aee26ffd1cc24952b7327629329664f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(779c0e49-df3e-4a13-a6e6-bbbcbd27183f),volume_type_id=779c0e49-df3e-4a13-a6e6-bbbcbd27183f)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:11:59 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-0700b5ed-f097-4a90-b153-93b8de14976e tempest-GroupSnapshotsTest-1320333608 None] Creating volume 8c0929ce-7aa9-42bf-86d8-839708b454a5 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:11:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-0700b5ed-f097-4a90-b153-93b8de14976e tempest-GroupSnapshotsTest-1320333608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:11:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-0700b5ed-f097-4a90-b153-93b8de14976e tempest-GroupSnapshotsTest-1320333608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:11:59 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-0700b5ed-f097-4a90-b153-93b8de14976e tempest-GroupSnapshotsTest-1320333608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:11:59 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-0700b5ed-f097-4a90-b153-93b8de14976e tempest-GroupSnapshotsTest-1320333608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:11:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-0700b5ed-f097-4a90-b153-93b8de14976e tempest-GroupSnapshotsTest-1320333608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:11:59 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-0700b5ed-f097-4a90-b153-93b8de14976e tempest-GroupSnapshotsTest-1320333608 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:11:59 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-0700b5ed-f097-4a90-b153-93b8de14976e tempest-GroupSnapshotsTest-1320333608 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:11:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0700b5ed-f097-4a90-b153-93b8de14976e tempest-GroupSnapshotsTest-1320333608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8c0929ce-7aa9-42bf-86d8-839708b454a5 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:11:59 devstack sudo[96468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8c0929ce-7aa9-42bf-86d8-839708b454a5 1073741824
Jul 03 01:11:59 devstack sudo[96468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:12:00 devstack sudo[96468]: pam_unix(sudo:session): session closed for user root
Jul 03 01:12:00 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0700b5ed-f097-4a90-b153-93b8de14976e tempest-GroupSnapshotsTest-1320333608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8c0929ce-7aa9-42bf-86d8-839708b454a5 1073741824" returned: 0 in 1.059s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:12:00 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0700b5ed-f097-4a90-b153-93b8de14976e tempest-GroupSnapshotsTest-1320333608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8c0929ce-7aa9-42bf-86d8-839708b454a5 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:12:00 devstack sudo[96474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8c0929ce-7aa9-42bf-86d8-839708b454a5
Jul 03 01:12:00 devstack sudo[96474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:12:00 devstack cinder-volume[86891]: INFO cinder.volume.manager [req-c2a0830d-0bdd-48f2-83f1-25eaa9c75a06 req-435adbbb-cdee-48ba-947e-f2944138d5c0 tempest-AttachVolumeNegativeTest-1781307442 None] Terminate volume connection completed successfully.
Jul 03 01:12:00 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [req-c2a0830d-0bdd-48f2-83f1-25eaa9c75a06 req-435adbbb-cdee-48ba-947e-f2944138d5c0 tempest-AttachVolumeNegativeTest-1781307442 None] Deleting attachment e784a271-4d32-4aa9-9b04-15821fca3b6c. {{(pid=86891) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 01:12:01 devstack sudo[96474]: pam_unix(sudo:session): session closed for user root
Jul 03 01:12:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0700b5ed-f097-4a90-b153-93b8de14976e tempest-GroupSnapshotsTest-1320333608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8c0929ce-7aa9-42bf-86d8-839708b454a5" returned: 0 in 1.081s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:12:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-0700b5ed-f097-4a90-b153-93b8de14976e tempest-GroupSnapshotsTest-1320333608 None] <== create_volume: return (2192ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:12:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-0700b5ed-f097-4a90-b153-93b8de14976e tempest-GroupSnapshotsTest-1320333608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.196s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:12:01 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-0700b5ed-f097-4a90-b153-93b8de14976e tempest-GroupSnapshotsTest-1320333608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66b3d33b-36b1-4513-8610-967181d7e1da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c0929ce-7aa9-42bf-86d8-839708b454a5', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:12:01 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-0700b5ed-f097-4a90-b153-93b8de14976e tempest-GroupSnapshotsTest-1320333608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7a3e6dc-a189-4abf-a297-393dd416264f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:12:01 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-0700b5ed-f097-4a90-b153-93b8de14976e tempest-GroupSnapshotsTest-1320333608 None] Volume volume-8c0929ce-7aa9-42bf-86d8-839708b454a5 (8c0929ce-7aa9-42bf-86d8-839708b454a5): created successfully
Jul 03 01:12:01 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-0700b5ed-f097-4a90-b153-93b8de14976e tempest-GroupSnapshotsTest-1320333608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7a3e6dc-a189-4abf-a297-393dd416264f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:12:01 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-0700b5ed-f097-4a90-b153-93b8de14976e tempest-GroupSnapshotsTest-1320333608 None] Flow 'volume_create_manager' (7a325fd1-55fa-41e6-929d-9e056728b8cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:12:01 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-0700b5ed-f097-4a90-b153-93b8de14976e tempest-GroupSnapshotsTest-1320333608 None] Created volume successfully.
Jul 03 01:12:01 devstack cinder-volume[86891]: DEBUG oslo_service.periodic_task [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86891) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 01:12:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:12:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:12:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:12:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:12:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:12:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:12:01 devstack sudo[96511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:12:01 devstack sudo[96511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:12:02 devstack sudo[96511]: pam_unix(sudo:session): session closed for user root
Jul 03 01:12:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.922s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:12:02 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:12:02 devstack cinder-volume[86891]: DEBUG oslo_service.periodic_task [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running periodic task VolumeManager._thread_info {{(pid=86891) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 01:12:02 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] thread count: 28 {{(pid=86891) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 01:12:02 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] thread info: [<_MainThread(MainThread, started 136731296534656)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136731184953280)>, <Thread(Thread-3 (stat_writer), started daemon 136731184058816)>, <Thread(Rabbit-heartbeat, started daemon 136731184846080)>, <Thread(Thread-5 (_runner), started daemon 136731182936576)>, <Thread(Thread-7 (_runner), started daemon 136731182954944)>, <Thread(fd_logger, started daemon 136731181916416)>, <Thread(privsep_reader, started daemon 136731180942208)>, <Thread(tpool_thread_0, started daemon 136731172161216)>, <Thread(tpool_thread_1, started daemon 136731163768512)>, <Thread(tpool_thread_2, started daemon 136731155375808)>, <Thread(tpool_thread_3, started daemon 136731146983104)>, <Thread(tpool_thread_4, started daemon 136731138590400)>, <Thread(tpool_thread_5, started daemon 136731130197696)>, <Thread(tpool_thread_6, started daemon 136731121804992)>, <Thread(tpool_thread_7, started daemon 136731113412288)>, <Thread(tpool_thread_8, started daemon 136731105003200)>, <Thread(tpool_thread_9, started daemon 136731096594112)>, <Thread(tpool_thread_10, started daemon 136731088185024)>, <Thread(tpool_thread_11, started daemon 136731079775936)>, <Thread(tpool_thread_12, started daemon 136731071366848)>, <Thread(tpool_thread_13, started daemon 136731062957760)>, <Thread(tpool_thread_14, started daemon 136731054548672)>, <Thread(tpool_thread_15, started daemon 136731046139584)>, <Thread(tpool_thread_16, started daemon 136731037730496)>, <Thread(tpool_thread_17, started daemon 136731029321408)>, <Thread(tpool_thread_18, started daemon 136731020912320)>, <Thread(tpool_thread_19, started daemon 136731012503232)>] {{(pid=86891) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 01:12:03 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-47aeecee-2a90-4d02-be7b-487ca4515942 tempest-GroupSnapshotsTest-1320333608 None] GroupSnapshot 7bb771e9-88ed-491f-8717-674224325763: creating.
Jul 03 01:12:03 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-47aeecee-2a90-4d02-be7b-487ca4515942 tempest-GroupSnapshotsTest-1320333608 None] Group snapshot 7bb771e9-88ed-491f-8717-674224325763: creating. {{(pid=86891) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 03 01:12:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-47aeecee-2a90-4d02-be7b-487ca4515942 tempest-GroupSnapshotsTest-1320333608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:12:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-47aeecee-2a90-4d02-be7b-487ca4515942 tempest-GroupSnapshotsTest-1320333608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:12:03 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-47aeecee-2a90-4d02-be7b-487ca4515942 tempest-GroupSnapshotsTest-1320333608 None] Creating offline snapshot 615f24d4-9e79-4c68-89e3-d824ebf20ac0 of volume 8c0929ce-7aa9-42bf-86d8-839708b454a5 {{(pid=86891) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 01:12:03 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[4321922d-af93-4169-8cd3-77fe6ed394d3]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:12:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-47aeecee-2a90-4d02-be7b-487ca4515942 tempest-GroupSnapshotsTest-1320333608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8c0929ce-7aa9-42bf-86d8-839708b454a5 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:12:03 devstack sudo[96524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8c0929ce-7aa9-42bf-86d8-839708b454a5
Jul 03 01:12:03 devstack sudo[96524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:12:04 devstack sudo[96524]: pam_unix(sudo:session): session closed for user root
Jul 03 01:12:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-47aeecee-2a90-4d02-be7b-487ca4515942 tempest-GroupSnapshotsTest-1320333608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8c0929ce-7aa9-42bf-86d8-839708b454a5" returned: 0 in 1.196s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:12:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-47aeecee-2a90-4d02-be7b-487ca4515942 tempest-GroupSnapshotsTest-1320333608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8c0929ce-7aa9-42bf-86d8-839708b454a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8c0929ce-7aa9-42bf-86d8-839708b454a5.615f24d4-9e79-4c68-89e3-d824ebf20ac0 1G {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:12:04 devstack sudo[96567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8c0929ce-7aa9-42bf-86d8-839708b454a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8c0929ce-7aa9-42bf-86d8-839708b454a5.615f24d4-9e79-4c68-89e3-d824ebf20ac0 1G
Jul 03 01:12:04 devstack sudo[96567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:12:05 devstack sudo[96567]: pam_unix(sudo:session): session closed for user root
Jul 03 01:12:05 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-47aeecee-2a90-4d02-be7b-487ca4515942 tempest-GroupSnapshotsTest-1320333608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8c0929ce-7aa9-42bf-86d8-839708b454a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8c0929ce-7aa9-42bf-86d8-839708b454a5.615f24d4-9e79-4c68-89e3-d824ebf20ac0 1G" returned: 0 in 1.153s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:12:05 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-47aeecee-2a90-4d02-be7b-487ca4515942 tempest-GroupSnapshotsTest-1320333608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c0929ce-7aa9-42bf-86d8-839708b454a5 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8c0929ce-7aa9-42bf-86d8-839708b454a5.615f24d4-9e79-4c68-89e3-d824ebf20ac0 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:12:05 devstack sudo[96576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c0929ce-7aa9-42bf-86d8-839708b454a5 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8c0929ce-7aa9-42bf-86d8-839708b454a5.615f24d4-9e79-4c68-89e3-d824ebf20ac0
Jul 03 01:12:05 devstack sudo[96576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:12:06 devstack sudo[96576]: pam_unix(sudo:session): session closed for user root
Jul 03 01:12:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-47aeecee-2a90-4d02-be7b-487ca4515942 tempest-GroupSnapshotsTest-1320333608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c0929ce-7aa9-42bf-86d8-839708b454a5 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8c0929ce-7aa9-42bf-86d8-839708b454a5.615f24d4-9e79-4c68-89e3-d824ebf20ac0" returned: 0 in 1.029s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:12:06 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-47aeecee-2a90-4d02-be7b-487ca4515942 tempest-GroupSnapshotsTest-1320333608 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8c0929ce-7aa9-42bf-86d8-839708b454a5.615f24d4-9e79-4c68-89e3-d824ebf20ac0 is being set with open permissions: ugo+rw: NotImplementedError
Jul 03 01:12:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-47aeecee-2a90-4d02-be7b-487ca4515942 tempest-GroupSnapshotsTest-1320333608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8c0929ce-7aa9-42bf-86d8-839708b454a5.615f24d4-9e79-4c68-89e3-d824ebf20ac0 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:12:06 devstack sudo[96586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8c0929ce-7aa9-42bf-86d8-839708b454a5.615f24d4-9e79-4c68-89e3-d824ebf20ac0
Jul 03 01:12:06 devstack sudo[96586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:12:07 devstack sudo[96586]: pam_unix(sudo:session): session closed for user root
Jul 03 01:12:07 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-47aeecee-2a90-4d02-be7b-487ca4515942 tempest-GroupSnapshotsTest-1320333608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8c0929ce-7aa9-42bf-86d8-839708b454a5.615f24d4-9e79-4c68-89e3-d824ebf20ac0" returned: 0 in 0.790s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:12:07 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-47aeecee-2a90-4d02-be7b-487ca4515942 tempest-GroupSnapshotsTest-1320333608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8c0929ce-7aa9-42bf-86d8-839708b454a5.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:12:07 devstack sudo[96589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8c0929ce-7aa9-42bf-86d8-839708b454a5.info
Jul 03 01:12:07 devstack sudo[96589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:12:08 devstack sudo[96589]: pam_unix(sudo:session): session closed for user root
Jul 03 01:12:08 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-47aeecee-2a90-4d02-be7b-487ca4515942 tempest-GroupSnapshotsTest-1320333608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8c0929ce-7aa9-42bf-86d8-839708b454a5.info" returned: 0 in 0.924s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:12:08 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-47aeecee-2a90-4d02-be7b-487ca4515942 tempest-GroupSnapshotsTest-1320333608 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8c0929ce-7aa9-42bf-86d8-839708b454a5.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 03 01:12:08 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-47aeecee-2a90-4d02-be7b-487ca4515942 tempest-GroupSnapshotsTest-1320333608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8c0929ce-7aa9-42bf-86d8-839708b454a5.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:12:08 devstack sudo[96639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8c0929ce-7aa9-42bf-86d8-839708b454a5.info
Jul 03 01:12:08 devstack sudo[96639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:12:09 devstack sudo[96639]: pam_unix(sudo:session): session closed for user root
Jul 03 01:12:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-47aeecee-2a90-4d02-be7b-487ca4515942 tempest-GroupSnapshotsTest-1320333608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8c0929ce-7aa9-42bf-86d8-839708b454a5.info" returned: 0 in 1.180s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:12:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-47aeecee-2a90-4d02-be7b-487ca4515942 tempest-GroupSnapshotsTest-1320333608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.422s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:12:09 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-47aeecee-2a90-4d02-be7b-487ca4515942 tempest-GroupSnapshotsTest-1320333608 None] group_snapshot 7bb771e9-88ed-491f-8717-674224325763: created successfully
Jul 03 01:12:10 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-c8f1d7e5-8c5d-443b-a44f-ac87346a1c1d tempest-GroupSnapshotsTest-1320333608 None] group_snapshot 7bb771e9-88ed-491f-8717-674224325763: deleting
Jul 03 01:12:10 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c8f1d7e5-8c5d-443b-a44f-ac87346a1c1d tempest-GroupSnapshotsTest-1320333608 None] group_snapshot 7bb771e9-88ed-491f-8717-674224325763: deleting {{(pid=86891) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 03 01:12:10 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-c8f1d7e5-8c5d-443b-a44f-ac87346a1c1d tempest-GroupSnapshotsTest-1320333608 None] Acquiring lock "cinder-quobyte-8c0929ce-7aa9-42bf-86d8-839708b454a5" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:12:10 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-c8f1d7e5-8c5d-443b-a44f-ac87346a1c1d tempest-GroupSnapshotsTest-1320333608 None] Lock "cinder-quobyte-8c0929ce-7aa9-42bf-86d8-839708b454a5" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:12:10 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-c8f1d7e5-8c5d-443b-a44f-ac87346a1c1d tempest-GroupSnapshotsTest-1320333608 None] Acquiring lock "cinder-quobyte-615f24d4-9e79-4c68-89e3-d824ebf20ac0" by "_delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:12:10 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-c8f1d7e5-8c5d-443b-a44f-ac87346a1c1d tempest-GroupSnapshotsTest-1320333608 None] Lock "cinder-quobyte-615f24d4-9e79-4c68-89e3-d824ebf20ac0" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:12:10 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-c8f1d7e5-8c5d-443b-a44f-ac87346a1c1d tempest-GroupSnapshotsTest-1320333608 None] Deleting offline snapshot 615f24d4-9e79-4c68-89e3-d824ebf20ac0 of volume 8c0929ce-7aa9-42bf-86d8-839708b454a5 {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 01:12:10 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-c8f1d7e5-8c5d-443b-a44f-ac87346a1c1d tempest-GroupSnapshotsTest-1320333608 None] snapshot_file for this snap is: volume-8c0929ce-7aa9-42bf-86d8-839708b454a5.615f24d4-9e79-4c68-89e3-d824ebf20ac0 {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 01:12:10 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[8249abfd-998c-440a-a27f-8f60e2af7565]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:12:10 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c8f1d7e5-8c5d-443b-a44f-ac87346a1c1d tempest-GroupSnapshotsTest-1320333608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8c0929ce-7aa9-42bf-86d8-839708b454a5.615f24d4-9e79-4c68-89e3-d824ebf20ac0 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:12:11 devstack sudo[96663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8c0929ce-7aa9-42bf-86d8-839708b454a5.615f24d4-9e79-4c68-89e3-d824ebf20ac0
Jul 03 01:12:11 devstack sudo[96663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:12:12 devstack sudo[96663]: pam_unix(sudo:session): session closed for user root
Jul 03 01:12:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c8f1d7e5-8c5d-443b-a44f-ac87346a1c1d tempest-GroupSnapshotsTest-1320333608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8c0929ce-7aa9-42bf-86d8-839708b454a5.615f24d4-9e79-4c68-89e3-d824ebf20ac0" returned: 0 in 1.123s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:12:12 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-c8f1d7e5-8c5d-443b-a44f-ac87346a1c1d tempest-GroupSnapshotsTest-1320333608 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c0929ce-7aa9-42bf-86d8-839708b454a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:12:12 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[729c6541-a678-4db0-b8d8-8577fce76ff8]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:12:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c8f1d7e5-8c5d-443b-a44f-ac87346a1c1d tempest-GroupSnapshotsTest-1320333608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8c0929ce-7aa9-42bf-86d8-839708b454a5 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:12:12 devstack sudo[96669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8c0929ce-7aa9-42bf-86d8-839708b454a5
Jul 03 01:12:12 devstack sudo[96669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:12:13 devstack sudo[96669]: pam_unix(sudo:session): session closed for user root
Jul 03 01:12:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c8f1d7e5-8c5d-443b-a44f-ac87346a1c1d tempest-GroupSnapshotsTest-1320333608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8c0929ce-7aa9-42bf-86d8-839708b454a5" returned: 0 in 1.103s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:12:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c8f1d7e5-8c5d-443b-a44f-ac87346a1c1d tempest-GroupSnapshotsTest-1320333608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8c0929ce-7aa9-42bf-86d8-839708b454a5.615f24d4-9e79-4c68-89e3-d824ebf20ac0 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:12:13 devstack sudo[96676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8c0929ce-7aa9-42bf-86d8-839708b454a5.615f24d4-9e79-4c68-89e3-d824ebf20ac0
Jul 03 01:12:13 devstack sudo[96676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:12:13 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-395413d6-ffae-453c-8a5f-a8d840601007 tempest-AttachVolumeNegativeTest-1781307442 None] Acquiring lock "cinder-62f555da-55ea-498d-81d2-bfe03541dd74-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:12:13 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-395413d6-ffae-453c-8a5f-a8d840601007 tempest-AttachVolumeNegativeTest-1781307442 None] Lock "cinder-62f555da-55ea-498d-81d2-bfe03541dd74-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:12:13 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-395413d6-ffae-453c-8a5f-a8d840601007 tempest-AttachVolumeNegativeTest-1781307442 None] Acquiring lock "cinder-quobyte-62f555da-55ea-498d-81d2-bfe03541dd74" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:12:14 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-395413d6-ffae-453c-8a5f-a8d840601007 tempest-AttachVolumeNegativeTest-1781307442 None] Lock "cinder-quobyte-62f555da-55ea-498d-81d2-bfe03541dd74" acquired by "delete_volume" :: waited 0.078s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:12:14 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[63311ed2-a26b-4a7a-b58e-e4f58a6a2eb6]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:12:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-395413d6-ffae-453c-8a5f-a8d840601007 tempest-AttachVolumeNegativeTest-1781307442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-62f555da-55ea-498d-81d2-bfe03541dd74 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:12:14 devstack sudo[96678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-62f555da-55ea-498d-81d2-bfe03541dd74
Jul 03 01:12:14 devstack sudo[96678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:12:14 devstack sudo[96676]: pam_unix(sudo:session): session closed for user root
Jul 03 01:12:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c8f1d7e5-8c5d-443b-a44f-ac87346a1c1d tempest-GroupSnapshotsTest-1320333608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8c0929ce-7aa9-42bf-86d8-839708b454a5.615f24d4-9e79-4c68-89e3-d824ebf20ac0" returned: 0 in 1.367s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:12:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c8f1d7e5-8c5d-443b-a44f-ac87346a1c1d tempest-GroupSnapshotsTest-1320333608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8c0929ce-7aa9-42bf-86d8-839708b454a5.615f24d4-9e79-4c68-89e3-d824ebf20ac0 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:12:14 devstack sudo[96684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8c0929ce-7aa9-42bf-86d8-839708b454a5.615f24d4-9e79-4c68-89e3-d824ebf20ac0
Jul 03 01:12:14 devstack sudo[96684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:12:15 devstack sudo[96678]: pam_unix(sudo:session): session closed for user root
Jul 03 01:12:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-395413d6-ffae-453c-8a5f-a8d840601007 tempest-AttachVolumeNegativeTest-1781307442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-62f555da-55ea-498d-81d2-bfe03541dd74" returned: 0 in 1.151s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:12:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-395413d6-ffae-453c-8a5f-a8d840601007 tempest-AttachVolumeNegativeTest-1781307442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-62f555da-55ea-498d-81d2-bfe03541dd74 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:12:15 devstack sudo[96689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-62f555da-55ea-498d-81d2-bfe03541dd74
Jul 03 01:12:15 devstack sudo[96689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:12:15 devstack sudo[96684]: pam_unix(sudo:session): session closed for user root
Jul 03 01:12:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c8f1d7e5-8c5d-443b-a44f-ac87346a1c1d tempest-GroupSnapshotsTest-1320333608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8c0929ce-7aa9-42bf-86d8-839708b454a5.615f24d4-9e79-4c68-89e3-d824ebf20ac0" returned: 0 in 1.093s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:12:15 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-c8f1d7e5-8c5d-443b-a44f-ac87346a1c1d tempest-GroupSnapshotsTest-1320333608 None] Lock "cinder-quobyte-615f24d4-9e79-4c68-89e3-d824ebf20ac0" released by "_delete_snapshot" :: held 4.900s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:12:15 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-c8f1d7e5-8c5d-443b-a44f-ac87346a1c1d tempest-GroupSnapshotsTest-1320333608 None] Lock "cinder-quobyte-8c0929ce-7aa9-42bf-86d8-839708b454a5" released by "delete_snapshot" :: held 4.948s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:12:15 devstack cinder-volume[86891]: WARNING cinder.quota [None req-c8f1d7e5-8c5d-443b-a44f-ac87346a1c1d tempest-GroupSnapshotsTest-1320333608 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-657873822 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-657873822, it is now deprecated. Please use the default quota class for default quota.
Jul 03 01:12:15 devstack cinder-volume[86891]: WARNING cinder.quota [None req-c8f1d7e5-8c5d-443b-a44f-ac87346a1c1d tempest-GroupSnapshotsTest-1320333608 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-657873822 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-657873822, it is now deprecated. Please use the default quota class for default quota.
Jul 03 01:12:15 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-c8f1d7e5-8c5d-443b-a44f-ac87346a1c1d tempest-GroupSnapshotsTest-1320333608 None] Created reservations ['6a31e1c1-7efc-40a1-a3a3-648af753e831', 'd589368c-c1e6-4d81-82ba-5757426bc383', '0349db25-5963-46dd-82ca-678dd8b5d2b9', '62524316-e753-4258-8a40-4ace79b670c4'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:12:16 devstack sudo[96689]: pam_unix(sudo:session): session closed for user root
Jul 03 01:12:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-395413d6-ffae-453c-8a5f-a8d840601007 tempest-AttachVolumeNegativeTest-1781307442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-62f555da-55ea-498d-81d2-bfe03541dd74" returned: 0 in 0.798s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:12:16 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-395413d6-ffae-453c-8a5f-a8d840601007 tempest-AttachVolumeNegativeTest-1781307442 None] Lock "cinder-quobyte-62f555da-55ea-498d-81d2-bfe03541dd74" released by "delete_volume" :: held 2.031s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:12:16 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-c8f1d7e5-8c5d-443b-a44f-ac87346a1c1d tempest-GroupSnapshotsTest-1320333608 None] group_snapshot 7bb771e9-88ed-491f-8717-674224325763: deleted successfully
Jul 03 01:12:16 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-395413d6-ffae-453c-8a5f-a8d840601007 tempest-AttachVolumeNegativeTest-1781307442 None] Created reservations ['e8b19006-bb03-43bd-b2e4-564d06eb5234', '40359f93-2a15-4d1c-9e1d-4f5a6934bbfa', 'db189946-a0e8-42dd-9abb-8d5841c9df1f', '45c028f4-d107-4d9b-bcca-83160ade7f33'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:12:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-395413d6-ffae-453c-8a5f-a8d840601007 tempest-AttachVolumeNegativeTest-1781307442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:12:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-395413d6-ffae-453c-8a5f-a8d840601007 tempest-AttachVolumeNegativeTest-1781307442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:12:16 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-395413d6-ffae-453c-8a5f-a8d840601007 tempest-AttachVolumeNegativeTest-1781307442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:12:16 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-395413d6-ffae-453c-8a5f-a8d840601007 tempest-AttachVolumeNegativeTest-1781307442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:12:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-395413d6-ffae-453c-8a5f-a8d840601007 tempest-AttachVolumeNegativeTest-1781307442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:12:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-395413d6-ffae-453c-8a5f-a8d840601007 tempest-AttachVolumeNegativeTest-1781307442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:12:16 devstack sudo[96693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:12:16 devstack sudo[96693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:12:16 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-c796e50f-ee99-4b57-9cb4-7ad1a45b1ec8 tempest-AttachVolumeNegativeTest-1781307442 None] Acquiring lock "cinder-8b139c6e-e277-4edc-85af-ebc3321ed3a1-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:12:16 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-c796e50f-ee99-4b57-9cb4-7ad1a45b1ec8 tempest-AttachVolumeNegativeTest-1781307442 None] Lock "cinder-8b139c6e-e277-4edc-85af-ebc3321ed3a1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:12:16 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-c796e50f-ee99-4b57-9cb4-7ad1a45b1ec8 tempest-AttachVolumeNegativeTest-1781307442 None] Acquiring lock "cinder-quobyte-8b139c6e-e277-4edc-85af-ebc3321ed3a1" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:12:16 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-c796e50f-ee99-4b57-9cb4-7ad1a45b1ec8 tempest-AttachVolumeNegativeTest-1781307442 None] Lock "cinder-quobyte-8b139c6e-e277-4edc-85af-ebc3321ed3a1" acquired by "delete_volume" :: waited 0.043s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:12:16 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a5ba55a-cc1a-4c6b-80bc-8eab46d2a761]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:12:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c796e50f-ee99-4b57-9cb4-7ad1a45b1ec8 tempest-AttachVolumeNegativeTest-1781307442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b139c6e-e277-4edc-85af-ebc3321ed3a1 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:12:17 devstack sudo[96696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b139c6e-e277-4edc-85af-ebc3321ed3a1
Jul 03 01:12:17 devstack sudo[96696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:12:17 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-adf7d258-7747-4162-bc76-605677ae2495 tempest-GroupSnapshotsTest-1320333608 None] Acquiring lock "cinder-quobyte-8c0929ce-7aa9-42bf-86d8-839708b454a5" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:12:17 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-adf7d258-7747-4162-bc76-605677ae2495 tempest-GroupSnapshotsTest-1320333608 None] Lock "cinder-quobyte-8c0929ce-7aa9-42bf-86d8-839708b454a5" acquired by "delete_volume" :: waited 0.028s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:12:17 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee5cc99-dd5d-4350-ab5e-de357fbc286c]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:12:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-adf7d258-7747-4162-bc76-605677ae2495 tempest-GroupSnapshotsTest-1320333608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8c0929ce-7aa9-42bf-86d8-839708b454a5 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:12:17 devstack sudo[96698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8c0929ce-7aa9-42bf-86d8-839708b454a5
Jul 03 01:12:17 devstack sudo[96698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:12:17 devstack sudo[96693]: pam_unix(sudo:session): session closed for user root
Jul 03 01:12:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-395413d6-ffae-453c-8a5f-a8d840601007 tempest-AttachVolumeNegativeTest-1781307442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 1.575s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:12:17 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-395413d6-ffae-453c-8a5f-a8d840601007 tempest-AttachVolumeNegativeTest-1781307442 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:12:17 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-395413d6-ffae-453c-8a5f-a8d840601007 tempest-AttachVolumeNegativeTest-1781307442 None] Deleted volume successfully.
Jul 03 01:12:17 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-395413d6-ffae-453c-8a5f-a8d840601007 tempest-AttachVolumeNegativeTest-1781307442 None] Lock "cinder-62f555da-55ea-498d-81d2-bfe03541dd74-delete_volume" released by "delete_volume" :: held 4.059s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:12:18 devstack sudo[96696]: pam_unix(sudo:session): session closed for user root
Jul 03 01:12:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c796e50f-ee99-4b57-9cb4-7ad1a45b1ec8 tempest-AttachVolumeNegativeTest-1781307442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b139c6e-e277-4edc-85af-ebc3321ed3a1" returned: 0 in 1.413s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:12:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c796e50f-ee99-4b57-9cb4-7ad1a45b1ec8 tempest-AttachVolumeNegativeTest-1781307442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b139c6e-e277-4edc-85af-ebc3321ed3a1 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:12:18 devstack sudo[96706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b139c6e-e277-4edc-85af-ebc3321ed3a1
Jul 03 01:12:18 devstack sudo[96706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:12:18 devstack sudo[96698]: pam_unix(sudo:session): session closed for user root
Jul 03 01:12:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-adf7d258-7747-4162-bc76-605677ae2495 tempest-GroupSnapshotsTest-1320333608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8c0929ce-7aa9-42bf-86d8-839708b454a5" returned: 0 in 1.251s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:12:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-adf7d258-7747-4162-bc76-605677ae2495 tempest-GroupSnapshotsTest-1320333608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8c0929ce-7aa9-42bf-86d8-839708b454a5 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:12:18 devstack sudo[96711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8c0929ce-7aa9-42bf-86d8-839708b454a5
Jul 03 01:12:18 devstack sudo[96711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:12:19 devstack sudo[96706]: pam_unix(sudo:session): session closed for user root
Jul 03 01:12:19 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c796e50f-ee99-4b57-9cb4-7ad1a45b1ec8 tempest-AttachVolumeNegativeTest-1781307442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b139c6e-e277-4edc-85af-ebc3321ed3a1" returned: 0 in 1.408s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:12:19 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-c796e50f-ee99-4b57-9cb4-7ad1a45b1ec8 tempest-AttachVolumeNegativeTest-1781307442 None] Lock "cinder-quobyte-8b139c6e-e277-4edc-85af-ebc3321ed3a1" released by "delete_volume" :: held 2.905s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:12:19 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-c796e50f-ee99-4b57-9cb4-7ad1a45b1ec8 tempest-AttachVolumeNegativeTest-1781307442 None] Created reservations ['1304b267-7d8e-4756-909a-5da329a49a69', '045fb04f-fe7e-4031-9c8d-ffdafd1d4fa6', '579b8795-09a6-4120-8738-938f8dde6091', 'f106aa44-02ef-44c5-bc9f-189d643ffdaa'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:12:19 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-c796e50f-ee99-4b57-9cb4-7ad1a45b1ec8 tempest-AttachVolumeNegativeTest-1781307442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:12:19 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-c796e50f-ee99-4b57-9cb4-7ad1a45b1ec8 tempest-AttachVolumeNegativeTest-1781307442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:12:19 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-c796e50f-ee99-4b57-9cb4-7ad1a45b1ec8 tempest-AttachVolumeNegativeTest-1781307442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:12:19 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-c796e50f-ee99-4b57-9cb4-7ad1a45b1ec8 tempest-AttachVolumeNegativeTest-1781307442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:12:19 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-c796e50f-ee99-4b57-9cb4-7ad1a45b1ec8 tempest-AttachVolumeNegativeTest-1781307442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:12:19 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c796e50f-ee99-4b57-9cb4-7ad1a45b1ec8 tempest-AttachVolumeNegativeTest-1781307442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:12:19 devstack sudo[96715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:12:19 devstack sudo[96715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:12:20 devstack sudo[96711]: pam_unix(sudo:session): session closed for user root
Jul 03 01:12:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-adf7d258-7747-4162-bc76-605677ae2495 tempest-GroupSnapshotsTest-1320333608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8c0929ce-7aa9-42bf-86d8-839708b454a5" returned: 0 in 1.528s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:12:20 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-adf7d258-7747-4162-bc76-605677ae2495 tempest-GroupSnapshotsTest-1320333608 None] Lock "cinder-quobyte-8c0929ce-7aa9-42bf-86d8-839708b454a5" released by "delete_volume" :: held 2.935s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:12:20 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-adf7d258-7747-4162-bc76-605677ae2495 tempest-GroupSnapshotsTest-1320333608 None] Created reservations ['a17dee93-de99-4fa3-b87f-ae36b630ea72'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:12:20 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-eb153d99-e44d-4709-a449-a8b1b6e3f679 tempest-AttachVolumeNegativeTest-1781307442 None] Acquiring lock "cinder-76978973-d64e-40a3-9168-b3b62ca3031b-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:12:20 devstack cinder-volume[86891]: WARNING cinder.quota [None req-adf7d258-7747-4162-bc76-605677ae2495 tempest-GroupSnapshotsTest-1320333608 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-657873822 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-657873822, it is now deprecated. Please use the default quota class for default quota.
Jul 03 01:12:20 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-eb153d99-e44d-4709-a449-a8b1b6e3f679 tempest-AttachVolumeNegativeTest-1781307442 None] Lock "cinder-76978973-d64e-40a3-9168-b3b62ca3031b-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:12:20 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-adf7d258-7747-4162-bc76-605677ae2495 tempest-GroupSnapshotsTest-1320333608 None] Created reservations ['20b439ea-9646-49a0-ac64-a539f1b200aa', '13d252fa-5280-417f-a2ff-96317fab38d6', '3d4d3c16-e2ca-4e5f-bb44-fd8aa84013e7', 'bef3f4dd-d1c8-431f-8f9a-428d24cf7786'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:12:20 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-eb153d99-e44d-4709-a449-a8b1b6e3f679 tempest-AttachVolumeNegativeTest-1781307442 None] Acquiring lock "cinder-quobyte-76978973-d64e-40a3-9168-b3b62ca3031b" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:12:21 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-eb153d99-e44d-4709-a449-a8b1b6e3f679 tempest-AttachVolumeNegativeTest-1781307442 None] Lock "cinder-quobyte-76978973-d64e-40a3-9168-b3b62ca3031b" acquired by "delete_volume" :: waited 0.063s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:12:21 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a9c5e3-3673-4bec-8ca7-ff5d915619a3]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:12:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-eb153d99-e44d-4709-a449-a8b1b6e3f679 tempest-AttachVolumeNegativeTest-1781307442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-76978973-d64e-40a3-9168-b3b62ca3031b {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:12:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-adf7d258-7747-4162-bc76-605677ae2495 tempest-GroupSnapshotsTest-1320333608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:12:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-adf7d258-7747-4162-bc76-605677ae2495 tempest-GroupSnapshotsTest-1320333608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:12:21 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-adf7d258-7747-4162-bc76-605677ae2495 tempest-GroupSnapshotsTest-1320333608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:12:21 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-adf7d258-7747-4162-bc76-605677ae2495 tempest-GroupSnapshotsTest-1320333608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:12:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-adf7d258-7747-4162-bc76-605677ae2495 tempest-GroupSnapshotsTest-1320333608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:12:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-adf7d258-7747-4162-bc76-605677ae2495 tempest-GroupSnapshotsTest-1320333608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:12:21 devstack sudo[96721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:12:21 devstack sudo[96721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:12:21 devstack sudo[96720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-76978973-d64e-40a3-9168-b3b62ca3031b
Jul 03 01:12:21 devstack sudo[96720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:12:21 devstack sudo[96715]: pam_unix(sudo:session): session closed for user root
Jul 03 01:12:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c796e50f-ee99-4b57-9cb4-7ad1a45b1ec8 tempest-AttachVolumeNegativeTest-1781307442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 1.639s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:12:21 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-c796e50f-ee99-4b57-9cb4-7ad1a45b1ec8 tempest-AttachVolumeNegativeTest-1781307442 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:12:21 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-c796e50f-ee99-4b57-9cb4-7ad1a45b1ec8 tempest-AttachVolumeNegativeTest-1781307442 None] Deleted volume successfully.
Jul 03 01:12:21 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-c796e50f-ee99-4b57-9cb4-7ad1a45b1ec8 tempest-AttachVolumeNegativeTest-1781307442 None] Lock "cinder-8b139c6e-e277-4edc-85af-ebc3321ed3a1-delete_volume" released by "delete_volume" :: held 4.999s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:12:22 devstack sudo[96721]: pam_unix(sudo:session): session closed for user root
Jul 03 01:12:22 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-adf7d258-7747-4162-bc76-605677ae2495 tempest-GroupSnapshotsTest-1320333608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 1.199s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:12:22 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-adf7d258-7747-4162-bc76-605677ae2495 tempest-GroupSnapshotsTest-1320333608 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:12:22 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-adf7d258-7747-4162-bc76-605677ae2495 tempest-GroupSnapshotsTest-1320333608 None] Delete group completed successfully.
Jul 03 01:12:22 devstack sudo[96720]: pam_unix(sudo:session): session closed for user root
Jul 03 01:12:22 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-eb153d99-e44d-4709-a449-a8b1b6e3f679 tempest-AttachVolumeNegativeTest-1781307442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-76978973-d64e-40a3-9168-b3b62ca3031b" returned: 0 in 1.421s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:12:22 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-eb153d99-e44d-4709-a449-a8b1b6e3f679 tempest-AttachVolumeNegativeTest-1781307442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-76978973-d64e-40a3-9168-b3b62ca3031b {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:12:22 devstack sudo[96747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-76978973-d64e-40a3-9168-b3b62ca3031b
Jul 03 01:12:22 devstack sudo[96747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:12:23 devstack sudo[96747]: pam_unix(sudo:session): session closed for user root
Jul 03 01:12:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-eb153d99-e44d-4709-a449-a8b1b6e3f679 tempest-AttachVolumeNegativeTest-1781307442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-76978973-d64e-40a3-9168-b3b62ca3031b" returned: 0 in 0.727s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:12:23 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-eb153d99-e44d-4709-a449-a8b1b6e3f679 tempest-AttachVolumeNegativeTest-1781307442 None] Lock "cinder-quobyte-76978973-d64e-40a3-9168-b3b62ca3031b" released by "delete_volume" :: held 2.260s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:12:23 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-eb153d99-e44d-4709-a449-a8b1b6e3f679 tempest-AttachVolumeNegativeTest-1781307442 None] Created reservations ['8c598ec4-f06c-4b29-a162-3d5ad97eb8cb', 'f9bfa6b4-beb8-4397-b362-732abc1b3178', 'd8a01d9c-5eb8-42a9-b9f8-6ff9461e3c87', '1dd84939-a2e1-457f-beb6-14482ba72d43'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:12:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-eb153d99-e44d-4709-a449-a8b1b6e3f679 tempest-AttachVolumeNegativeTest-1781307442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:12:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-eb153d99-e44d-4709-a449-a8b1b6e3f679 tempest-AttachVolumeNegativeTest-1781307442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:12:23 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-eb153d99-e44d-4709-a449-a8b1b6e3f679 tempest-AttachVolumeNegativeTest-1781307442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:12:23 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-eb153d99-e44d-4709-a449-a8b1b6e3f679 tempest-AttachVolumeNegativeTest-1781307442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:12:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-eb153d99-e44d-4709-a449-a8b1b6e3f679 tempest-AttachVolumeNegativeTest-1781307442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:12:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-eb153d99-e44d-4709-a449-a8b1b6e3f679 tempest-AttachVolumeNegativeTest-1781307442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:12:23 devstack sudo[96750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:12:23 devstack sudo[96750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:12:24 devstack sudo[96750]: pam_unix(sudo:session): session closed for user root
Jul 03 01:12:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-eb153d99-e44d-4709-a449-a8b1b6e3f679 tempest-AttachVolumeNegativeTest-1781307442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.974s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:12:24 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-eb153d99-e44d-4709-a449-a8b1b6e3f679 tempest-AttachVolumeNegativeTest-1781307442 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:12:24 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-eb153d99-e44d-4709-a449-a8b1b6e3f679 tempest-AttachVolumeNegativeTest-1781307442 None] Deleted volume successfully.
Jul 03 01:12:24 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-eb153d99-e44d-4709-a449-a8b1b6e3f679 tempest-AttachVolumeNegativeTest-1781307442 None] Lock "cinder-76978973-d64e-40a3-9168-b3b62ca3031b-delete_volume" released by "delete_volume" :: held 3.647s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:12:30 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-ed0ffcbb-f8df-4d0c-8248-982e91012559 tempest-GroupsTest-1482238299 None] Group tempest-Group1-758923484: creating
Jul 03 01:12:30 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-ed0ffcbb-f8df-4d0c-8248-982e91012559 tempest-GroupsTest-1482238299 None] Group tempest-Group1-758923484: created successfully
Jul 03 01:12:30 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-ed0ffcbb-f8df-4d0c-8248-982e91012559 tempest-GroupsTest-1482238299 None] Create group completed successfully.
Jul 03 01:12:31 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-c84f0b31-752d-4428-a7e7-aac512035093 tempest-GroupsTest-1482238299 None] Group tempest-Group2-1357211463: creating
Jul 03 01:12:31 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-c84f0b31-752d-4428-a7e7-aac512035093 tempest-GroupsTest-1482238299 None] Group tempest-Group2-1357211463: created successfully
Jul 03 01:12:31 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-c84f0b31-752d-4428-a7e7-aac512035093 tempest-GroupsTest-1482238299 None] Create group completed successfully.
Jul 03 01:12:33 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-31571880-ed43-42fa-a778-086592c620fa tempest-GroupsTest-1482238299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:12:33 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-31571880-ed43-42fa-a778-086592c620fa tempest-GroupsTest-1482238299 None] Flow 'volume_create_manager' (a2bd5d7e-a3e7-4dbf-b10a-9019c5df86e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:12:33 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-31571880-ed43-42fa-a778-086592c620fa tempest-GroupsTest-1482238299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e560016-7363-46a8-804b-288ae3c09cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:12:33 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-31571880-ed43-42fa-a778-086592c620fa tempest-GroupsTest-1482238299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e560016-7363-46a8-804b-288ae3c09cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:12:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1482249253',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5dca3c02-6e64-4b7d-a8f7-99e80abc2e61,host='devstack@QuobyteHD#QuobyteHD',id=86be1d58-5b44-4766-a4f8-63f9d6cb9fae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24e055f4dc4242058cf6e245439e4f89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:12:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:12:33Z,use_quota=True,user_id='f5ec3e27ca3d45c4923aff63a6bbaff3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b318e988-cdbc-414c-be64-5264f1379404),volume_type_id=b318e988-cdbc-414c-be64-5264f1379404)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:12:33 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-31571880-ed43-42fa-a778-086592c620fa tempest-GroupsTest-1482238299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28e3ca07-f0dc-482c-93d5-3fdf3bbd55f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:12:33 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-31571880-ed43-42fa-a778-086592c620fa tempest-GroupsTest-1482238299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28e3ca07-f0dc-482c-93d5-3fdf3bbd55f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:12:33 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-31571880-ed43-42fa-a778-086592c620fa tempest-GroupsTest-1482238299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a2bd5fd-a1c6-4020-aade-ba2ec4236c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:12:33 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-31571880-ed43-42fa-a778-086592c620fa tempest-GroupsTest-1482238299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a2bd5fd-a1c6-4020-aade-ba2ec4236c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86be1d58-5b44-4766-a4f8-63f9d6cb9fae', 'volume_name': 'volume-86be1d58-5b44-4766-a4f8-63f9d6cb9fae', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:12:33 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-31571880-ed43-42fa-a778-086592c620fa tempest-GroupsTest-1482238299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55f23ec9-bfe7-4a74-8172-1c86926cd107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:12:33 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-31571880-ed43-42fa-a778-086592c620fa tempest-GroupsTest-1482238299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55f23ec9-bfe7-4a74-8172-1c86926cd107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:12:33 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-31571880-ed43-42fa-a778-086592c620fa tempest-GroupsTest-1482238299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (098eda06-c4cf-44f9-b815-2a98580d7cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:12:33 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-31571880-ed43-42fa-a778-086592c620fa tempest-GroupsTest-1482238299 None] Volume 86be1d58-5b44-4766-a4f8-63f9d6cb9fae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86be1d58-5b44-4766-a4f8-63f9d6cb9fae', 'volume_size': 1}
Jul 03 01:12:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-31571880-ed43-42fa-a778-086592c620fa tempest-GroupsTest-1482238299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:12:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-31571880-ed43-42fa-a778-086592c620fa tempest-GroupsTest-1482238299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:12:33 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-31571880-ed43-42fa-a778-086592c620fa tempest-GroupsTest-1482238299 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=5dca3c02-6e64-4b7d-a8f7-99e80abc2e61,created_at=2026-07-02T23:12:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1482249253',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5dca3c02-6e64-4b7d-a8f7-99e80abc2e61,host='devstack@QuobyteHD#QuobyteHD',id=86be1d58-5b44-4766-a4f8-63f9d6cb9fae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24e055f4dc4242058cf6e245439e4f89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:12:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:12:33Z,use_quota=True,user_id='f5ec3e27ca3d45c4923aff63a6bbaff3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b318e988-cdbc-414c-be64-5264f1379404),volume_type_id=b318e988-cdbc-414c-be64-5264f1379404)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:12:33 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-31571880-ed43-42fa-a778-086592c620fa tempest-GroupsTest-1482238299 None] Creating volume 86be1d58-5b44-4766-a4f8-63f9d6cb9fae {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:12:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-31571880-ed43-42fa-a778-086592c620fa tempest-GroupsTest-1482238299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:12:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-31571880-ed43-42fa-a778-086592c620fa tempest-GroupsTest-1482238299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:12:33 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-31571880-ed43-42fa-a778-086592c620fa tempest-GroupsTest-1482238299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:12:33 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-31571880-ed43-42fa-a778-086592c620fa tempest-GroupsTest-1482238299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:12:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-31571880-ed43-42fa-a778-086592c620fa tempest-GroupsTest-1482238299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:12:33 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-31571880-ed43-42fa-a778-086592c620fa tempest-GroupsTest-1482238299 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:12:33 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-31571880-ed43-42fa-a778-086592c620fa tempest-GroupsTest-1482238299 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:12:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-31571880-ed43-42fa-a778-086592c620fa tempest-GroupsTest-1482238299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-86be1d58-5b44-4766-a4f8-63f9d6cb9fae 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:12:33 devstack sudo[96794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-86be1d58-5b44-4766-a4f8-63f9d6cb9fae 1073741824
Jul 03 01:12:33 devstack sudo[96794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:12:34 devstack sudo[96794]: pam_unix(sudo:session): session closed for user root
Jul 03 01:12:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-31571880-ed43-42fa-a778-086592c620fa tempest-GroupsTest-1482238299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-86be1d58-5b44-4766-a4f8-63f9d6cb9fae 1073741824" returned: 0 in 1.337s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:12:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-31571880-ed43-42fa-a778-086592c620fa tempest-GroupsTest-1482238299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-86be1d58-5b44-4766-a4f8-63f9d6cb9fae {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:12:34 devstack sudo[96802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-86be1d58-5b44-4766-a4f8-63f9d6cb9fae
Jul 03 01:12:34 devstack sudo[96802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:12:34 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [req-7eccc7a6-5c24-40c0-ba63-1a7dbe99f819 req-e46c19a8-08eb-4ee1-ba12-fbe9cb357515 tempest-VolumesSnapshotsTestJSON-2086553202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:12:34 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [req-7eccc7a6-5c24-40c0-ba63-1a7dbe99f819 req-e46c19a8-08eb-4ee1-ba12-fbe9cb357515 tempest-VolumesSnapshotsTestJSON-2086553202 None] Flow 'volume_create_manager' (2f6eadd1-c351-4381-a2f1-cbc783106b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:12:34 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [req-7eccc7a6-5c24-40c0-ba63-1a7dbe99f819 req-e46c19a8-08eb-4ee1-ba12-fbe9cb357515 tempest-VolumesSnapshotsTestJSON-2086553202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c07ca06b-13f2-4f50-bc33-8c005727b0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:12:34 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d064439-bae8-412c-b88a-4ad7bc217397 tempest-TestServerVolumeAttachScenarioOldVersion-1230274272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:12:35 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1d064439-bae8-412c-b88a-4ad7bc217397 tempest-TestServerVolumeAttachScenarioOldVersion-1230274272 None] Flow 'volume_create_manager' (4da70c0d-0897-4aba-b33b-6d5ce7195290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:12:35 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1d064439-bae8-412c-b88a-4ad7bc217397 tempest-TestServerVolumeAttachScenarioOldVersion-1230274272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26b49690-ebcd-4c62-8731-727df9d8ef62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:12:35 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1d064439-bae8-412c-b88a-4ad7bc217397 tempest-TestServerVolumeAttachScenarioOldVersion-1230274272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26b49690-ebcd-4c62-8731-727df9d8ef62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:12:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-527514629',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f5b8f66-e023-48e9-857f-e8817ac029ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9941c21924a1490db642a5d55432414c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:12:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:12:35Z,use_quota=True,user_id='0b528c3292534d5fb1e68b3499ac5023',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:12:35 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1d064439-bae8-412c-b88a-4ad7bc217397 tempest-TestServerVolumeAttachScenarioOldVersion-1230274272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e88e179a-5d52-4e38-910e-81c58d78f234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:12:35 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1d064439-bae8-412c-b88a-4ad7bc217397 tempest-TestServerVolumeAttachScenarioOldVersion-1230274272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e88e179a-5d52-4e38-910e-81c58d78f234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:12:35 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1d064439-bae8-412c-b88a-4ad7bc217397 tempest-TestServerVolumeAttachScenarioOldVersion-1230274272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e90f260-de58-44c3-9f65-4f3686f73531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:12:35 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1d064439-bae8-412c-b88a-4ad7bc217397 tempest-TestServerVolumeAttachScenarioOldVersion-1230274272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e90f260-de58-44c3-9f65-4f3686f73531) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f5b8f66-e023-48e9-857f-e8817ac029ad', 'volume_name': 'volume-6f5b8f66-e023-48e9-857f-e8817ac029ad', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:12:35 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1d064439-bae8-412c-b88a-4ad7bc217397 tempest-TestServerVolumeAttachScenarioOldVersion-1230274272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db9af251-0f81-42af-aec3-d17c79269c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:12:35 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1d064439-bae8-412c-b88a-4ad7bc217397 tempest-TestServerVolumeAttachScenarioOldVersion-1230274272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db9af251-0f81-42af-aec3-d17c79269c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:12:35 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1d064439-bae8-412c-b88a-4ad7bc217397 tempest-TestServerVolumeAttachScenarioOldVersion-1230274272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b47ac4f-d5fe-472d-9ea3-3445a6cc5f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:12:35 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-1d064439-bae8-412c-b88a-4ad7bc217397 tempest-TestServerVolumeAttachScenarioOldVersion-1230274272 None] Volume 6f5b8f66-e023-48e9-857f-e8817ac029ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f5b8f66-e023-48e9-857f-e8817ac029ad', 'volume_size': 1}
Jul 03 01:12:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1d064439-bae8-412c-b88a-4ad7bc217397 tempest-TestServerVolumeAttachScenarioOldVersion-1230274272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:12:35 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [req-7eccc7a6-5c24-40c0-ba63-1a7dbe99f819 req-e46c19a8-08eb-4ee1-ba12-fbe9cb357515 tempest-VolumesSnapshotsTestJSON-2086553202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c07ca06b-13f2-4f50-bc33-8c005727b0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:12:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-12714160',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dfdeaa1-2615-42db-941c-03556ed41a77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5299c3171a24e66990e6877bd42a13d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:12:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:12:35Z,use_quota=True,user_id='79e7dbb2d4ef44cf9a8ba788f7f69f0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:12:35 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [req-7eccc7a6-5c24-40c0-ba63-1a7dbe99f819 req-e46c19a8-08eb-4ee1-ba12-fbe9cb357515 tempest-VolumesSnapshotsTestJSON-2086553202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (168b18fb-b0e9-40ba-94d9-3eacec4b4547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:12:35 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [req-7eccc7a6-5c24-40c0-ba63-1a7dbe99f819 req-e46c19a8-08eb-4ee1-ba12-fbe9cb357515 tempest-VolumesSnapshotsTestJSON-2086553202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (168b18fb-b0e9-40ba-94d9-3eacec4b4547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:12:35 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [req-7eccc7a6-5c24-40c0-ba63-1a7dbe99f819 req-e46c19a8-08eb-4ee1-ba12-fbe9cb357515 tempest-VolumesSnapshotsTestJSON-2086553202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6db5f92f-445d-429e-a9bb-0a204b2a627b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:12:35 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [req-7eccc7a6-5c24-40c0-ba63-1a7dbe99f819 req-e46c19a8-08eb-4ee1-ba12-fbe9cb357515 tempest-VolumesSnapshotsTestJSON-2086553202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6db5f92f-445d-429e-a9bb-0a204b2a627b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1dfdeaa1-2615-42db-941c-03556ed41a77', 'volume_name': 'volume-1dfdeaa1-2615-42db-941c-03556ed41a77', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:12:35 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [req-7eccc7a6-5c24-40c0-ba63-1a7dbe99f819 req-e46c19a8-08eb-4ee1-ba12-fbe9cb357515 tempest-VolumesSnapshotsTestJSON-2086553202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5773eed5-c3fe-4a10-97a2-f942367aef02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:12:35 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [req-7eccc7a6-5c24-40c0-ba63-1a7dbe99f819 req-e46c19a8-08eb-4ee1-ba12-fbe9cb357515 tempest-VolumesSnapshotsTestJSON-2086553202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5773eed5-c3fe-4a10-97a2-f942367aef02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:12:35 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [req-7eccc7a6-5c24-40c0-ba63-1a7dbe99f819 req-e46c19a8-08eb-4ee1-ba12-fbe9cb357515 tempest-VolumesSnapshotsTestJSON-2086553202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0511e592-d912-4dcd-b2c8-7ca00f7c251c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:12:35 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [req-7eccc7a6-5c24-40c0-ba63-1a7dbe99f819 req-e46c19a8-08eb-4ee1-ba12-fbe9cb357515 tempest-VolumesSnapshotsTestJSON-2086553202 None] Volume 1dfdeaa1-2615-42db-941c-03556ed41a77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1dfdeaa1-2615-42db-941c-03556ed41a77', 'volume_size': 1}
Jul 03 01:12:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-7eccc7a6-5c24-40c0-ba63-1a7dbe99f819 req-e46c19a8-08eb-4ee1-ba12-fbe9cb357515 tempest-VolumesSnapshotsTestJSON-2086553202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:12:35 devstack sudo[96802]: pam_unix(sudo:session): session closed for user root
Jul 03 01:12:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-31571880-ed43-42fa-a778-086592c620fa tempest-GroupsTest-1482238299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-86be1d58-5b44-4766-a4f8-63f9d6cb9fae" returned: 0 in 0.746s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:12:35 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-31571880-ed43-42fa-a778-086592c620fa tempest-GroupsTest-1482238299 None] <== create_volume: return (2152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:12:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-31571880-ed43-42fa-a778-086592c620fa tempest-GroupsTest-1482238299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.155s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:12:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1d064439-bae8-412c-b88a-4ad7bc217397 tempest-TestServerVolumeAttachScenarioOldVersion-1230274272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.390s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:12:35 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-1d064439-bae8-412c-b88a-4ad7bc217397 tempest-TestServerVolumeAttachScenarioOldVersion-1230274272 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:12:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-527514629',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f5b8f66-e023-48e9-857f-e8817ac029ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9941c21924a1490db642a5d55432414c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:12:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:12:35Z,use_quota=True,user_id='0b528c3292534d5fb1e68b3499ac5023',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:12:35 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-1d064439-bae8-412c-b88a-4ad7bc217397 tempest-TestServerVolumeAttachScenarioOldVersion-1230274272 None] Creating volume 6f5b8f66-e023-48e9-857f-e8817ac029ad {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:12:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1d064439-bae8-412c-b88a-4ad7bc217397 tempest-TestServerVolumeAttachScenarioOldVersion-1230274272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:12:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1d064439-bae8-412c-b88a-4ad7bc217397 tempest-TestServerVolumeAttachScenarioOldVersion-1230274272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:12:35 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-1d064439-bae8-412c-b88a-4ad7bc217397 tempest-TestServerVolumeAttachScenarioOldVersion-1230274272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:12:35 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-1d064439-bae8-412c-b88a-4ad7bc217397 tempest-TestServerVolumeAttachScenarioOldVersion-1230274272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:12:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1d064439-bae8-412c-b88a-4ad7bc217397 tempest-TestServerVolumeAttachScenarioOldVersion-1230274272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:12:35 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-1d064439-bae8-412c-b88a-4ad7bc217397 tempest-TestServerVolumeAttachScenarioOldVersion-1230274272 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:12:35 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-1d064439-bae8-412c-b88a-4ad7bc217397 tempest-TestServerVolumeAttachScenarioOldVersion-1230274272 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:12:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1d064439-bae8-412c-b88a-4ad7bc217397 tempest-TestServerVolumeAttachScenarioOldVersion-1230274272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-6f5b8f66-e023-48e9-857f-e8817ac029ad 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:12:35 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-31571880-ed43-42fa-a778-086592c620fa tempest-GroupsTest-1482238299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (098eda06-c4cf-44f9-b815-2a98580d7cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86be1d58-5b44-4766-a4f8-63f9d6cb9fae', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:12:35 devstack sudo[96806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-6f5b8f66-e023-48e9-857f-e8817ac029ad 1073741824
Jul 03 01:12:35 devstack sudo[96806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:12:35 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-31571880-ed43-42fa-a778-086592c620fa tempest-GroupsTest-1482238299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (233310ff-bc48-4470-81ac-49e5e2aa5a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:12:35 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-31571880-ed43-42fa-a778-086592c620fa tempest-GroupsTest-1482238299 None] Volume volume-86be1d58-5b44-4766-a4f8-63f9d6cb9fae (86be1d58-5b44-4766-a4f8-63f9d6cb9fae): created successfully
Jul 03 01:12:35 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-31571880-ed43-42fa-a778-086592c620fa tempest-GroupsTest-1482238299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (233310ff-bc48-4470-81ac-49e5e2aa5a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:12:35 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-31571880-ed43-42fa-a778-086592c620fa tempest-GroupsTest-1482238299 None] Flow 'volume_create_manager' (a2bd5d7e-a3e7-4dbf-b10a-9019c5df86e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:12:35 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-31571880-ed43-42fa-a778-086592c620fa tempest-GroupsTest-1482238299 None] Created volume successfully.
Jul 03 01:12:36 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-117fd0af-0909-4094-b3ca-b64346312797 tempest-GroupsTest-1482238299 None] Acquiring lock "cinder-quobyte-86be1d58-5b44-4766-a4f8-63f9d6cb9fae" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:12:36 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-117fd0af-0909-4094-b3ca-b64346312797 tempest-GroupsTest-1482238299 None] Lock "cinder-quobyte-86be1d58-5b44-4766-a4f8-63f9d6cb9fae" acquired by "delete_volume" :: waited 0.024s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:12:36 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[60644c3a-4f50-4560-8e07-f8dd96bafd37]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:12:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-117fd0af-0909-4094-b3ca-b64346312797 tempest-GroupsTest-1482238299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-86be1d58-5b44-4766-a4f8-63f9d6cb9fae {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:12:36 devstack sudo[96806]: pam_unix(sudo:session): session closed for user root
Jul 03 01:12:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1d064439-bae8-412c-b88a-4ad7bc217397 tempest-TestServerVolumeAttachScenarioOldVersion-1230274272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-6f5b8f66-e023-48e9-857f-e8817ac029ad 1073741824" returned: 0 in 0.969s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:12:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1d064439-bae8-412c-b88a-4ad7bc217397 tempest-TestServerVolumeAttachScenarioOldVersion-1230274272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-6f5b8f66-e023-48e9-857f-e8817ac029ad {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:12:36 devstack sudo[96815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-86be1d58-5b44-4766-a4f8-63f9d6cb9fae
Jul 03 01:12:36 devstack sudo[96816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-6f5b8f66-e023-48e9-857f-e8817ac029ad
Jul 03 01:12:36 devstack sudo[96815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:12:36 devstack sudo[96816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:12:37 devstack sudo[96816]: pam_unix(sudo:session): session closed for user root
Jul 03 01:12:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1d064439-bae8-412c-b88a-4ad7bc217397 tempest-TestServerVolumeAttachScenarioOldVersion-1230274272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-6f5b8f66-e023-48e9-857f-e8817ac029ad" returned: 0 in 0.678s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:12:37 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-1d064439-bae8-412c-b88a-4ad7bc217397 tempest-TestServerVolumeAttachScenarioOldVersion-1230274272 None] <== create_volume: return (1758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:12:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1d064439-bae8-412c-b88a-4ad7bc217397 tempest-TestServerVolumeAttachScenarioOldVersion-1230274272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.762s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:12:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-7eccc7a6-5c24-40c0-ba63-1a7dbe99f819 req-e46c19a8-08eb-4ee1-ba12-fbe9cb357515 tempest-VolumesSnapshotsTestJSON-2086553202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.113s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:12:37 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [req-7eccc7a6-5c24-40c0-ba63-1a7dbe99f819 req-e46c19a8-08eb-4ee1-ba12-fbe9cb357515 tempest-VolumesSnapshotsTestJSON-2086553202 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:12:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-12714160',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dfdeaa1-2615-42db-941c-03556ed41a77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5299c3171a24e66990e6877bd42a13d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:12:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:12:35Z,use_quota=True,user_id='79e7dbb2d4ef44cf9a8ba788f7f69f0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:12:37 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [req-7eccc7a6-5c24-40c0-ba63-1a7dbe99f819 req-e46c19a8-08eb-4ee1-ba12-fbe9cb357515 tempest-VolumesSnapshotsTestJSON-2086553202 None] Creating volume 1dfdeaa1-2615-42db-941c-03556ed41a77 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:12:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-7eccc7a6-5c24-40c0-ba63-1a7dbe99f819 req-e46c19a8-08eb-4ee1-ba12-fbe9cb357515 tempest-VolumesSnapshotsTestJSON-2086553202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:12:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-7eccc7a6-5c24-40c0-ba63-1a7dbe99f819 req-e46c19a8-08eb-4ee1-ba12-fbe9cb357515 tempest-VolumesSnapshotsTestJSON-2086553202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:12:37 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [req-7eccc7a6-5c24-40c0-ba63-1a7dbe99f819 req-e46c19a8-08eb-4ee1-ba12-fbe9cb357515 tempest-VolumesSnapshotsTestJSON-2086553202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:12:37 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [req-7eccc7a6-5c24-40c0-ba63-1a7dbe99f819 req-e46c19a8-08eb-4ee1-ba12-fbe9cb357515 tempest-VolumesSnapshotsTestJSON-2086553202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:12:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-7eccc7a6-5c24-40c0-ba63-1a7dbe99f819 req-e46c19a8-08eb-4ee1-ba12-fbe9cb357515 tempest-VolumesSnapshotsTestJSON-2086553202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:12:37 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [req-7eccc7a6-5c24-40c0-ba63-1a7dbe99f819 req-e46c19a8-08eb-4ee1-ba12-fbe9cb357515 tempest-VolumesSnapshotsTestJSON-2086553202 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:12:37 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [req-7eccc7a6-5c24-40c0-ba63-1a7dbe99f819 req-e46c19a8-08eb-4ee1-ba12-fbe9cb357515 tempest-VolumesSnapshotsTestJSON-2086553202 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:12:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-7eccc7a6-5c24-40c0-ba63-1a7dbe99f819 req-e46c19a8-08eb-4ee1-ba12-fbe9cb357515 tempest-VolumesSnapshotsTestJSON-2086553202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1dfdeaa1-2615-42db-941c-03556ed41a77 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:12:37 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1d064439-bae8-412c-b88a-4ad7bc217397 tempest-TestServerVolumeAttachScenarioOldVersion-1230274272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b47ac4f-d5fe-472d-9ea3-3445a6cc5f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f5b8f66-e023-48e9-857f-e8817ac029ad', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:12:37 devstack sudo[96823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1dfdeaa1-2615-42db-941c-03556ed41a77 1073741824
Jul 03 01:12:37 devstack sudo[96823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:12:37 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1d064439-bae8-412c-b88a-4ad7bc217397 tempest-TestServerVolumeAttachScenarioOldVersion-1230274272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea0a4541-512f-431f-8af9-3adb6b884cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:12:37 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-1d064439-bae8-412c-b88a-4ad7bc217397 tempest-TestServerVolumeAttachScenarioOldVersion-1230274272 None] Volume volume-6f5b8f66-e023-48e9-857f-e8817ac029ad (6f5b8f66-e023-48e9-857f-e8817ac029ad): created successfully
Jul 03 01:12:37 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1d064439-bae8-412c-b88a-4ad7bc217397 tempest-TestServerVolumeAttachScenarioOldVersion-1230274272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea0a4541-512f-431f-8af9-3adb6b884cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:12:37 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1d064439-bae8-412c-b88a-4ad7bc217397 tempest-TestServerVolumeAttachScenarioOldVersion-1230274272 None] Flow 'volume_create_manager' (4da70c0d-0897-4aba-b33b-6d5ce7195290) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:12:37 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-1d064439-bae8-412c-b88a-4ad7bc217397 tempest-TestServerVolumeAttachScenarioOldVersion-1230274272 None] Created volume successfully.
Jul 03 01:12:37 devstack sudo[96815]: pam_unix(sudo:session): session closed for user root
Jul 03 01:12:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-117fd0af-0909-4094-b3ca-b64346312797 tempest-GroupsTest-1482238299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-86be1d58-5b44-4766-a4f8-63f9d6cb9fae" returned: 0 in 0.957s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:12:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-117fd0af-0909-4094-b3ca-b64346312797 tempest-GroupsTest-1482238299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-86be1d58-5b44-4766-a4f8-63f9d6cb9fae {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:12:37 devstack sudo[96825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-86be1d58-5b44-4766-a4f8-63f9d6cb9fae
Jul 03 01:12:37 devstack sudo[96825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:12:38 devstack sudo[96825]: pam_unix(sudo:session): session closed for user root
Jul 03 01:12:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-117fd0af-0909-4094-b3ca-b64346312797 tempest-GroupsTest-1482238299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-86be1d58-5b44-4766-a4f8-63f9d6cb9fae" returned: 0 in 0.791s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:12:38 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-117fd0af-0909-4094-b3ca-b64346312797 tempest-GroupsTest-1482238299 None] Lock "cinder-quobyte-86be1d58-5b44-4766-a4f8-63f9d6cb9fae" released by "delete_volume" :: held 1.805s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:12:38 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-117fd0af-0909-4094-b3ca-b64346312797 tempest-GroupsTest-1482238299 None] Created reservations ['e99b1220-90f3-40a7-92c7-a57c505e6139'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:12:38 devstack sudo[96823]: pam_unix(sudo:session): session closed for user root
Jul 03 01:12:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-7eccc7a6-5c24-40c0-ba63-1a7dbe99f819 req-e46c19a8-08eb-4ee1-ba12-fbe9cb357515 tempest-VolumesSnapshotsTestJSON-2086553202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1dfdeaa1-2615-42db-941c-03556ed41a77 1073741824" returned: 0 in 1.018s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:12:38 devstack cinder-volume[86891]: WARNING cinder.quota [None req-117fd0af-0909-4094-b3ca-b64346312797 tempest-GroupsTest-1482238299 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-986440948 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-986440948, it is now deprecated. Please use the default quota class for default quota.
Jul 03 01:12:38 devstack cinder-volume[86891]: WARNING cinder.quota [None req-117fd0af-0909-4094-b3ca-b64346312797 tempest-GroupsTest-1482238299 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-986440948 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-986440948, it is now deprecated. Please use the default quota class for default quota.
Jul 03 01:12:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-7eccc7a6-5c24-40c0-ba63-1a7dbe99f819 req-e46c19a8-08eb-4ee1-ba12-fbe9cb357515 tempest-VolumesSnapshotsTestJSON-2086553202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1dfdeaa1-2615-42db-941c-03556ed41a77 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:12:38 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-117fd0af-0909-4094-b3ca-b64346312797 tempest-GroupsTest-1482238299 None] Created reservations ['7d96bbad-52f7-4fb8-b620-e19d7aea0225', '92e2b5ac-b3ca-4ebe-b556-56c7078fea6e', '79d80745-cede-4245-8bf6-60384774ff56', 'a6ef1904-42a2-48d2-89ec-11c6a910b15e'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:12:38 devstack sudo[96836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1dfdeaa1-2615-42db-941c-03556ed41a77
Jul 03 01:12:38 devstack sudo[96836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:12:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-117fd0af-0909-4094-b3ca-b64346312797 tempest-GroupsTest-1482238299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:12:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-117fd0af-0909-4094-b3ca-b64346312797 tempest-GroupsTest-1482238299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:12:38 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-117fd0af-0909-4094-b3ca-b64346312797 tempest-GroupsTest-1482238299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:12:38 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-117fd0af-0909-4094-b3ca-b64346312797 tempest-GroupsTest-1482238299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:12:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-117fd0af-0909-4094-b3ca-b64346312797 tempest-GroupsTest-1482238299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:12:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-117fd0af-0909-4094-b3ca-b64346312797 tempest-GroupsTest-1482238299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:12:38 devstack sudo[96838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:12:38 devstack sudo[96838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:12:38 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-cce883cc-7f64-4666-9081-04d7818b192c tempest-GroupsTest-1482238299 None] Created reservations ['0d198dd4-8d00-4900-b9cc-ba33225a52f4'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:12:38 devstack sudo[96836]: pam_unix(sudo:session): session closed for user root
Jul 03 01:12:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-7eccc7a6-5c24-40c0-ba63-1a7dbe99f819 req-e46c19a8-08eb-4ee1-ba12-fbe9cb357515 tempest-VolumesSnapshotsTestJSON-2086553202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1dfdeaa1-2615-42db-941c-03556ed41a77" returned: 0 in 0.665s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:12:38 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [req-7eccc7a6-5c24-40c0-ba63-1a7dbe99f819 req-e46c19a8-08eb-4ee1-ba12-fbe9cb357515 tempest-VolumesSnapshotsTestJSON-2086553202 None] <== create_volume: return (1730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:12:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-7eccc7a6-5c24-40c0-ba63-1a7dbe99f819 req-e46c19a8-08eb-4ee1-ba12-fbe9cb357515 tempest-VolumesSnapshotsTestJSON-2086553202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.733s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:12:38 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [req-7eccc7a6-5c24-40c0-ba63-1a7dbe99f819 req-e46c19a8-08eb-4ee1-ba12-fbe9cb357515 tempest-VolumesSnapshotsTestJSON-2086553202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0511e592-d912-4dcd-b2c8-7ca00f7c251c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1dfdeaa1-2615-42db-941c-03556ed41a77', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:12:39 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [req-7eccc7a6-5c24-40c0-ba63-1a7dbe99f819 req-e46c19a8-08eb-4ee1-ba12-fbe9cb357515 tempest-VolumesSnapshotsTestJSON-2086553202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (349ad8fb-3443-42c5-91b1-cd7a93a44251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:12:39 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [req-7eccc7a6-5c24-40c0-ba63-1a7dbe99f819 req-e46c19a8-08eb-4ee1-ba12-fbe9cb357515 tempest-VolumesSnapshotsTestJSON-2086553202 None] Volume volume-1dfdeaa1-2615-42db-941c-03556ed41a77 (1dfdeaa1-2615-42db-941c-03556ed41a77): created successfully
Jul 03 01:12:39 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [req-7eccc7a6-5c24-40c0-ba63-1a7dbe99f819 req-e46c19a8-08eb-4ee1-ba12-fbe9cb357515 tempest-VolumesSnapshotsTestJSON-2086553202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (349ad8fb-3443-42c5-91b1-cd7a93a44251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:12:39 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [req-7eccc7a6-5c24-40c0-ba63-1a7dbe99f819 req-e46c19a8-08eb-4ee1-ba12-fbe9cb357515 tempest-VolumesSnapshotsTestJSON-2086553202 None] Flow 'volume_create_manager' (2f6eadd1-c351-4381-a2f1-cbc783106b3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:12:39 devstack cinder-volume[86891]: INFO cinder.volume.manager [req-7eccc7a6-5c24-40c0-ba63-1a7dbe99f819 req-e46c19a8-08eb-4ee1-ba12-fbe9cb357515 tempest-VolumesSnapshotsTestJSON-2086553202 None] Created volume successfully.
Jul 03 01:12:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-cce883cc-7f64-4666-9081-04d7818b192c tempest-GroupsTest-1482238299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:12:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-cce883cc-7f64-4666-9081-04d7818b192c tempest-GroupsTest-1482238299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:12:39 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-cce883cc-7f64-4666-9081-04d7818b192c tempest-GroupsTest-1482238299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:12:39 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-cce883cc-7f64-4666-9081-04d7818b192c tempest-GroupsTest-1482238299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:12:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-cce883cc-7f64-4666-9081-04d7818b192c tempest-GroupsTest-1482238299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:12:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-cce883cc-7f64-4666-9081-04d7818b192c tempest-GroupsTest-1482238299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:12:39 devstack sudo[96842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:12:39 devstack sudo[96842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:12:39 devstack sudo[96838]: pam_unix(sudo:session): session closed for user root
Jul 03 01:12:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-117fd0af-0909-4094-b3ca-b64346312797 tempest-GroupsTest-1482238299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.707s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:12:39 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-117fd0af-0909-4094-b3ca-b64346312797 tempest-GroupsTest-1482238299 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:12:39 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-117fd0af-0909-4094-b3ca-b64346312797 tempest-GroupsTest-1482238299 None] Delete group completed successfully.
Jul 03 01:12:39 devstack sudo[96842]: pam_unix(sudo:session): session closed for user root
Jul 03 01:12:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-cce883cc-7f64-4666-9081-04d7818b192c tempest-GroupsTest-1482238299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.641s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:12:39 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-cce883cc-7f64-4666-9081-04d7818b192c tempest-GroupsTest-1482238299 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:12:39 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-cce883cc-7f64-4666-9081-04d7818b192c tempest-GroupsTest-1482238299 None] Delete group completed successfully.
Jul 03 01:12:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-9a633f9a-f59a-43c2-a241-c3d5dd478e4e req-277306e9-19ee-429b-90b1-f5a89ac28d59 tempest-VolumesSnapshotsTestJSON-2086553202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:12:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-9a633f9a-f59a-43c2-a241-c3d5dd478e4e req-277306e9-19ee-429b-90b1-f5a89ac28d59 tempest-VolumesSnapshotsTestJSON-2086553202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:12:40 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [req-9a633f9a-f59a-43c2-a241-c3d5dd478e4e req-277306e9-19ee-429b-90b1-f5a89ac28d59 tempest-VolumesSnapshotsTestJSON-2086553202 None] Creating offline snapshot c0ceb429-3753-4877-85ee-5111014ccb6b of volume 1dfdeaa1-2615-42db-941c-03556ed41a77 {{(pid=86891) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 01:12:40 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bcf0c8f-4222-41da-aaab-0cf4d6212a72]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:12:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-9a633f9a-f59a-43c2-a241-c3d5dd478e4e req-277306e9-19ee-429b-90b1-f5a89ac28d59 tempest-VolumesSnapshotsTestJSON-2086553202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1dfdeaa1-2615-42db-941c-03556ed41a77 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:12:40 devstack sudo[96851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1dfdeaa1-2615-42db-941c-03556ed41a77
Jul 03 01:12:40 devstack sudo[96851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:12:40 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-29265b2a-199b-465d-ae69-d0b6ac305355 tempest-GroupsTest-1482238299 None] Group tempest-GroupsTest-Group-110444907: creating
Jul 03 01:12:40 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-29265b2a-199b-465d-ae69-d0b6ac305355 tempest-GroupsTest-1482238299 None] Group tempest-GroupsTest-Group-110444907: created successfully
Jul 03 01:12:40 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-29265b2a-199b-465d-ae69-d0b6ac305355 tempest-GroupsTest-1482238299 None] Create group completed successfully.
Jul 03 01:12:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-a699b0d2-5fc2-466d-8c87-bf4b5bd048e7 req-7ea0a52d-6a4a-4261-b8b4-7fb00011ed25 tempest-TestServerVolumeAttachScenarioOldVersion-1230274272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:12:41 devstack sudo[96851]: pam_unix(sudo:session): session closed for user root
Jul 03 01:12:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-9a633f9a-f59a-43c2-a241-c3d5dd478e4e req-277306e9-19ee-429b-90b1-f5a89ac28d59 tempest-VolumesSnapshotsTestJSON-2086553202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1dfdeaa1-2615-42db-941c-03556ed41a77" returned: 0 in 1.023s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:12:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-9a633f9a-f59a-43c2-a241-c3d5dd478e4e req-277306e9-19ee-429b-90b1-f5a89ac28d59 tempest-VolumesSnapshotsTestJSON-2086553202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1dfdeaa1-2615-42db-941c-03556ed41a77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1dfdeaa1-2615-42db-941c-03556ed41a77.c0ceb429-3753-4877-85ee-5111014ccb6b 1G {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:12:41 devstack sudo[96865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1dfdeaa1-2615-42db-941c-03556ed41a77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1dfdeaa1-2615-42db-941c-03556ed41a77.c0ceb429-3753-4877-85ee-5111014ccb6b 1G
Jul 03 01:12:41 devstack sudo[96865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:12:42 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-06b43e72-660a-4108-a105-b5653fbde283 tempest-GroupsTest-1482238299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:12:42 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-06b43e72-660a-4108-a105-b5653fbde283 tempest-GroupsTest-1482238299 None] Flow 'volume_create_manager' (d5d0b58a-8fed-4de6-ac3c-7ce77163cabc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:12:42 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-06b43e72-660a-4108-a105-b5653fbde283 tempest-GroupsTest-1482238299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccccd3ab-906d-4e2a-8359-99686cb3634c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:12:42 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-06b43e72-660a-4108-a105-b5653fbde283 tempest-GroupsTest-1482238299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccccd3ab-906d-4e2a-8359-99686cb3634c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:12:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-863117224',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c1104dae-f0e5-4597-bed3-8ff7ed2542c0,host='devstack@QuobyteHD#QuobyteHD',id=81d5c819-98d7-4881-97bf-68f6265eaa63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24e055f4dc4242058cf6e245439e4f89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:12:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:12:43Z,use_quota=True,user_id='f5ec3e27ca3d45c4923aff63a6bbaff3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4d35de7-2789-45ab-9515-03c622fded9f),volume_type_id=d4d35de7-2789-45ab-9515-03c622fded9f)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:12:42 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-06b43e72-660a-4108-a105-b5653fbde283 tempest-GroupsTest-1482238299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69f66f49-446a-40ca-bbd3-be6b8b96cf1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:12:42 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-06b43e72-660a-4108-a105-b5653fbde283 tempest-GroupsTest-1482238299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69f66f49-446a-40ca-bbd3-be6b8b96cf1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:12:42 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-06b43e72-660a-4108-a105-b5653fbde283 tempest-GroupsTest-1482238299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76a3bbc2-0152-451c-a5d6-7473d2a46c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:12:42 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-06b43e72-660a-4108-a105-b5653fbde283 tempest-GroupsTest-1482238299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76a3bbc2-0152-451c-a5d6-7473d2a46c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81d5c819-98d7-4881-97bf-68f6265eaa63', 'volume_name': 'volume-81d5c819-98d7-4881-97bf-68f6265eaa63', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:12:42 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-06b43e72-660a-4108-a105-b5653fbde283 tempest-GroupsTest-1482238299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59f22ff9-90bc-4d88-899b-9f7478267dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:12:42 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-06b43e72-660a-4108-a105-b5653fbde283 tempest-GroupsTest-1482238299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59f22ff9-90bc-4d88-899b-9f7478267dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:12:42 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-06b43e72-660a-4108-a105-b5653fbde283 tempest-GroupsTest-1482238299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf854bc6-fb97-4cc8-a9dc-24baade4a7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:12:42 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-06b43e72-660a-4108-a105-b5653fbde283 tempest-GroupsTest-1482238299 None] Volume 81d5c819-98d7-4881-97bf-68f6265eaa63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81d5c819-98d7-4881-97bf-68f6265eaa63', 'volume_size': 1}
Jul 03 01:12:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-06b43e72-660a-4108-a105-b5653fbde283 tempest-GroupsTest-1482238299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:12:42 devstack sudo[96865]: pam_unix(sudo:session): session closed for user root
Jul 03 01:12:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-9a633f9a-f59a-43c2-a241-c3d5dd478e4e req-277306e9-19ee-429b-90b1-f5a89ac28d59 tempest-VolumesSnapshotsTestJSON-2086553202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1dfdeaa1-2615-42db-941c-03556ed41a77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1dfdeaa1-2615-42db-941c-03556ed41a77.c0ceb429-3753-4877-85ee-5111014ccb6b 1G" returned: 0 in 1.143s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:12:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-9a633f9a-f59a-43c2-a241-c3d5dd478e4e req-277306e9-19ee-429b-90b1-f5a89ac28d59 tempest-VolumesSnapshotsTestJSON-2086553202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1dfdeaa1-2615-42db-941c-03556ed41a77 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1dfdeaa1-2615-42db-941c-03556ed41a77.c0ceb429-3753-4877-85ee-5111014ccb6b {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:12:42 devstack sudo[96876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1dfdeaa1-2615-42db-941c-03556ed41a77 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1dfdeaa1-2615-42db-941c-03556ed41a77.c0ceb429-3753-4877-85ee-5111014ccb6b
Jul 03 01:12:42 devstack sudo[96876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:12:43 devstack sudo[96876]: pam_unix(sudo:session): session closed for user root
Jul 03 01:12:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-9a633f9a-f59a-43c2-a241-c3d5dd478e4e req-277306e9-19ee-429b-90b1-f5a89ac28d59 tempest-VolumesSnapshotsTestJSON-2086553202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1dfdeaa1-2615-42db-941c-03556ed41a77 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1dfdeaa1-2615-42db-941c-03556ed41a77.c0ceb429-3753-4877-85ee-5111014ccb6b" returned: 0 in 0.718s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:12:43 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [req-9a633f9a-f59a-43c2-a241-c3d5dd478e4e req-277306e9-19ee-429b-90b1-f5a89ac28d59 tempest-VolumesSnapshotsTestJSON-2086553202 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1dfdeaa1-2615-42db-941c-03556ed41a77.c0ceb429-3753-4877-85ee-5111014ccb6b is being set with open permissions: ugo+rw
Jul 03 01:12:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-9a633f9a-f59a-43c2-a241-c3d5dd478e4e req-277306e9-19ee-429b-90b1-f5a89ac28d59 tempest-VolumesSnapshotsTestJSON-2086553202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1dfdeaa1-2615-42db-941c-03556ed41a77.c0ceb429-3753-4877-85ee-5111014ccb6b {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:12:43 devstack sudo[96893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1dfdeaa1-2615-42db-941c-03556ed41a77.c0ceb429-3753-4877-85ee-5111014ccb6b
Jul 03 01:12:43 devstack sudo[96893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:12:44 devstack sudo[96893]: pam_unix(sudo:session): session closed for user root
Jul 03 01:12:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-9a633f9a-f59a-43c2-a241-c3d5dd478e4e req-277306e9-19ee-429b-90b1-f5a89ac28d59 tempest-VolumesSnapshotsTestJSON-2086553202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1dfdeaa1-2615-42db-941c-03556ed41a77.c0ceb429-3753-4877-85ee-5111014ccb6b" returned: 0 in 0.670s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:12:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-9a633f9a-f59a-43c2-a241-c3d5dd478e4e req-277306e9-19ee-429b-90b1-f5a89ac28d59 tempest-VolumesSnapshotsTestJSON-2086553202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1dfdeaa1-2615-42db-941c-03556ed41a77.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:12:44 devstack sudo[96896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1dfdeaa1-2615-42db-941c-03556ed41a77.info
Jul 03 01:12:44 devstack sudo[96896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:12:44 devstack sudo[96896]: pam_unix(sudo:session): session closed for user root
Jul 03 01:12:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-9a633f9a-f59a-43c2-a241-c3d5dd478e4e req-277306e9-19ee-429b-90b1-f5a89ac28d59 tempest-VolumesSnapshotsTestJSON-2086553202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1dfdeaa1-2615-42db-941c-03556ed41a77.info" returned: 0 in 0.666s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:12:44 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [req-9a633f9a-f59a-43c2-a241-c3d5dd478e4e req-277306e9-19ee-429b-90b1-f5a89ac28d59 tempest-VolumesSnapshotsTestJSON-2086553202 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1dfdeaa1-2615-42db-941c-03556ed41a77.info is being set with open permissions: ugo+rw
Jul 03 01:12:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-9a633f9a-f59a-43c2-a241-c3d5dd478e4e req-277306e9-19ee-429b-90b1-f5a89ac28d59 tempest-VolumesSnapshotsTestJSON-2086553202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1dfdeaa1-2615-42db-941c-03556ed41a77.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:12:44 devstack sudo[96899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1dfdeaa1-2615-42db-941c-03556ed41a77.info
Jul 03 01:12:44 devstack sudo[96899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:12:45 devstack sudo[96899]: pam_unix(sudo:session): session closed for user root
Jul 03 01:12:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-9a633f9a-f59a-43c2-a241-c3d5dd478e4e req-277306e9-19ee-429b-90b1-f5a89ac28d59 tempest-VolumesSnapshotsTestJSON-2086553202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1dfdeaa1-2615-42db-941c-03556ed41a77.info" returned: 0 in 0.638s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:12:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-9a633f9a-f59a-43c2-a241-c3d5dd478e4e req-277306e9-19ee-429b-90b1-f5a89ac28d59 tempest-VolumesSnapshotsTestJSON-2086553202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.977s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:12:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-a699b0d2-5fc2-466d-8c87-bf4b5bd048e7 req-7ea0a52d-6a4a-4261-b8b4-7fb00011ed25 tempest-TestServerVolumeAttachScenarioOldVersion-1230274272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.388s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:12:45 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f53d55-2d52-4e8f-b8dc-a3843c45ea10]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:12:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-a699b0d2-5fc2-466d-8c87-bf4b5bd048e7 req-7ea0a52d-6a4a-4261-b8b4-7fb00011ed25 tempest-TestServerVolumeAttachScenarioOldVersion-1230274272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-6f5b8f66-e023-48e9-857f-e8817ac029ad {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:12:45 devstack cinder-volume[86891]: INFO cinder.volume.manager [req-9a633f9a-f59a-43c2-a241-c3d5dd478e4e req-277306e9-19ee-429b-90b1-f5a89ac28d59 tempest-VolumesSnapshotsTestJSON-2086553202 None] Create snapshot completed successfully
Jul 03 01:12:45 devstack sudo[96902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-6f5b8f66-e023-48e9-857f-e8817ac029ad
Jul 03 01:12:45 devstack sudo[96902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:12:45 devstack cinder-volume[86891]: DEBUG cinder.coordination [req-e7a62c6b-8957-48ef-92f3-58fe6d6fcf97 req-3d1f15df-4101-444d-a850-89e079135b99 tempest-VolumesSnapshotsTestJSON-2086553202 None] Acquiring lock "cinder-c0ceb429-3753-4877-85ee-5111014ccb6b-delete_snapshot" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:12:45 devstack cinder-volume[86891]: DEBUG cinder.coordination [req-e7a62c6b-8957-48ef-92f3-58fe6d6fcf97 req-3d1f15df-4101-444d-a850-89e079135b99 tempest-VolumesSnapshotsTestJSON-2086553202 None] Lock "cinder-c0ceb429-3753-4877-85ee-5111014ccb6b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:12:45 devstack cinder-volume[86891]: DEBUG cinder.coordination [req-e7a62c6b-8957-48ef-92f3-58fe6d6fcf97 req-3d1f15df-4101-444d-a850-89e079135b99 tempest-VolumesSnapshotsTestJSON-2086553202 None] Acquiring lock "cinder-quobyte-1dfdeaa1-2615-42db-941c-03556ed41a77" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:12:45 devstack cinder-volume[86891]: DEBUG cinder.coordination [req-e7a62c6b-8957-48ef-92f3-58fe6d6fcf97 req-3d1f15df-4101-444d-a850-89e079135b99 tempest-VolumesSnapshotsTestJSON-2086553202 None] Lock "cinder-quobyte-1dfdeaa1-2615-42db-941c-03556ed41a77" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:12:45 devstack cinder-volume[86891]: DEBUG cinder.coordination [req-e7a62c6b-8957-48ef-92f3-58fe6d6fcf97 req-3d1f15df-4101-444d-a850-89e079135b99 tempest-VolumesSnapshotsTestJSON-2086553202 None] Acquiring lock "cinder-quobyte-c0ceb429-3753-4877-85ee-5111014ccb6b" by "_delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:12:45 devstack cinder-volume[86891]: DEBUG cinder.coordination [req-e7a62c6b-8957-48ef-92f3-58fe6d6fcf97 req-3d1f15df-4101-444d-a850-89e079135b99 tempest-VolumesSnapshotsTestJSON-2086553202 None] Lock "cinder-quobyte-c0ceb429-3753-4877-85ee-5111014ccb6b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:12:45 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [req-e7a62c6b-8957-48ef-92f3-58fe6d6fcf97 req-3d1f15df-4101-444d-a850-89e079135b99 tempest-VolumesSnapshotsTestJSON-2086553202 None] Deleting offline snapshot c0ceb429-3753-4877-85ee-5111014ccb6b of volume 1dfdeaa1-2615-42db-941c-03556ed41a77 {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 01:12:45 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [req-e7a62c6b-8957-48ef-92f3-58fe6d6fcf97 req-3d1f15df-4101-444d-a850-89e079135b99 tempest-VolumesSnapshotsTestJSON-2086553202 None] snapshot_file for this snap is: volume-1dfdeaa1-2615-42db-941c-03556ed41a77.c0ceb429-3753-4877-85ee-5111014ccb6b {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 01:12:45 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a5d5a5-c0c4-479a-bdae-b8d0e4bd2078]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:12:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-e7a62c6b-8957-48ef-92f3-58fe6d6fcf97 req-3d1f15df-4101-444d-a850-89e079135b99 tempest-VolumesSnapshotsTestJSON-2086553202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1dfdeaa1-2615-42db-941c-03556ed41a77.c0ceb429-3753-4877-85ee-5111014ccb6b {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:12:45 devstack sudo[96904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1dfdeaa1-2615-42db-941c-03556ed41a77.c0ceb429-3753-4877-85ee-5111014ccb6b
Jul 03 01:12:45 devstack sudo[96904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:12:46 devstack sudo[96902]: pam_unix(sudo:session): session closed for user root
Jul 03 01:12:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-a699b0d2-5fc2-466d-8c87-bf4b5bd048e7 req-7ea0a52d-6a4a-4261-b8b4-7fb00011ed25 tempest-TestServerVolumeAttachScenarioOldVersion-1230274272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-6f5b8f66-e023-48e9-857f-e8817ac029ad" returned: 0 in 0.833s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:12:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-a699b0d2-5fc2-466d-8c87-bf4b5bd048e7 req-7ea0a52d-6a4a-4261-b8b4-7fb00011ed25 tempest-TestServerVolumeAttachScenarioOldVersion-1230274272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.854s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:12:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-06b43e72-660a-4108-a105-b5653fbde283 tempest-GroupsTest-1482238299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.718s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:12:46 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-06b43e72-660a-4108-a105-b5653fbde283 tempest-GroupsTest-1482238299 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=c1104dae-f0e5-4597-bed3-8ff7ed2542c0,created_at=2026-07-02T23:12:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-863117224',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c1104dae-f0e5-4597-bed3-8ff7ed2542c0,host='devstack@QuobyteHD#QuobyteHD',id=81d5c819-98d7-4881-97bf-68f6265eaa63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24e055f4dc4242058cf6e245439e4f89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:12:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:12:43Z,use_quota=True,user_id='f5ec3e27ca3d45c4923aff63a6bbaff3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4d35de7-2789-45ab-9515-03c622fded9f),volume_type_id=d4d35de7-2789-45ab-9515-03c622fded9f)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:12:46 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-06b43e72-660a-4108-a105-b5653fbde283 tempest-GroupsTest-1482238299 None] Creating volume 81d5c819-98d7-4881-97bf-68f6265eaa63 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:12:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-06b43e72-660a-4108-a105-b5653fbde283 tempest-GroupsTest-1482238299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:12:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-06b43e72-660a-4108-a105-b5653fbde283 tempest-GroupsTest-1482238299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:12:46 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-06b43e72-660a-4108-a105-b5653fbde283 tempest-GroupsTest-1482238299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:12:46 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-06b43e72-660a-4108-a105-b5653fbde283 tempest-GroupsTest-1482238299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:12:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-06b43e72-660a-4108-a105-b5653fbde283 tempest-GroupsTest-1482238299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:12:46 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-06b43e72-660a-4108-a105-b5653fbde283 tempest-GroupsTest-1482238299 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:12:46 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-06b43e72-660a-4108-a105-b5653fbde283 tempest-GroupsTest-1482238299 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:12:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-06b43e72-660a-4108-a105-b5653fbde283 tempest-GroupsTest-1482238299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-81d5c819-98d7-4881-97bf-68f6265eaa63 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:12:46 devstack sudo[96913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-81d5c819-98d7-4881-97bf-68f6265eaa63 1073741824
Jul 03 01:12:46 devstack sudo[96913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:12:46 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [req-a699b0d2-5fc2-466d-8c87-bf4b5bd048e7 req-7ea0a52d-6a4a-4261-b8b4-7fb00011ed25 tempest-TestServerVolumeAttachScenarioOldVersion-1230274272 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3', 'name': 'volume-6f5b8f66-e023-48e9-857f-e8817ac029ad', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd65275e8-c7cc-41d9-8450-bf67098b6e3c', 'enforce_multipath': True} {{(pid=86891) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 01:12:46 devstack cinder-volume[86891]: INFO cinder.volume.manager [req-a699b0d2-5fc2-466d-8c87-bf4b5bd048e7 req-7ea0a52d-6a4a-4261-b8b4-7fb00011ed25 tempest-TestServerVolumeAttachScenarioOldVersion-1230274272 None] attachment_update completed successfully.
Jul 03 01:12:46 devstack sudo[96904]: pam_unix(sudo:session): session closed for user root
Jul 03 01:12:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-e7a62c6b-8957-48ef-92f3-58fe6d6fcf97 req-3d1f15df-4101-444d-a850-89e079135b99 tempest-VolumesSnapshotsTestJSON-2086553202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1dfdeaa1-2615-42db-941c-03556ed41a77.c0ceb429-3753-4877-85ee-5111014ccb6b" returned: 0 in 0.808s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:12:46 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [req-e7a62c6b-8957-48ef-92f3-58fe6d6fcf97 req-3d1f15df-4101-444d-a850-89e079135b99 tempest-VolumesSnapshotsTestJSON-2086553202 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1dfdeaa1-2615-42db-941c-03556ed41a77(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:12:46 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[30098696-5b65-433b-9e54-10cce199325a]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:12:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-e7a62c6b-8957-48ef-92f3-58fe6d6fcf97 req-3d1f15df-4101-444d-a850-89e079135b99 tempest-VolumesSnapshotsTestJSON-2086553202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1dfdeaa1-2615-42db-941c-03556ed41a77 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:12:46 devstack sudo[96919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1dfdeaa1-2615-42db-941c-03556ed41a77
Jul 03 01:12:46 devstack sudo[96919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:12:47 devstack sudo[96913]: pam_unix(sudo:session): session closed for user root
Jul 03 01:12:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-06b43e72-660a-4108-a105-b5653fbde283 tempest-GroupsTest-1482238299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-81d5c819-98d7-4881-97bf-68f6265eaa63 1073741824" returned: 0 in 0.936s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:12:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-06b43e72-660a-4108-a105-b5653fbde283 tempest-GroupsTest-1482238299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-81d5c819-98d7-4881-97bf-68f6265eaa63 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:12:47 devstack sudo[96992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-81d5c819-98d7-4881-97bf-68f6265eaa63
Jul 03 01:12:47 devstack sudo[96992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:12:47 devstack sudo[96919]: pam_unix(sudo:session): session closed for user root
Jul 03 01:12:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-e7a62c6b-8957-48ef-92f3-58fe6d6fcf97 req-3d1f15df-4101-444d-a850-89e079135b99 tempest-VolumesSnapshotsTestJSON-2086553202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1dfdeaa1-2615-42db-941c-03556ed41a77" returned: 0 in 0.844s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:12:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-e7a62c6b-8957-48ef-92f3-58fe6d6fcf97 req-3d1f15df-4101-444d-a850-89e079135b99 tempest-VolumesSnapshotsTestJSON-2086553202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1dfdeaa1-2615-42db-941c-03556ed41a77.c0ceb429-3753-4877-85ee-5111014ccb6b {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:12:47 devstack sudo[97312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1dfdeaa1-2615-42db-941c-03556ed41a77.c0ceb429-3753-4877-85ee-5111014ccb6b
Jul 03 01:12:47 devstack sudo[97312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:12:48 devstack sudo[96992]: pam_unix(sudo:session): session closed for user root
Jul 03 01:12:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-06b43e72-660a-4108-a105-b5653fbde283 tempest-GroupsTest-1482238299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-81d5c819-98d7-4881-97bf-68f6265eaa63" returned: 0 in 0.893s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:12:48 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-06b43e72-660a-4108-a105-b5653fbde283 tempest-GroupsTest-1482238299 None] <== create_volume: return (1869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:12:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-06b43e72-660a-4108-a105-b5653fbde283 tempest-GroupsTest-1482238299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.872s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:12:48 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-06b43e72-660a-4108-a105-b5653fbde283 tempest-GroupsTest-1482238299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf854bc6-fb97-4cc8-a9dc-24baade4a7bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81d5c819-98d7-4881-97bf-68f6265eaa63', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:12:48 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-06b43e72-660a-4108-a105-b5653fbde283 tempest-GroupsTest-1482238299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c9bef83-cb41-439b-8784-57f1bfec496a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:12:48 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-06b43e72-660a-4108-a105-b5653fbde283 tempest-GroupsTest-1482238299 None] Volume volume-81d5c819-98d7-4881-97bf-68f6265eaa63 (81d5c819-98d7-4881-97bf-68f6265eaa63): created successfully
Jul 03 01:12:48 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-06b43e72-660a-4108-a105-b5653fbde283 tempest-GroupsTest-1482238299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c9bef83-cb41-439b-8784-57f1bfec496a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:12:48 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-06b43e72-660a-4108-a105-b5653fbde283 tempest-GroupsTest-1482238299 None] Flow 'volume_create_manager' (d5d0b58a-8fed-4de6-ac3c-7ce77163cabc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:12:48 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-06b43e72-660a-4108-a105-b5653fbde283 tempest-GroupsTest-1482238299 None] Created volume successfully.
Jul 03 01:12:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-e7a62c6b-8957-48ef-92f3-58fe6d6fcf97 req-3d1f15df-4101-444d-a850-89e079135b99 tempest-VolumesSnapshotsTestJSON-2086553202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1dfdeaa1-2615-42db-941c-03556ed41a77.c0ceb429-3753-4877-85ee-5111014ccb6b" returned: 0 in 1.250s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:12:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-e7a62c6b-8957-48ef-92f3-58fe6d6fcf97 req-3d1f15df-4101-444d-a850-89e079135b99 tempest-VolumesSnapshotsTestJSON-2086553202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1dfdeaa1-2615-42db-941c-03556ed41a77.c0ceb429-3753-4877-85ee-5111014ccb6b {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:12:48 devstack sudo[97312]: pam_unix(sudo:session): session closed for user root
Jul 03 01:12:48 devstack sudo[97381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1dfdeaa1-2615-42db-941c-03556ed41a77.c0ceb429-3753-4877-85ee-5111014ccb6b
Jul 03 01:12:48 devstack sudo[97381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:12:49 devstack sudo[97381]: pam_unix(sudo:session): session closed for user root
Jul 03 01:12:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-e7a62c6b-8957-48ef-92f3-58fe6d6fcf97 req-3d1f15df-4101-444d-a850-89e079135b99 tempest-VolumesSnapshotsTestJSON-2086553202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1dfdeaa1-2615-42db-941c-03556ed41a77.c0ceb429-3753-4877-85ee-5111014ccb6b" returned: 0 in 0.702s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:12:49 devstack cinder-volume[86891]: DEBUG cinder.coordination [req-e7a62c6b-8957-48ef-92f3-58fe6d6fcf97 req-3d1f15df-4101-444d-a850-89e079135b99 tempest-VolumesSnapshotsTestJSON-2086553202 None] Lock "cinder-quobyte-c0ceb429-3753-4877-85ee-5111014ccb6b" released by "_delete_snapshot" :: held 3.745s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:12:49 devstack cinder-volume[86891]: DEBUG cinder.coordination [req-e7a62c6b-8957-48ef-92f3-58fe6d6fcf97 req-3d1f15df-4101-444d-a850-89e079135b99 tempest-VolumesSnapshotsTestJSON-2086553202 None] Lock "cinder-quobyte-1dfdeaa1-2615-42db-941c-03556ed41a77" released by "delete_snapshot" :: held 3.770s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:12:49 devstack cinder-volume[86891]: DEBUG cinder.quota [req-e7a62c6b-8957-48ef-92f3-58fe6d6fcf97 req-3d1f15df-4101-444d-a850-89e079135b99 tempest-VolumesSnapshotsTestJSON-2086553202 None] Created reservations ['b235f727-be43-43bb-98a8-4bf3570bf4b7', 'fda9e468-33af-4f3e-b33f-29ff7888f3c0', '76ebd64c-1b58-4ac3-86ae-bd453caf573f', 'b9744d64-2aae-4105-8be4-4001edabc050'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:12:49 devstack cinder-volume[86891]: INFO cinder.volume.manager [req-e7a62c6b-8957-48ef-92f3-58fe6d6fcf97 req-3d1f15df-4101-444d-a850-89e079135b99 tempest-VolumesSnapshotsTestJSON-2086553202 None] Delete snapshot completed successfully.
Jul 03 01:12:49 devstack cinder-volume[86891]: DEBUG cinder.coordination [req-e7a62c6b-8957-48ef-92f3-58fe6d6fcf97 req-3d1f15df-4101-444d-a850-89e079135b99 tempest-VolumesSnapshotsTestJSON-2086553202 None] Lock "cinder-c0ceb429-3753-4877-85ee-5111014ccb6b-delete_snapshot" released by "delete_snapshot" :: held 3.942s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:12:50 devstack cinder-volume[86891]: DEBUG cinder.coordination [req-7b161e26-5f3e-4b32-ae4b-7bc8951d8b3f req-c332acba-951a-41e2-874c-3d4b2b93b984 tempest-VolumesSnapshotsTestJSON-2086553202 None] Acquiring lock "cinder-1dfdeaa1-2615-42db-941c-03556ed41a77-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:12:50 devstack cinder-volume[86891]: DEBUG cinder.coordination [req-7b161e26-5f3e-4b32-ae4b-7bc8951d8b3f req-c332acba-951a-41e2-874c-3d4b2b93b984 tempest-VolumesSnapshotsTestJSON-2086553202 None] Lock "cinder-1dfdeaa1-2615-42db-941c-03556ed41a77-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:12:50 devstack cinder-volume[86891]: DEBUG cinder.coordination [req-7b161e26-5f3e-4b32-ae4b-7bc8951d8b3f req-c332acba-951a-41e2-874c-3d4b2b93b984 tempest-VolumesSnapshotsTestJSON-2086553202 None] Acquiring lock "cinder-quobyte-1dfdeaa1-2615-42db-941c-03556ed41a77" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:12:50 devstack cinder-volume[86891]: DEBUG cinder.coordination [req-7b161e26-5f3e-4b32-ae4b-7bc8951d8b3f req-c332acba-951a-41e2-874c-3d4b2b93b984 tempest-VolumesSnapshotsTestJSON-2086553202 None] Lock "cinder-quobyte-1dfdeaa1-2615-42db-941c-03556ed41a77" acquired by "delete_volume" :: waited 0.054s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:12:50 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5db581-1c59-4a73-86c4-82c3d9a653c3]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:12:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-7b161e26-5f3e-4b32-ae4b-7bc8951d8b3f req-c332acba-951a-41e2-874c-3d4b2b93b984 tempest-VolumesSnapshotsTestJSON-2086553202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1dfdeaa1-2615-42db-941c-03556ed41a77 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:12:50 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-369a6886-68ce-44d8-9713-932f26b70a47 tempest-GroupsTest-1482238299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:12:50 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-369a6886-68ce-44d8-9713-932f26b70a47 tempest-GroupsTest-1482238299 None] Flow 'volume_create_manager' (a3d84103-6082-4d95-969c-afd745299725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:12:50 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-369a6886-68ce-44d8-9713-932f26b70a47 tempest-GroupsTest-1482238299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ef1dae2-73f1-4dcc-a55a-b57c9f767c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:12:50 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-369a6886-68ce-44d8-9713-932f26b70a47 tempest-GroupsTest-1482238299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ef1dae2-73f1-4dcc-a55a-b57c9f767c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:12:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1321192931',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c1104dae-f0e5-4597-bed3-8ff7ed2542c0,host='devstack@QuobyteHD#QuobyteHD',id=3bb55b49-b71f-445b-9aca-494819b184d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24e055f4dc4242058cf6e245439e4f89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:12:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:12:51Z,use_quota=True,user_id='f5ec3e27ca3d45c4923aff63a6bbaff3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4d35de7-2789-45ab-9515-03c622fded9f),volume_type_id=d4d35de7-2789-45ab-9515-03c622fded9f)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:12:50 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-369a6886-68ce-44d8-9713-932f26b70a47 tempest-GroupsTest-1482238299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb5c2ae6-ac93-4f74-b006-4de0d2d004ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:12:50 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-369a6886-68ce-44d8-9713-932f26b70a47 tempest-GroupsTest-1482238299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb5c2ae6-ac93-4f74-b006-4de0d2d004ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:12:50 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-369a6886-68ce-44d8-9713-932f26b70a47 tempest-GroupsTest-1482238299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (382a7218-1516-4a04-805d-d074b65c1309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:12:50 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-369a6886-68ce-44d8-9713-932f26b70a47 tempest-GroupsTest-1482238299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (382a7218-1516-4a04-805d-d074b65c1309) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bb55b49-b71f-445b-9aca-494819b184d2', 'volume_name': 'volume-3bb55b49-b71f-445b-9aca-494819b184d2', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:12:50 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-369a6886-68ce-44d8-9713-932f26b70a47 tempest-GroupsTest-1482238299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee98f4f1-49b7-4ca8-9ecb-db1eeda41ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:12:50 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-369a6886-68ce-44d8-9713-932f26b70a47 tempest-GroupsTest-1482238299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee98f4f1-49b7-4ca8-9ecb-db1eeda41ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:12:50 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-369a6886-68ce-44d8-9713-932f26b70a47 tempest-GroupsTest-1482238299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (545986fe-fccf-4c82-966a-16e9010200dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:12:50 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-369a6886-68ce-44d8-9713-932f26b70a47 tempest-GroupsTest-1482238299 None] Volume 3bb55b49-b71f-445b-9aca-494819b184d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bb55b49-b71f-445b-9aca-494819b184d2', 'volume_size': 1}
Jul 03 01:12:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-369a6886-68ce-44d8-9713-932f26b70a47 tempest-GroupsTest-1482238299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:12:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-369a6886-68ce-44d8-9713-932f26b70a47 tempest-GroupsTest-1482238299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:12:50 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-369a6886-68ce-44d8-9713-932f26b70a47 tempest-GroupsTest-1482238299 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=c1104dae-f0e5-4597-bed3-8ff7ed2542c0,created_at=2026-07-02T23:12:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1321192931',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c1104dae-f0e5-4597-bed3-8ff7ed2542c0,host='devstack@QuobyteHD#QuobyteHD',id=3bb55b49-b71f-445b-9aca-494819b184d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24e055f4dc4242058cf6e245439e4f89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:12:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:12:51Z,use_quota=True,user_id='f5ec3e27ca3d45c4923aff63a6bbaff3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4d35de7-2789-45ab-9515-03c622fded9f),volume_type_id=d4d35de7-2789-45ab-9515-03c622fded9f)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:12:50 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-369a6886-68ce-44d8-9713-932f26b70a47 tempest-GroupsTest-1482238299 None] Creating volume 3bb55b49-b71f-445b-9aca-494819b184d2 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:12:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-369a6886-68ce-44d8-9713-932f26b70a47 tempest-GroupsTest-1482238299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:12:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-369a6886-68ce-44d8-9713-932f26b70a47 tempest-GroupsTest-1482238299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:12:50 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-369a6886-68ce-44d8-9713-932f26b70a47 tempest-GroupsTest-1482238299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:12:50 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-369a6886-68ce-44d8-9713-932f26b70a47 tempest-GroupsTest-1482238299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:12:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-369a6886-68ce-44d8-9713-932f26b70a47 tempest-GroupsTest-1482238299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:12:50 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-369a6886-68ce-44d8-9713-932f26b70a47 tempest-GroupsTest-1482238299 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:12:50 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-369a6886-68ce-44d8-9713-932f26b70a47 tempest-GroupsTest-1482238299 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:12:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-369a6886-68ce-44d8-9713-932f26b70a47 tempest-GroupsTest-1482238299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3bb55b49-b71f-445b-9aca-494819b184d2 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:12:50 devstack sudo[97390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1dfdeaa1-2615-42db-941c-03556ed41a77
Jul 03 01:12:50 devstack sudo[97390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:12:50 devstack sudo[97391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3bb55b49-b71f-445b-9aca-494819b184d2 1073741824
Jul 03 01:12:50 devstack sudo[97391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:12:52 devstack sudo[97390]: pam_unix(sudo:session): session closed for user root
Jul 03 01:12:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-7b161e26-5f3e-4b32-ae4b-7bc8951d8b3f req-c332acba-951a-41e2-874c-3d4b2b93b984 tempest-VolumesSnapshotsTestJSON-2086553202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1dfdeaa1-2615-42db-941c-03556ed41a77" returned: 0 in 1.416s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:12:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-7b161e26-5f3e-4b32-ae4b-7bc8951d8b3f req-c332acba-951a-41e2-874c-3d4b2b93b984 tempest-VolumesSnapshotsTestJSON-2086553202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1dfdeaa1-2615-42db-941c-03556ed41a77 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:12:52 devstack sudo[97401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1dfdeaa1-2615-42db-941c-03556ed41a77
Jul 03 01:12:52 devstack sudo[97401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:12:52 devstack sudo[97391]: pam_unix(sudo:session): session closed for user root
Jul 03 01:12:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-369a6886-68ce-44d8-9713-932f26b70a47 tempest-GroupsTest-1482238299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3bb55b49-b71f-445b-9aca-494819b184d2 1073741824" returned: 0 in 1.499s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:12:52 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3d2efa5-c65c-47e6-b27a-f36c8ecbc3a1 tempest-VolumesActionsTest-1547316290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:12:52 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b3d2efa5-c65c-47e6-b27a-f36c8ecbc3a1 tempest-VolumesActionsTest-1547316290 None] Flow 'volume_create_manager' (4495e0f9-3a11-48de-810e-d55611361e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:12:52 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b3d2efa5-c65c-47e6-b27a-f36c8ecbc3a1 tempest-VolumesActionsTest-1547316290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (730a25c9-7331-46c3-8641-fd50de6a4f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:12:52 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b3d2efa5-c65c-47e6-b27a-f36c8ecbc3a1 tempest-VolumesActionsTest-1547316290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (730a25c9-7331-46c3-8641-fd50de6a4f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:12:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1779065532',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=656b4665-b0d9-4a2a-b050-673d64e60f04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d7c647a6e6746b1a1936d53da5b3c17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:12:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:12:52Z,use_quota=True,user_id='7892e5242ca34398b2945766f2cd4ae7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:12:52 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b3d2efa5-c65c-47e6-b27a-f36c8ecbc3a1 tempest-VolumesActionsTest-1547316290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64da2b9c-2cca-4fd4-840b-7f479153589f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:12:52 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b3d2efa5-c65c-47e6-b27a-f36c8ecbc3a1 tempest-VolumesActionsTest-1547316290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64da2b9c-2cca-4fd4-840b-7f479153589f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:12:52 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b3d2efa5-c65c-47e6-b27a-f36c8ecbc3a1 tempest-VolumesActionsTest-1547316290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6935d52f-c659-44db-b8ac-b50f91594a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:12:52 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b3d2efa5-c65c-47e6-b27a-f36c8ecbc3a1 tempest-VolumesActionsTest-1547316290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6935d52f-c659-44db-b8ac-b50f91594a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '656b4665-b0d9-4a2a-b050-673d64e60f04', 'volume_name': 'volume-656b4665-b0d9-4a2a-b050-673d64e60f04', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:12:52 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b3d2efa5-c65c-47e6-b27a-f36c8ecbc3a1 tempest-VolumesActionsTest-1547316290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fd22998-b42f-4606-8a2a-3d3825ab01fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:12:52 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b3d2efa5-c65c-47e6-b27a-f36c8ecbc3a1 tempest-VolumesActionsTest-1547316290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fd22998-b42f-4606-8a2a-3d3825ab01fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:12:52 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b3d2efa5-c65c-47e6-b27a-f36c8ecbc3a1 tempest-VolumesActionsTest-1547316290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc946052-8cee-40f3-a718-6d620ea6bded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:12:52 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-b3d2efa5-c65c-47e6-b27a-f36c8ecbc3a1 tempest-VolumesActionsTest-1547316290 None] Volume 656b4665-b0d9-4a2a-b050-673d64e60f04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-656b4665-b0d9-4a2a-b050-673d64e60f04', 'volume_size': 1}
Jul 03 01:12:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b3d2efa5-c65c-47e6-b27a-f36c8ecbc3a1 tempest-VolumesActionsTest-1547316290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:12:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-369a6886-68ce-44d8-9713-932f26b70a47 tempest-GroupsTest-1482238299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3bb55b49-b71f-445b-9aca-494819b184d2 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:12:52 devstack sudo[97403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3bb55b49-b71f-445b-9aca-494819b184d2
Jul 03 01:12:52 devstack sudo[97403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:12:53 devstack sudo[97401]: pam_unix(sudo:session): session closed for user root
Jul 03 01:12:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-7b161e26-5f3e-4b32-ae4b-7bc8951d8b3f req-c332acba-951a-41e2-874c-3d4b2b93b984 tempest-VolumesSnapshotsTestJSON-2086553202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1dfdeaa1-2615-42db-941c-03556ed41a77" returned: 0 in 0.959s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:12:53 devstack cinder-volume[86891]: DEBUG cinder.coordination [req-7b161e26-5f3e-4b32-ae4b-7bc8951d8b3f req-c332acba-951a-41e2-874c-3d4b2b93b984 tempest-VolumesSnapshotsTestJSON-2086553202 None] Lock "cinder-quobyte-1dfdeaa1-2615-42db-941c-03556ed41a77" released by "delete_volume" :: held 2.594s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:12:53 devstack cinder-volume[86891]: DEBUG cinder.quota [req-7b161e26-5f3e-4b32-ae4b-7bc8951d8b3f req-c332acba-951a-41e2-874c-3d4b2b93b984 tempest-VolumesSnapshotsTestJSON-2086553202 None] Created reservations ['39723b46-e604-4983-b0e8-97c276becccc', 'bc70d1bb-c738-4d57-a381-905da4e31902', '62fd48db-27dc-4550-8b51-11edd0d0dcf5', 'b4374e52-0a0d-4ede-bc4b-dd6e07ea4c2e'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:12:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-7b161e26-5f3e-4b32-ae4b-7bc8951d8b3f req-c332acba-951a-41e2-874c-3d4b2b93b984 tempest-VolumesSnapshotsTestJSON-2086553202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:12:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-7b161e26-5f3e-4b32-ae4b-7bc8951d8b3f req-c332acba-951a-41e2-874c-3d4b2b93b984 tempest-VolumesSnapshotsTestJSON-2086553202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:12:53 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [req-7b161e26-5f3e-4b32-ae4b-7bc8951d8b3f req-c332acba-951a-41e2-874c-3d4b2b93b984 tempest-VolumesSnapshotsTestJSON-2086553202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:12:53 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [req-7b161e26-5f3e-4b32-ae4b-7bc8951d8b3f req-c332acba-951a-41e2-874c-3d4b2b93b984 tempest-VolumesSnapshotsTestJSON-2086553202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:12:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-7b161e26-5f3e-4b32-ae4b-7bc8951d8b3f req-c332acba-951a-41e2-874c-3d4b2b93b984 tempest-VolumesSnapshotsTestJSON-2086553202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:12:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-7b161e26-5f3e-4b32-ae4b-7bc8951d8b3f req-c332acba-951a-41e2-874c-3d4b2b93b984 tempest-VolumesSnapshotsTestJSON-2086553202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:12:53 devstack sudo[97407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:12:53 devstack sudo[97407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:12:53 devstack sudo[97403]: pam_unix(sudo:session): session closed for user root
Jul 03 01:12:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-369a6886-68ce-44d8-9713-932f26b70a47 tempest-GroupsTest-1482238299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3bb55b49-b71f-445b-9aca-494819b184d2" returned: 0 in 0.686s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:12:53 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-369a6886-68ce-44d8-9713-932f26b70a47 tempest-GroupsTest-1482238299 None] <== create_volume: return (2416ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:12:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-369a6886-68ce-44d8-9713-932f26b70a47 tempest-GroupsTest-1482238299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.419s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:12:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b3d2efa5-c65c-47e6-b27a-f36c8ecbc3a1 tempest-VolumesActionsTest-1547316290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.700s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:12:53 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-b3d2efa5-c65c-47e6-b27a-f36c8ecbc3a1 tempest-VolumesActionsTest-1547316290 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:12:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1779065532',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=656b4665-b0d9-4a2a-b050-673d64e60f04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d7c647a6e6746b1a1936d53da5b3c17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:12:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:12:52Z,use_quota=True,user_id='7892e5242ca34398b2945766f2cd4ae7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:12:53 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-b3d2efa5-c65c-47e6-b27a-f36c8ecbc3a1 tempest-VolumesActionsTest-1547316290 None] Creating volume 656b4665-b0d9-4a2a-b050-673d64e60f04 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:12:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b3d2efa5-c65c-47e6-b27a-f36c8ecbc3a1 tempest-VolumesActionsTest-1547316290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:12:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b3d2efa5-c65c-47e6-b27a-f36c8ecbc3a1 tempest-VolumesActionsTest-1547316290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:12:53 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-b3d2efa5-c65c-47e6-b27a-f36c8ecbc3a1 tempest-VolumesActionsTest-1547316290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:12:53 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-b3d2efa5-c65c-47e6-b27a-f36c8ecbc3a1 tempest-VolumesActionsTest-1547316290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:12:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b3d2efa5-c65c-47e6-b27a-f36c8ecbc3a1 tempest-VolumesActionsTest-1547316290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:12:53 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-b3d2efa5-c65c-47e6-b27a-f36c8ecbc3a1 tempest-VolumesActionsTest-1547316290 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:12:53 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-b3d2efa5-c65c-47e6-b27a-f36c8ecbc3a1 tempest-VolumesActionsTest-1547316290 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:12:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b3d2efa5-c65c-47e6-b27a-f36c8ecbc3a1 tempest-VolumesActionsTest-1547316290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-656b4665-b0d9-4a2a-b050-673d64e60f04 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:12:53 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-369a6886-68ce-44d8-9713-932f26b70a47 tempest-GroupsTest-1482238299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (545986fe-fccf-4c82-966a-16e9010200dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bb55b49-b71f-445b-9aca-494819b184d2', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:12:53 devstack sudo[97409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-656b4665-b0d9-4a2a-b050-673d64e60f04 1073741824
Jul 03 01:12:53 devstack sudo[97409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:12:53 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-369a6886-68ce-44d8-9713-932f26b70a47 tempest-GroupsTest-1482238299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (397b8175-777f-4314-94bc-93e2bae69cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:12:53 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-369a6886-68ce-44d8-9713-932f26b70a47 tempest-GroupsTest-1482238299 None] Volume volume-3bb55b49-b71f-445b-9aca-494819b184d2 (3bb55b49-b71f-445b-9aca-494819b184d2): created successfully
Jul 03 01:12:53 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-369a6886-68ce-44d8-9713-932f26b70a47 tempest-GroupsTest-1482238299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (397b8175-777f-4314-94bc-93e2bae69cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:12:53 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-369a6886-68ce-44d8-9713-932f26b70a47 tempest-GroupsTest-1482238299 None] Flow 'volume_create_manager' (a3d84103-6082-4d95-969c-afd745299725) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:12:53 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-369a6886-68ce-44d8-9713-932f26b70a47 tempest-GroupsTest-1482238299 None] Created volume successfully.
Jul 03 01:12:53 devstack sudo[97407]: pam_unix(sudo:session): session closed for user root
Jul 03 01:12:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-7b161e26-5f3e-4b32-ae4b-7bc8951d8b3f req-c332acba-951a-41e2-874c-3d4b2b93b984 tempest-VolumesSnapshotsTestJSON-2086553202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.729s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:12:53 devstack cinder-volume[86891]: DEBUG cinder.manager [req-7b161e26-5f3e-4b32-ae4b-7bc8951d8b3f req-c332acba-951a-41e2-874c-3d4b2b93b984 tempest-VolumesSnapshotsTestJSON-2086553202 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:12:53 devstack cinder-volume[86891]: INFO cinder.volume.manager [req-7b161e26-5f3e-4b32-ae4b-7bc8951d8b3f req-c332acba-951a-41e2-874c-3d4b2b93b984 tempest-VolumesSnapshotsTestJSON-2086553202 None] Deleted volume successfully.
Jul 03 01:12:53 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:SELECT=119,cinder:UPDATE=119,cinder:INSERT=31,cinder:DELETE=7 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:12:53 devstack cinder-volume[86891]: DEBUG cinder.coordination [req-7b161e26-5f3e-4b32-ae4b-7bc8951d8b3f req-c332acba-951a-41e2-874c-3d4b2b93b984 tempest-VolumesSnapshotsTestJSON-2086553202 None] Lock "cinder-1dfdeaa1-2615-42db-941c-03556ed41a77-delete_volume" released by "delete_volume" :: held 3.702s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:12:54 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:UPDATE=126,cinder:SELECT=99,cinder:INSERT=25,cinder:DELETE=5 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:12:54 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-b2db4a39-d08c-49e5-84aa-36bdb1626002 tempest-GroupsTest-1482238299 None] Update group completed successfully.
Jul 03 01:12:54 devstack cinder-volume[86891]: INFO cinder.volume.manager [req-dfebea17-0437-4c6a-aa3a-a77cc48f5ae7 req-152c72e8-b3b3-4dec-a116-ee34580a4215 tempest-TestServerVolumeAttachScenarioOldVersion-1230274272 None] Terminate volume connection completed successfully.
Jul 03 01:12:54 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [req-dfebea17-0437-4c6a-aa3a-a77cc48f5ae7 req-152c72e8-b3b3-4dec-a116-ee34580a4215 tempest-TestServerVolumeAttachScenarioOldVersion-1230274272 None] Deleting attachment d65275e8-c7cc-41d9-8450-bf67098b6e3c. {{(pid=86891) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 01:12:54 devstack sudo[97409]: pam_unix(sudo:session): session closed for user root
Jul 03 01:12:54 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b3d2efa5-c65c-47e6-b27a-f36c8ecbc3a1 tempest-VolumesActionsTest-1547316290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-656b4665-b0d9-4a2a-b050-673d64e60f04 1073741824" returned: 0 in 1.301s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:12:54 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b3d2efa5-c65c-47e6-b27a-f36c8ecbc3a1 tempest-VolumesActionsTest-1547316290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-656b4665-b0d9-4a2a-b050-673d64e60f04 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:12:54 devstack sudo[97442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-656b4665-b0d9-4a2a-b050-673d64e60f04
Jul 03 01:12:54 devstack sudo[97442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:12:55 devstack sudo[97442]: pam_unix(sudo:session): session closed for user root
Jul 03 01:12:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b3d2efa5-c65c-47e6-b27a-f36c8ecbc3a1 tempest-VolumesActionsTest-1547316290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-656b4665-b0d9-4a2a-b050-673d64e60f04" returned: 0 in 0.725s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:12:55 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-b3d2efa5-c65c-47e6-b27a-f36c8ecbc3a1 tempest-VolumesActionsTest-1547316290 None] <== create_volume: return (2098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:12:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b3d2efa5-c65c-47e6-b27a-f36c8ecbc3a1 tempest-VolumesActionsTest-1547316290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.101s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:12:55 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b3d2efa5-c65c-47e6-b27a-f36c8ecbc3a1 tempest-VolumesActionsTest-1547316290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc946052-8cee-40f3-a718-6d620ea6bded) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-656b4665-b0d9-4a2a-b050-673d64e60f04', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:12:55 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b3d2efa5-c65c-47e6-b27a-f36c8ecbc3a1 tempest-VolumesActionsTest-1547316290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (674c2354-93e6-4b5f-be5c-5712b9d1aeb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:12:55 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-b3d2efa5-c65c-47e6-b27a-f36c8ecbc3a1 tempest-VolumesActionsTest-1547316290 None] Volume volume-656b4665-b0d9-4a2a-b050-673d64e60f04 (656b4665-b0d9-4a2a-b050-673d64e60f04): created successfully
Jul 03 01:12:55 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b3d2efa5-c65c-47e6-b27a-f36c8ecbc3a1 tempest-VolumesActionsTest-1547316290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (674c2354-93e6-4b5f-be5c-5712b9d1aeb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:12:55 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b3d2efa5-c65c-47e6-b27a-f36c8ecbc3a1 tempest-VolumesActionsTest-1547316290 None] Flow 'volume_create_manager' (4495e0f9-3a11-48de-810e-d55611361e66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:12:55 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-b3d2efa5-c65c-47e6-b27a-f36c8ecbc3a1 tempest-VolumesActionsTest-1547316290 None] Created volume successfully.
Jul 03 01:12:55 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d4a7ab87-25da-4e49-96f3-7af8608946ce tempest-VolumesActionsTest-1547316290 None] Acquiring lock "cinder-656b4665-b0d9-4a2a-b050-673d64e60f04" by "attach_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:12:55 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d4a7ab87-25da-4e49-96f3-7af8608946ce tempest-VolumesActionsTest-1547316290 None] Lock "cinder-656b4665-b0d9-4a2a-b050-673d64e60f04" acquired by "attach_volume" :: waited 0.071s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:12:55 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-d4a7ab87-25da-4e49-96f3-7af8608946ce tempest-VolumesActionsTest-1547316290 None] Attaching volume 656b4665-b0d9-4a2a-b050-673d64e60f04 to instance 88f377c4-64a6-4ab8-9624-33f3e133b79c at mountpoint /dev/vdb on host None.
Jul 03 01:12:55 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-ab65c521-1ab4-474e-a479-fa3da6e79e70 tempest-GroupsTest-1482238299 None] Update group completed successfully.
Jul 03 01:12:55 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-d4a7ab87-25da-4e49-96f3-7af8608946ce tempest-VolumesActionsTest-1547316290 None] Attach volume completed successfully.
Jul 03 01:12:55 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d4a7ab87-25da-4e49-96f3-7af8608946ce tempest-VolumesActionsTest-1547316290 None] Lock "cinder-656b4665-b0d9-4a2a-b050-673d64e60f04" released by "attach_volume" :: held 0.161s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:12:56 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-782d6321-031a-4854-905b-e22678cfd433 tempest-TestServerVolumeAttachScenarioOldVersion-1230274272 None] Acquiring lock "cinder-6f5b8f66-e023-48e9-857f-e8817ac029ad-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:12:56 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-782d6321-031a-4854-905b-e22678cfd433 tempest-TestServerVolumeAttachScenarioOldVersion-1230274272 None] Lock "cinder-6f5b8f66-e023-48e9-857f-e8817ac029ad-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:12:56 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-782d6321-031a-4854-905b-e22678cfd433 tempest-TestServerVolumeAttachScenarioOldVersion-1230274272 None] Acquiring lock "cinder-quobyte-6f5b8f66-e023-48e9-857f-e8817ac029ad" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:12:56 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-782d6321-031a-4854-905b-e22678cfd433 tempest-TestServerVolumeAttachScenarioOldVersion-1230274272 None] Lock "cinder-quobyte-6f5b8f66-e023-48e9-857f-e8817ac029ad" acquired by "delete_volume" :: waited 0.025s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:12:56 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[92920a0d-7e85-4358-a20d-17e632b435bd]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:12:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-782d6321-031a-4854-905b-e22678cfd433 tempest-TestServerVolumeAttachScenarioOldVersion-1230274272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-6f5b8f66-e023-48e9-857f-e8817ac029ad {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:12:56 devstack sudo[97445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-6f5b8f66-e023-48e9-857f-e8817ac029ad
Jul 03 01:12:56 devstack sudo[97445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:12:57 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-7e867fac-666f-4b0f-bda9-5407367d6b41 tempest-VolumesActionsTest-1293153765 None] Terminate volume connection completed successfully.
Jul 03 01:12:57 devstack sudo[97445]: pam_unix(sudo:session): session closed for user root
Jul 03 01:12:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-782d6321-031a-4854-905b-e22678cfd433 tempest-TestServerVolumeAttachScenarioOldVersion-1230274272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-6f5b8f66-e023-48e9-857f-e8817ac029ad" returned: 0 in 1.061s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:12:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-782d6321-031a-4854-905b-e22678cfd433 tempest-TestServerVolumeAttachScenarioOldVersion-1230274272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-6f5b8f66-e023-48e9-857f-e8817ac029ad {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:12:57 devstack sudo[97450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-6f5b8f66-e023-48e9-857f-e8817ac029ad
Jul 03 01:12:57 devstack sudo[97450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:12:57 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8e6fb69c-0cc3-475e-8ea3-f7f8a72fd7b7 tempest-GroupsTest-1482238299 None] Acquiring lock "cinder-quobyte-3bb55b49-b71f-445b-9aca-494819b184d2" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:12:57 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-7e867fac-666f-4b0f-bda9-5407367d6b41 tempest-VolumesActionsTest-1293153765 None] Acquiring lock "cinder-656b4665-b0d9-4a2a-b050-673d64e60f04-detach_volume" by "detach_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:12:57 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8e6fb69c-0cc3-475e-8ea3-f7f8a72fd7b7 tempest-GroupsTest-1482238299 None] Lock "cinder-quobyte-3bb55b49-b71f-445b-9aca-494819b184d2" acquired by "delete_volume" :: waited 0.061s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:12:57 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-7e867fac-666f-4b0f-bda9-5407367d6b41 tempest-VolumesActionsTest-1293153765 None] Lock "cinder-656b4665-b0d9-4a2a-b050-673d64e60f04-detach_volume" acquired by "detach_volume" :: waited 0.070s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:12:57 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb2602c-6d49-432b-beed-2fabf0896225]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:12:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8e6fb69c-0cc3-475e-8ea3-f7f8a72fd7b7 tempest-GroupsTest-1482238299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3bb55b49-b71f-445b-9aca-494819b184d2 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:12:58 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-7e867fac-666f-4b0f-bda9-5407367d6b41 tempest-VolumesActionsTest-1293153765 None] Detaching volume 656b4665-b0d9-4a2a-b050-673d64e60f04 from instance 88f377c4-64a6-4ab8-9624-33f3e133b79c.
Jul 03 01:12:58 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-7e867fac-666f-4b0f-bda9-5407367d6b41 tempest-VolumesActionsTest-1293153765 None] Detach volume completed successfully.
Jul 03 01:12:58 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-7e867fac-666f-4b0f-bda9-5407367d6b41 tempest-VolumesActionsTest-1293153765 None] Lock "cinder-656b4665-b0d9-4a2a-b050-673d64e60f04-detach_volume" released by "detach_volume" :: held 0.112s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:12:58 devstack sudo[97452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3bb55b49-b71f-445b-9aca-494819b184d2
Jul 03 01:12:58 devstack sudo[97452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:12:58 devstack sudo[97450]: pam_unix(sudo:session): session closed for user root
Jul 03 01:12:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-782d6321-031a-4854-905b-e22678cfd433 tempest-TestServerVolumeAttachScenarioOldVersion-1230274272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-6f5b8f66-e023-48e9-857f-e8817ac029ad" returned: 0 in 1.062s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:12:58 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-782d6321-031a-4854-905b-e22678cfd433 tempest-TestServerVolumeAttachScenarioOldVersion-1230274272 None] Lock "cinder-quobyte-6f5b8f66-e023-48e9-857f-e8817ac029ad" released by "delete_volume" :: held 2.199s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:12:58 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-ecf26049-2ca8-4096-b1ab-1d41705202cc tempest-VolumesActionsTest-1547316290 None] Acquiring lock "cinder-656b4665-b0d9-4a2a-b050-673d64e60f04-detach_volume" by "detach_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:12:58 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-ecf26049-2ca8-4096-b1ab-1d41705202cc tempest-VolumesActionsTest-1547316290 None] Lock "cinder-656b4665-b0d9-4a2a-b050-673d64e60f04-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:12:58 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-ecf26049-2ca8-4096-b1ab-1d41705202cc tempest-VolumesActionsTest-1547316290 None] Volume detach called, but volume not attached.
Jul 03 01:12:58 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-ecf26049-2ca8-4096-b1ab-1d41705202cc tempest-VolumesActionsTest-1547316290 None] Lock "cinder-656b4665-b0d9-4a2a-b050-673d64e60f04-detach_volume" released by "detach_volume" :: held 0.032s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:12:58 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-782d6321-031a-4854-905b-e22678cfd433 tempest-TestServerVolumeAttachScenarioOldVersion-1230274272 None] Created reservations ['2d32cfe0-b6ae-4638-8b21-90b20b0c8365', '4accaf0b-874a-42f3-8534-55d26dc618bb', '35b71f81-6266-4a7a-8d55-1409cd410a38', '387f6810-bc9b-46bd-9ab5-b3c8f3b8e4a6'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:12:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-782d6321-031a-4854-905b-e22678cfd433 tempest-TestServerVolumeAttachScenarioOldVersion-1230274272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:12:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-782d6321-031a-4854-905b-e22678cfd433 tempest-TestServerVolumeAttachScenarioOldVersion-1230274272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:12:58 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-782d6321-031a-4854-905b-e22678cfd433 tempest-TestServerVolumeAttachScenarioOldVersion-1230274272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:12:58 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-782d6321-031a-4854-905b-e22678cfd433 tempest-TestServerVolumeAttachScenarioOldVersion-1230274272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:12:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-782d6321-031a-4854-905b-e22678cfd433 tempest-TestServerVolumeAttachScenarioOldVersion-1230274272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:12:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-782d6321-031a-4854-905b-e22678cfd433 tempest-TestServerVolumeAttachScenarioOldVersion-1230274272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:12:58 devstack sudo[97456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:12:58 devstack sudo[97456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:12:59 devstack sudo[97452]: pam_unix(sudo:session): session closed for user root
Jul 03 01:12:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8e6fb69c-0cc3-475e-8ea3-f7f8a72fd7b7 tempest-GroupsTest-1482238299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3bb55b49-b71f-445b-9aca-494819b184d2" returned: 0 in 1.558s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:12:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8e6fb69c-0cc3-475e-8ea3-f7f8a72fd7b7 tempest-GroupsTest-1482238299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3bb55b49-b71f-445b-9aca-494819b184d2 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:12:59 devstack sudo[97461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3bb55b49-b71f-445b-9aca-494819b184d2
Jul 03 01:12:59 devstack sudo[97461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:12:59 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-3ab9b418-4b80-4021-b0f9-017c0fd8ee4c tempest-VolumesActionsTest-1547316290 None] Acquiring lock "cinder-656b4665-b0d9-4a2a-b050-673d64e60f04-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:12:59 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-3ab9b418-4b80-4021-b0f9-017c0fd8ee4c tempest-VolumesActionsTest-1547316290 None] Lock "cinder-656b4665-b0d9-4a2a-b050-673d64e60f04-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:12:59 devstack sudo[97456]: pam_unix(sudo:session): session closed for user root
Jul 03 01:12:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-782d6321-031a-4854-905b-e22678cfd433 tempest-TestServerVolumeAttachScenarioOldVersion-1230274272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.917s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:12:59 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-782d6321-031a-4854-905b-e22678cfd433 tempest-TestServerVolumeAttachScenarioOldVersion-1230274272 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:12:59 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-782d6321-031a-4854-905b-e22678cfd433 tempest-TestServerVolumeAttachScenarioOldVersion-1230274272 None] Deleted volume successfully.
Jul 03 01:12:59 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-3ab9b418-4b80-4021-b0f9-017c0fd8ee4c tempest-VolumesActionsTest-1547316290 None] Acquiring lock "cinder-quobyte-656b4665-b0d9-4a2a-b050-673d64e60f04" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:12:59 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-782d6321-031a-4854-905b-e22678cfd433 tempest-TestServerVolumeAttachScenarioOldVersion-1230274272 None] Lock "cinder-6f5b8f66-e023-48e9-857f-e8817ac029ad-delete_volume" released by "delete_volume" :: held 3.457s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:12:59 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-3ab9b418-4b80-4021-b0f9-017c0fd8ee4c tempest-VolumesActionsTest-1547316290 None] Lock "cinder-quobyte-656b4665-b0d9-4a2a-b050-673d64e60f04" acquired by "delete_volume" :: waited 0.029s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:12:59 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a2d4afb-cab3-4b01-a891-5417582d96a0]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:12:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-3ab9b418-4b80-4021-b0f9-017c0fd8ee4c tempest-VolumesActionsTest-1547316290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-656b4665-b0d9-4a2a-b050-673d64e60f04 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:00 devstack sudo[97464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-656b4665-b0d9-4a2a-b050-673d64e60f04
Jul 03 01:13:00 devstack sudo[97464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:01 devstack sudo[97461]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8e6fb69c-0cc3-475e-8ea3-f7f8a72fd7b7 tempest-GroupsTest-1482238299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3bb55b49-b71f-445b-9aca-494819b184d2" returned: 0 in 1.452s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:01 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8e6fb69c-0cc3-475e-8ea3-f7f8a72fd7b7 tempest-GroupsTest-1482238299 None] Lock "cinder-quobyte-3bb55b49-b71f-445b-9aca-494819b184d2" released by "delete_volume" :: held 3.094s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:13:01 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8e6fb69c-0cc3-475e-8ea3-f7f8a72fd7b7 tempest-GroupsTest-1482238299 None] Acquiring lock "cinder-quobyte-81d5c819-98d7-4881-97bf-68f6265eaa63" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:13:01 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8e6fb69c-0cc3-475e-8ea3-f7f8a72fd7b7 tempest-GroupsTest-1482238299 None] Lock "cinder-quobyte-81d5c819-98d7-4881-97bf-68f6265eaa63" acquired by "delete_volume" :: waited 0.026s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:13:01 devstack sudo[97464]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-3ab9b418-4b80-4021-b0f9-017c0fd8ee4c tempest-VolumesActionsTest-1547316290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-656b4665-b0d9-4a2a-b050-673d64e60f04" returned: 0 in 1.209s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-3ab9b418-4b80-4021-b0f9-017c0fd8ee4c tempest-VolumesActionsTest-1547316290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-656b4665-b0d9-4a2a-b050-673d64e60f04 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:01 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[853abf25-18d5-412c-a8b0-1ce4a440fb92]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:13:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8e6fb69c-0cc3-475e-8ea3-f7f8a72fd7b7 tempest-GroupsTest-1482238299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-81d5c819-98d7-4881-97bf-68f6265eaa63 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:01 devstack sudo[97470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-656b4665-b0d9-4a2a-b050-673d64e60f04
Jul 03 01:13:01 devstack sudo[97470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:01 devstack sudo[97471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-81d5c819-98d7-4881-97bf-68f6265eaa63
Jul 03 01:13:01 devstack sudo[97471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:01 devstack cinder-volume[86891]: DEBUG oslo_service.periodic_task [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86891) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 01:13:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:13:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:13:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:13:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:13:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:13:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:02 devstack sudo[97531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:13:02 devstack sudo[97531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:02 devstack sudo[97470]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-3ab9b418-4b80-4021-b0f9-017c0fd8ee4c tempest-VolumesActionsTest-1547316290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-656b4665-b0d9-4a2a-b050-673d64e60f04" returned: 0 in 1.489s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:02 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-3ab9b418-4b80-4021-b0f9-017c0fd8ee4c tempest-VolumesActionsTest-1547316290 None] Lock "cinder-quobyte-656b4665-b0d9-4a2a-b050-673d64e60f04" released by "delete_volume" :: held 2.783s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:13:02 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-3ab9b418-4b80-4021-b0f9-017c0fd8ee4c tempest-VolumesActionsTest-1547316290 None] Created reservations ['df7a5c3e-6b24-40fc-a290-4c0c8d5aa0db', '4fddf150-a36d-4bda-a330-9092b2d0c50b', 'eed0b539-ca20-4d5b-859f-64ec9e654872', 'fd1ae2d9-83b2-4ba5-8271-0ec7c8ad0620'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:13:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-3ab9b418-4b80-4021-b0f9-017c0fd8ee4c tempest-VolumesActionsTest-1547316290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:13:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-3ab9b418-4b80-4021-b0f9-017c0fd8ee4c tempest-VolumesActionsTest-1547316290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:13:02 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-3ab9b418-4b80-4021-b0f9-017c0fd8ee4c tempest-VolumesActionsTest-1547316290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:13:02 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-3ab9b418-4b80-4021-b0f9-017c0fd8ee4c tempest-VolumesActionsTest-1547316290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:13:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-3ab9b418-4b80-4021-b0f9-017c0fd8ee4c tempest-VolumesActionsTest-1547316290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:13:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-3ab9b418-4b80-4021-b0f9-017c0fd8ee4c tempest-VolumesActionsTest-1547316290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:02 devstack sudo[97471]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8e6fb69c-0cc3-475e-8ea3-f7f8a72fd7b7 tempest-GroupsTest-1482238299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-81d5c819-98d7-4881-97bf-68f6265eaa63" returned: 0 in 1.847s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8e6fb69c-0cc3-475e-8ea3-f7f8a72fd7b7 tempest-GroupsTest-1482238299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-81d5c819-98d7-4881-97bf-68f6265eaa63 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:02 devstack sudo[97571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:13:02 devstack sudo[97571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:03 devstack sudo[97572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-81d5c819-98d7-4881-97bf-68f6265eaa63
Jul 03 01:13:03 devstack sudo[97572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:03 devstack sudo[97531]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 1.325s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:03 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:13:03 devstack cinder-volume[86891]: DEBUG oslo_service.periodic_task [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running periodic task VolumeManager._thread_info {{(pid=86891) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 01:13:03 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] thread count: 28 {{(pid=86891) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 01:13:03 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] thread info: [<_MainThread(MainThread, started 136731296534656)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136731184953280)>, <Thread(Thread-3 (stat_writer), started daemon 136731184058816)>, <Thread(Rabbit-heartbeat, started daemon 136731184846080)>, <Thread(Thread-5 (_runner), started daemon 136731182936576)>, <Thread(Thread-7 (_runner), started daemon 136731182954944)>, <Thread(fd_logger, started daemon 136731181916416)>, <Thread(privsep_reader, started daemon 136731180942208)>, <Thread(tpool_thread_0, started daemon 136731172161216)>, <Thread(tpool_thread_1, started daemon 136731163768512)>, <Thread(tpool_thread_2, started daemon 136731155375808)>, <Thread(tpool_thread_3, started daemon 136731146983104)>, <Thread(tpool_thread_4, started daemon 136731138590400)>, <Thread(tpool_thread_5, started daemon 136731130197696)>, <Thread(tpool_thread_6, started daemon 136731121804992)>, <Thread(tpool_thread_7, started daemon 136731113412288)>, <Thread(tpool_thread_8, started daemon 136731105003200)>, <Thread(tpool_thread_9, started daemon 136731096594112)>, <Thread(tpool_thread_10, started daemon 136731088185024)>, <Thread(tpool_thread_11, started daemon 136731079775936)>, <Thread(tpool_thread_12, started daemon 136731071366848)>, <Thread(tpool_thread_13, started daemon 136731062957760)>, <Thread(tpool_thread_14, started daemon 136731054548672)>, <Thread(tpool_thread_15, started daemon 136731046139584)>, <Thread(tpool_thread_16, started daemon 136731037730496)>, <Thread(tpool_thread_17, started daemon 136731029321408)>, <Thread(tpool_thread_18, started daemon 136731020912320)>, <Thread(tpool_thread_19, started daemon 136731012503232)>] {{(pid=86891) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 01:13:04 devstack sudo[97571]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-3ab9b418-4b80-4021-b0f9-017c0fd8ee4c tempest-VolumesActionsTest-1547316290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 1.269s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:04 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-3ab9b418-4b80-4021-b0f9-017c0fd8ee4c tempest-VolumesActionsTest-1547316290 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:13:04 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-3ab9b418-4b80-4021-b0f9-017c0fd8ee4c tempest-VolumesActionsTest-1547316290 None] Deleted volume successfully.
Jul 03 01:13:04 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-3ab9b418-4b80-4021-b0f9-017c0fd8ee4c tempest-VolumesActionsTest-1547316290 None] Lock "cinder-656b4665-b0d9-4a2a-b050-673d64e60f04-delete_volume" released by "delete_volume" :: held 4.497s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:13:04 devstack sudo[97572]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8e6fb69c-0cc3-475e-8ea3-f7f8a72fd7b7 tempest-GroupsTest-1482238299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-81d5c819-98d7-4881-97bf-68f6265eaa63" returned: 0 in 1.425s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:04 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8e6fb69c-0cc3-475e-8ea3-f7f8a72fd7b7 tempest-GroupsTest-1482238299 None] Lock "cinder-quobyte-81d5c819-98d7-4881-97bf-68f6265eaa63" released by "delete_volume" :: held 3.344s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:13:04 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-8e6fb69c-0cc3-475e-8ea3-f7f8a72fd7b7 tempest-GroupsTest-1482238299 None] Created reservations ['1bda8fef-bdb0-4213-9ad4-67d299885beb'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:13:04 devstack cinder-volume[86891]: WARNING cinder.quota [None req-8e6fb69c-0cc3-475e-8ea3-f7f8a72fd7b7 tempest-GroupsTest-1482238299 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-905282840 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-905282840, it is now deprecated. Please use the default quota class for default quota.
Jul 03 01:13:04 devstack cinder-volume[86891]: WARNING cinder.quota [None req-8e6fb69c-0cc3-475e-8ea3-f7f8a72fd7b7 tempest-GroupsTest-1482238299 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-905282840 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-905282840, it is now deprecated. Please use the default quota class for default quota.
Jul 03 01:13:04 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-8e6fb69c-0cc3-475e-8ea3-f7f8a72fd7b7 tempest-GroupsTest-1482238299 None] Created reservations ['18579996-811b-4050-ac97-94c1bf5eb576', 'e3630008-4c66-49a7-858b-cb25e4e63659', 'f6de8e56-4a78-4f24-a22d-6efbf9de1070', '4a99231f-648e-41f2-84ea-265b8bf515b9'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:13:04 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-8e6fb69c-0cc3-475e-8ea3-f7f8a72fd7b7 tempest-GroupsTest-1482238299 None] Created reservations ['f5f0bac8-3a74-44bc-9b3d-177a0e73691c', '61f00e1f-0d86-4185-b9c4-758d042d435a', '243598cf-1999-4fad-96a3-7408689f3fa6', 'e58e0d70-3c0f-48c9-b088-788da79ef05b'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:13:05 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-8e6fb69c-0cc3-475e-8ea3-f7f8a72fd7b7 tempest-GroupsTest-1482238299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:13:05 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-8e6fb69c-0cc3-475e-8ea3-f7f8a72fd7b7 tempest-GroupsTest-1482238299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:13:05 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-8e6fb69c-0cc3-475e-8ea3-f7f8a72fd7b7 tempest-GroupsTest-1482238299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:13:05 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-8e6fb69c-0cc3-475e-8ea3-f7f8a72fd7b7 tempest-GroupsTest-1482238299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:13:05 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-8e6fb69c-0cc3-475e-8ea3-f7f8a72fd7b7 tempest-GroupsTest-1482238299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:13:05 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8e6fb69c-0cc3-475e-8ea3-f7f8a72fd7b7 tempest-GroupsTest-1482238299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:05 devstack sudo[97630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:13:05 devstack sudo[97630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:05 devstack sudo[97630]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:05 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8e6fb69c-0cc3-475e-8ea3-f7f8a72fd7b7 tempest-GroupsTest-1482238299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.789s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:05 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-8e6fb69c-0cc3-475e-8ea3-f7f8a72fd7b7 tempest-GroupsTest-1482238299 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:13:05 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-8e6fb69c-0cc3-475e-8ea3-f7f8a72fd7b7 tempest-GroupsTest-1482238299 None] Delete group completed successfully.
Jul 03 01:13:12 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c4b0d4a-519e-4172-afbe-3ec3c94380f1 tempest-VolumesActionsTest-1547316290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:13:12 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3c4b0d4a-519e-4172-afbe-3ec3c94380f1 tempest-VolumesActionsTest-1547316290 None] Flow 'volume_create_manager' (b45dfbd5-fdaf-4f8b-8f2c-c008e821c703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:13:12 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3c4b0d4a-519e-4172-afbe-3ec3c94380f1 tempest-VolumesActionsTest-1547316290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a9361cf-92ee-4d73-8193-495f0d4b5d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:12 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3c4b0d4a-519e-4172-afbe-3ec3c94380f1 tempest-VolumesActionsTest-1547316290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a9361cf-92ee-4d73-8193-495f0d4b5d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:13:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-749681494',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e73a0a7e-4d6d-4484-8dd1-fa402e327829,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d7c647a6e6746b1a1936d53da5b3c17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:13:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:13:12Z,use_quota=True,user_id='7892e5242ca34398b2945766f2cd4ae7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:12 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3c4b0d4a-519e-4172-afbe-3ec3c94380f1 tempest-VolumesActionsTest-1547316290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd18f846-42db-4c43-8fba-1cc98ddd5a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:12 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3c4b0d4a-519e-4172-afbe-3ec3c94380f1 tempest-VolumesActionsTest-1547316290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd18f846-42db-4c43-8fba-1cc98ddd5a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:12 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3c4b0d4a-519e-4172-afbe-3ec3c94380f1 tempest-VolumesActionsTest-1547316290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e9d97d5-ca0b-495d-8d9a-6fad46645b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:12 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3c4b0d4a-519e-4172-afbe-3ec3c94380f1 tempest-VolumesActionsTest-1547316290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e9d97d5-ca0b-495d-8d9a-6fad46645b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e73a0a7e-4d6d-4484-8dd1-fa402e327829', 'volume_name': 'volume-e73a0a7e-4d6d-4484-8dd1-fa402e327829', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:12 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3c4b0d4a-519e-4172-afbe-3ec3c94380f1 tempest-VolumesActionsTest-1547316290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08a1bf12-b91e-455c-b42b-8611b7d59a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:12 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3c4b0d4a-519e-4172-afbe-3ec3c94380f1 tempest-VolumesActionsTest-1547316290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08a1bf12-b91e-455c-b42b-8611b7d59a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:12 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3c4b0d4a-519e-4172-afbe-3ec3c94380f1 tempest-VolumesActionsTest-1547316290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57b5ce95-78cc-4c8a-8cec-005455f77223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:12 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-3c4b0d4a-519e-4172-afbe-3ec3c94380f1 tempest-VolumesActionsTest-1547316290 None] Volume e73a0a7e-4d6d-4484-8dd1-fa402e327829: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e73a0a7e-4d6d-4484-8dd1-fa402e327829', 'volume_size': 1}
Jul 03 01:13:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-3c4b0d4a-519e-4172-afbe-3ec3c94380f1 tempest-VolumesActionsTest-1547316290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:13:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-3c4b0d4a-519e-4172-afbe-3ec3c94380f1 tempest-VolumesActionsTest-1547316290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:13:12 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-3c4b0d4a-519e-4172-afbe-3ec3c94380f1 tempest-VolumesActionsTest-1547316290 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:13:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-749681494',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e73a0a7e-4d6d-4484-8dd1-fa402e327829,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d7c647a6e6746b1a1936d53da5b3c17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:13:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:13:12Z,use_quota=True,user_id='7892e5242ca34398b2945766f2cd4ae7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:13:12 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-3c4b0d4a-519e-4172-afbe-3ec3c94380f1 tempest-VolumesActionsTest-1547316290 None] Creating volume e73a0a7e-4d6d-4484-8dd1-fa402e327829 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:13:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-3c4b0d4a-519e-4172-afbe-3ec3c94380f1 tempest-VolumesActionsTest-1547316290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:13:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-3c4b0d4a-519e-4172-afbe-3ec3c94380f1 tempest-VolumesActionsTest-1547316290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:13:12 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-3c4b0d4a-519e-4172-afbe-3ec3c94380f1 tempest-VolumesActionsTest-1547316290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:13:12 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-3c4b0d4a-519e-4172-afbe-3ec3c94380f1 tempest-VolumesActionsTest-1547316290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:13:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-3c4b0d4a-519e-4172-afbe-3ec3c94380f1 tempest-VolumesActionsTest-1547316290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:13:12 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-3c4b0d4a-519e-4172-afbe-3ec3c94380f1 tempest-VolumesActionsTest-1547316290 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:13:12 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-3c4b0d4a-519e-4172-afbe-3ec3c94380f1 tempest-VolumesActionsTest-1547316290 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:13:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-3c4b0d4a-519e-4172-afbe-3ec3c94380f1 tempest-VolumesActionsTest-1547316290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e73a0a7e-4d6d-4484-8dd1-fa402e327829 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:12 devstack sudo[97641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e73a0a7e-4d6d-4484-8dd1-fa402e327829 1073741824
Jul 03 01:13:12 devstack sudo[97641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:13 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-32a90590-ed08-4361-a969-e2e6e78089a1 tempest-VolumeQuotasAdminTestJSON-343806598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:13:13 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-32a90590-ed08-4361-a969-e2e6e78089a1 tempest-VolumeQuotasAdminTestJSON-343806598 None] Flow 'volume_create_manager' (89cdd1d9-dca7-4bdb-a0a9-b1745ba1f153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:13:13 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-32a90590-ed08-4361-a969-e2e6e78089a1 tempest-VolumeQuotasAdminTestJSON-343806598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac9ff3a6-58b2-420a-a20e-aace4ba811d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:13 devstack sudo[97641]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:13 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-d91db47a-0bfd-46a2-a06e-787e04b5f6ad tempest-SnapshotsActionsTest-1724460990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:13:13 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-d91db47a-0bfd-46a2-a06e-787e04b5f6ad tempest-SnapshotsActionsTest-1724460990 None] Flow 'volume_create_manager' (381182b7-2136-4093-a810-bf34e38f86ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:13:13 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-d91db47a-0bfd-46a2-a06e-787e04b5f6ad tempest-SnapshotsActionsTest-1724460990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eb427bb-439b-4e3f-8732-c859254ccb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-3c4b0d4a-519e-4172-afbe-3ec3c94380f1 tempest-VolumesActionsTest-1547316290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e73a0a7e-4d6d-4484-8dd1-fa402e327829 1073741824" returned: 0 in 1.056s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:13 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-32a90590-ed08-4361-a969-e2e6e78089a1 tempest-VolumeQuotasAdminTestJSON-343806598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac9ff3a6-58b2-420a-a20e-aace4ba811d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:13:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-391109383',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cd36eba-ba1d-4603-b1de-4ec47489c6e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='925702021d4c44ae813d8db8615631c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:13:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:13:13Z,use_quota=True,user_id='05700ddfb6b94ed3957535dad3eb05b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:13 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-32a90590-ed08-4361-a969-e2e6e78089a1 tempest-VolumeQuotasAdminTestJSON-343806598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa15cadc-a341-465e-a043-7ed47ec31e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:13 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-32a90590-ed08-4361-a969-e2e6e78089a1 tempest-VolumeQuotasAdminTestJSON-343806598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa15cadc-a341-465e-a043-7ed47ec31e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:13 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-32a90590-ed08-4361-a969-e2e6e78089a1 tempest-VolumeQuotasAdminTestJSON-343806598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8157782-e0d2-4e84-af65-9d50d7f89332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:13 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-32a90590-ed08-4361-a969-e2e6e78089a1 tempest-VolumeQuotasAdminTestJSON-343806598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8157782-e0d2-4e84-af65-9d50d7f89332) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cd36eba-ba1d-4603-b1de-4ec47489c6e9', 'volume_name': 'volume-2cd36eba-ba1d-4603-b1de-4ec47489c6e9', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:13 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-32a90590-ed08-4361-a969-e2e6e78089a1 tempest-VolumeQuotasAdminTestJSON-343806598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e42d75af-ac64-4a75-acbb-21e01c0460c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:13 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-32a90590-ed08-4361-a969-e2e6e78089a1 tempest-VolumeQuotasAdminTestJSON-343806598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e42d75af-ac64-4a75-acbb-21e01c0460c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:13 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-32a90590-ed08-4361-a969-e2e6e78089a1 tempest-VolumeQuotasAdminTestJSON-343806598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (358e937d-359b-4770-9114-e47098dfe79b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:13 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-32a90590-ed08-4361-a969-e2e6e78089a1 tempest-VolumeQuotasAdminTestJSON-343806598 None] Volume 2cd36eba-ba1d-4603-b1de-4ec47489c6e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cd36eba-ba1d-4603-b1de-4ec47489c6e9', 'volume_size': 1}
Jul 03 01:13:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-32a90590-ed08-4361-a969-e2e6e78089a1 tempest-VolumeQuotasAdminTestJSON-343806598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:13:13 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-d91db47a-0bfd-46a2-a06e-787e04b5f6ad tempest-SnapshotsActionsTest-1724460990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eb427bb-439b-4e3f-8732-c859254ccb0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:13:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-362045884',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d1b77c3-b58d-4c30-8075-2e237b09fdf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfd1d65d9fb441bcb4df9066039219ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:13:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:13:13Z,use_quota=True,user_id='382c359d13414e8fa47a6d8a9f2249b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:13 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-d91db47a-0bfd-46a2-a06e-787e04b5f6ad tempest-SnapshotsActionsTest-1724460990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaafb5f1-bfa1-4408-bac4-755f760e7362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:13 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-d91db47a-0bfd-46a2-a06e-787e04b5f6ad tempest-SnapshotsActionsTest-1724460990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaafb5f1-bfa1-4408-bac4-755f760e7362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:13 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-d91db47a-0bfd-46a2-a06e-787e04b5f6ad tempest-SnapshotsActionsTest-1724460990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9746f24-9ae1-4dba-be1b-ef226141ca6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:13 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-d91db47a-0bfd-46a2-a06e-787e04b5f6ad tempest-SnapshotsActionsTest-1724460990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9746f24-9ae1-4dba-be1b-ef226141ca6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d1b77c3-b58d-4c30-8075-2e237b09fdf4', 'volume_name': 'volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:13 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-d91db47a-0bfd-46a2-a06e-787e04b5f6ad tempest-SnapshotsActionsTest-1724460990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e63cd38d-5f8b-4900-8a98-33856ba09fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:13 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-d91db47a-0bfd-46a2-a06e-787e04b5f6ad tempest-SnapshotsActionsTest-1724460990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e63cd38d-5f8b-4900-8a98-33856ba09fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:13 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-d91db47a-0bfd-46a2-a06e-787e04b5f6ad tempest-SnapshotsActionsTest-1724460990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6eecdfd-d6b4-4e91-85ac-60dcb122e5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:13 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-d91db47a-0bfd-46a2-a06e-787e04b5f6ad tempest-SnapshotsActionsTest-1724460990 None] Volume 7d1b77c3-b58d-4c30-8075-2e237b09fdf4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4', 'volume_size': 1}
Jul 03 01:13:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-d91db47a-0bfd-46a2-a06e-787e04b5f6ad tempest-SnapshotsActionsTest-1724460990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:13:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-3c4b0d4a-519e-4172-afbe-3ec3c94380f1 tempest-VolumesActionsTest-1547316290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e73a0a7e-4d6d-4484-8dd1-fa402e327829 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:13 devstack sudo[97647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e73a0a7e-4d6d-4484-8dd1-fa402e327829
Jul 03 01:13:13 devstack sudo[97647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:14 devstack sudo[97647]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-3c4b0d4a-519e-4172-afbe-3ec3c94380f1 tempest-VolumesActionsTest-1547316290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e73a0a7e-4d6d-4484-8dd1-fa402e327829" returned: 0 in 0.733s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:14 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-3c4b0d4a-519e-4172-afbe-3ec3c94380f1 tempest-VolumesActionsTest-1547316290 None] <== create_volume: return (1922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:13:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-3c4b0d4a-519e-4172-afbe-3ec3c94380f1 tempest-VolumesActionsTest-1547316290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.927s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:13:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-32a90590-ed08-4361-a969-e2e6e78089a1 tempest-VolumeQuotasAdminTestJSON-343806598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.817s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:13:14 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-32a90590-ed08-4361-a969-e2e6e78089a1 tempest-VolumeQuotasAdminTestJSON-343806598 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:13:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-391109383',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cd36eba-ba1d-4603-b1de-4ec47489c6e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='925702021d4c44ae813d8db8615631c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:13:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:13:13Z,use_quota=True,user_id='05700ddfb6b94ed3957535dad3eb05b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:13:14 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-32a90590-ed08-4361-a969-e2e6e78089a1 tempest-VolumeQuotasAdminTestJSON-343806598 None] Creating volume 2cd36eba-ba1d-4603-b1de-4ec47489c6e9 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:13:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-32a90590-ed08-4361-a969-e2e6e78089a1 tempest-VolumeQuotasAdminTestJSON-343806598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:13:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-32a90590-ed08-4361-a969-e2e6e78089a1 tempest-VolumeQuotasAdminTestJSON-343806598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:13:14 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-32a90590-ed08-4361-a969-e2e6e78089a1 tempest-VolumeQuotasAdminTestJSON-343806598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:13:14 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-32a90590-ed08-4361-a969-e2e6e78089a1 tempest-VolumeQuotasAdminTestJSON-343806598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:13:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-32a90590-ed08-4361-a969-e2e6e78089a1 tempest-VolumeQuotasAdminTestJSON-343806598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:13:14 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-32a90590-ed08-4361-a969-e2e6e78089a1 tempest-VolumeQuotasAdminTestJSON-343806598 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:13:14 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-32a90590-ed08-4361-a969-e2e6e78089a1 tempest-VolumeQuotasAdminTestJSON-343806598 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:13:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-32a90590-ed08-4361-a969-e2e6e78089a1 tempest-VolumeQuotasAdminTestJSON-343806598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2cd36eba-ba1d-4603-b1de-4ec47489c6e9 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:14 devstack sudo[97650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2cd36eba-ba1d-4603-b1de-4ec47489c6e9 1073741824
Jul 03 01:13:14 devstack sudo[97650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:14 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3c4b0d4a-519e-4172-afbe-3ec3c94380f1 tempest-VolumesActionsTest-1547316290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57b5ce95-78cc-4c8a-8cec-005455f77223) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e73a0a7e-4d6d-4484-8dd1-fa402e327829', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:14 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3c4b0d4a-519e-4172-afbe-3ec3c94380f1 tempest-VolumesActionsTest-1547316290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b547d181-b1f6-407b-9371-cfda553e0770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:14 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-3c4b0d4a-519e-4172-afbe-3ec3c94380f1 tempest-VolumesActionsTest-1547316290 None] Volume volume-e73a0a7e-4d6d-4484-8dd1-fa402e327829 (e73a0a7e-4d6d-4484-8dd1-fa402e327829): created successfully
Jul 03 01:13:14 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3c4b0d4a-519e-4172-afbe-3ec3c94380f1 tempest-VolumesActionsTest-1547316290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b547d181-b1f6-407b-9371-cfda553e0770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:14 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3c4b0d4a-519e-4172-afbe-3ec3c94380f1 tempest-VolumesActionsTest-1547316290 None] Flow 'volume_create_manager' (b45dfbd5-fdaf-4f8b-8f2c-c008e821c703) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:13:14 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-3c4b0d4a-519e-4172-afbe-3ec3c94380f1 tempest-VolumesActionsTest-1547316290 None] Created volume successfully.
Jul 03 01:13:15 devstack sudo[97650]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-32a90590-ed08-4361-a969-e2e6e78089a1 tempest-VolumeQuotasAdminTestJSON-343806598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2cd36eba-ba1d-4603-b1de-4ec47489c6e9 1073741824" returned: 0 in 0.930s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-32a90590-ed08-4361-a969-e2e6e78089a1 tempest-VolumeQuotasAdminTestJSON-343806598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2cd36eba-ba1d-4603-b1de-4ec47489c6e9 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:15 devstack sudo[97656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2cd36eba-ba1d-4603-b1de-4ec47489c6e9
Jul 03 01:13:15 devstack sudo[97656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:15 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-1ff5579f-f69c-4fdb-8cd7-f9532f469572 tempest-VolumesActionsTest-1293153765 None] Acquiring lock "cinder-e73a0a7e-4d6d-4484-8dd1-fa402e327829-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:13:15 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-1ff5579f-f69c-4fdb-8cd7-f9532f469572 tempest-VolumesActionsTest-1293153765 None] Lock "cinder-e73a0a7e-4d6d-4484-8dd1-fa402e327829-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:13:15 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-1ff5579f-f69c-4fdb-8cd7-f9532f469572 tempest-VolumesActionsTest-1293153765 None] Acquiring lock "cinder-quobyte-e73a0a7e-4d6d-4484-8dd1-fa402e327829" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:13:15 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-1ff5579f-f69c-4fdb-8cd7-f9532f469572 tempest-VolumesActionsTest-1293153765 None] Lock "cinder-quobyte-e73a0a7e-4d6d-4484-8dd1-fa402e327829" acquired by "delete_volume" :: waited 0.022s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:13:15 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a69fff-43dd-470f-808c-9300d35a5f54]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:13:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1ff5579f-f69c-4fdb-8cd7-f9532f469572 tempest-VolumesActionsTest-1293153765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e73a0a7e-4d6d-4484-8dd1-fa402e327829 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:15 devstack sudo[97658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e73a0a7e-4d6d-4484-8dd1-fa402e327829
Jul 03 01:13:15 devstack sudo[97658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:15 devstack sudo[97656]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-32a90590-ed08-4361-a969-e2e6e78089a1 tempest-VolumeQuotasAdminTestJSON-343806598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2cd36eba-ba1d-4603-b1de-4ec47489c6e9" returned: 0 in 0.739s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:15 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-32a90590-ed08-4361-a969-e2e6e78089a1 tempest-VolumeQuotasAdminTestJSON-343806598 None] <== create_volume: return (1709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:13:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-32a90590-ed08-4361-a969-e2e6e78089a1 tempest-VolumeQuotasAdminTestJSON-343806598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.712s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:13:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-d91db47a-0bfd-46a2-a06e-787e04b5f6ad tempest-SnapshotsActionsTest-1724460990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.482s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:13:15 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-d91db47a-0bfd-46a2-a06e-787e04b5f6ad tempest-SnapshotsActionsTest-1724460990 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:13:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-362045884',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d1b77c3-b58d-4c30-8075-2e237b09fdf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfd1d65d9fb441bcb4df9066039219ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:13:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:13:13Z,use_quota=True,user_id='382c359d13414e8fa47a6d8a9f2249b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:13:15 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-d91db47a-0bfd-46a2-a06e-787e04b5f6ad tempest-SnapshotsActionsTest-1724460990 None] Creating volume 7d1b77c3-b58d-4c30-8075-2e237b09fdf4 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:13:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-d91db47a-0bfd-46a2-a06e-787e04b5f6ad tempest-SnapshotsActionsTest-1724460990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:13:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-d91db47a-0bfd-46a2-a06e-787e04b5f6ad tempest-SnapshotsActionsTest-1724460990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:13:15 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-d91db47a-0bfd-46a2-a06e-787e04b5f6ad tempest-SnapshotsActionsTest-1724460990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:13:15 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-d91db47a-0bfd-46a2-a06e-787e04b5f6ad tempest-SnapshotsActionsTest-1724460990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:13:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-d91db47a-0bfd-46a2-a06e-787e04b5f6ad tempest-SnapshotsActionsTest-1724460990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:13:15 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-d91db47a-0bfd-46a2-a06e-787e04b5f6ad tempest-SnapshotsActionsTest-1724460990 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:13:15 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-d91db47a-0bfd-46a2-a06e-787e04b5f6ad tempest-SnapshotsActionsTest-1724460990 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:13:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d91db47a-0bfd-46a2-a06e-787e04b5f6ad tempest-SnapshotsActionsTest-1724460990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:15 devstack sudo[97661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4 1073741824
Jul 03 01:13:15 devstack sudo[97661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:15 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-32a90590-ed08-4361-a969-e2e6e78089a1 tempest-VolumeQuotasAdminTestJSON-343806598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (358e937d-359b-4770-9114-e47098dfe79b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cd36eba-ba1d-4603-b1de-4ec47489c6e9', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:15 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-32a90590-ed08-4361-a969-e2e6e78089a1 tempest-VolumeQuotasAdminTestJSON-343806598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76cb7e0d-f943-4902-9e46-470cb0a1ca6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:15 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-32a90590-ed08-4361-a969-e2e6e78089a1 tempest-VolumeQuotasAdminTestJSON-343806598 None] Volume volume-2cd36eba-ba1d-4603-b1de-4ec47489c6e9 (2cd36eba-ba1d-4603-b1de-4ec47489c6e9): created successfully
Jul 03 01:13:15 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-32a90590-ed08-4361-a969-e2e6e78089a1 tempest-VolumeQuotasAdminTestJSON-343806598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76cb7e0d-f943-4902-9e46-470cb0a1ca6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:15 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-32a90590-ed08-4361-a969-e2e6e78089a1 tempest-VolumeQuotasAdminTestJSON-343806598 None] Flow 'volume_create_manager' (89cdd1d9-dca7-4bdb-a0a9-b1745ba1f153) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:13:16 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-32a90590-ed08-4361-a969-e2e6e78089a1 tempest-VolumeQuotasAdminTestJSON-343806598 None] Created volume successfully.
Jul 03 01:13:16 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-dbe786cc-1517-406c-9923-23a1643c3dc2 tempest-VolumeQuotasAdminTestJSON-343806598 None] Acquiring lock "cinder-2cd36eba-ba1d-4603-b1de-4ec47489c6e9-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:13:16 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-dbe786cc-1517-406c-9923-23a1643c3dc2 tempest-VolumeQuotasAdminTestJSON-343806598 None] Lock "cinder-2cd36eba-ba1d-4603-b1de-4ec47489c6e9-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:13:16 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-dbe786cc-1517-406c-9923-23a1643c3dc2 tempest-VolumeQuotasAdminTestJSON-343806598 None] Acquiring lock "cinder-quobyte-2cd36eba-ba1d-4603-b1de-4ec47489c6e9" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:13:16 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-dbe786cc-1517-406c-9923-23a1643c3dc2 tempest-VolumeQuotasAdminTestJSON-343806598 None] Lock "cinder-quobyte-2cd36eba-ba1d-4603-b1de-4ec47489c6e9" acquired by "delete_volume" :: waited 0.025s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:13:16 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d23fd5a-302a-4adb-92c6-25d0f27937f1]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:13:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-dbe786cc-1517-406c-9923-23a1643c3dc2 tempest-VolumeQuotasAdminTestJSON-343806598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2cd36eba-ba1d-4603-b1de-4ec47489c6e9 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:16 devstack sudo[97666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2cd36eba-ba1d-4603-b1de-4ec47489c6e9
Jul 03 01:13:16 devstack sudo[97666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:16 devstack sudo[97658]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1ff5579f-f69c-4fdb-8cd7-f9532f469572 tempest-VolumesActionsTest-1293153765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e73a0a7e-4d6d-4484-8dd1-fa402e327829" returned: 0 in 0.915s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1ff5579f-f69c-4fdb-8cd7-f9532f469572 tempest-VolumesActionsTest-1293153765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e73a0a7e-4d6d-4484-8dd1-fa402e327829 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:16 devstack sudo[97669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e73a0a7e-4d6d-4484-8dd1-fa402e327829
Jul 03 01:13:16 devstack sudo[97669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:16 devstack sudo[97661]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d91db47a-0bfd-46a2-a06e-787e04b5f6ad tempest-SnapshotsActionsTest-1724460990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4 1073741824" returned: 0 in 1.045s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d91db47a-0bfd-46a2-a06e-787e04b5f6ad tempest-SnapshotsActionsTest-1724460990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:17 devstack sudo[97675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4
Jul 03 01:13:17 devstack sudo[97675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:17 devstack sudo[97666]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-dbe786cc-1517-406c-9923-23a1643c3dc2 tempest-VolumeQuotasAdminTestJSON-343806598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2cd36eba-ba1d-4603-b1de-4ec47489c6e9" returned: 0 in 0.897s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-dbe786cc-1517-406c-9923-23a1643c3dc2 tempest-VolumeQuotasAdminTestJSON-343806598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2cd36eba-ba1d-4603-b1de-4ec47489c6e9 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:17 devstack sudo[97682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2cd36eba-ba1d-4603-b1de-4ec47489c6e9
Jul 03 01:13:17 devstack sudo[97682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:17 devstack sudo[97669]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1ff5579f-f69c-4fdb-8cd7-f9532f469572 tempest-VolumesActionsTest-1293153765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e73a0a7e-4d6d-4484-8dd1-fa402e327829" returned: 0 in 0.835s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:17 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-1ff5579f-f69c-4fdb-8cd7-f9532f469572 tempest-VolumesActionsTest-1293153765 None] Lock "cinder-quobyte-e73a0a7e-4d6d-4484-8dd1-fa402e327829" released by "delete_volume" :: held 1.811s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:13:17 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-1ff5579f-f69c-4fdb-8cd7-f9532f469572 tempest-VolumesActionsTest-1293153765 None] Created reservations ['8692dd6b-769e-40cc-8cc5-ff845b1404fb', '1dccf3de-309a-41e3-b70e-8c93e80b72a8', 'f2204858-7aab-40fc-8944-020fda883884', '41f7a151-6333-4480-9e81-05af6bd58873'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:13:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1ff5579f-f69c-4fdb-8cd7-f9532f469572 tempest-VolumesActionsTest-1293153765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:13:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1ff5579f-f69c-4fdb-8cd7-f9532f469572 tempest-VolumesActionsTest-1293153765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:13:17 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-1ff5579f-f69c-4fdb-8cd7-f9532f469572 tempest-VolumesActionsTest-1293153765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:13:17 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-1ff5579f-f69c-4fdb-8cd7-f9532f469572 tempest-VolumesActionsTest-1293153765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:13:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1ff5579f-f69c-4fdb-8cd7-f9532f469572 tempest-VolumesActionsTest-1293153765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:13:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1ff5579f-f69c-4fdb-8cd7-f9532f469572 tempest-VolumesActionsTest-1293153765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:17 devstack sudo[97685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:13:17 devstack sudo[97685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:17 devstack sudo[97675]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d91db47a-0bfd-46a2-a06e-787e04b5f6ad tempest-SnapshotsActionsTest-1724460990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4" returned: 0 in 0.886s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:17 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-d91db47a-0bfd-46a2-a06e-787e04b5f6ad tempest-SnapshotsActionsTest-1724460990 None] <== create_volume: return (1975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:13:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-d91db47a-0bfd-46a2-a06e-787e04b5f6ad tempest-SnapshotsActionsTest-1724460990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.978s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:13:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-d91db47a-0bfd-46a2-a06e-787e04b5f6ad tempest-SnapshotsActionsTest-1724460990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6eecdfd-d6b4-4e91-85ac-60dcb122e5ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-d91db47a-0bfd-46a2-a06e-787e04b5f6ad tempest-SnapshotsActionsTest-1724460990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0552f03e-fb53-4a23-817b-0cbcb2b70cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:17 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-d91db47a-0bfd-46a2-a06e-787e04b5f6ad tempest-SnapshotsActionsTest-1724460990 None] Volume volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4 (7d1b77c3-b58d-4c30-8075-2e237b09fdf4): created successfully
Jul 03 01:13:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-d91db47a-0bfd-46a2-a06e-787e04b5f6ad tempest-SnapshotsActionsTest-1724460990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0552f03e-fb53-4a23-817b-0cbcb2b70cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-d91db47a-0bfd-46a2-a06e-787e04b5f6ad tempest-SnapshotsActionsTest-1724460990 None] Flow 'volume_create_manager' (381182b7-2136-4093-a810-bf34e38f86ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:13:18 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-d91db47a-0bfd-46a2-a06e-787e04b5f6ad tempest-SnapshotsActionsTest-1724460990 None] Created volume successfully.
Jul 03 01:13:18 devstack sudo[97682]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-dbe786cc-1517-406c-9923-23a1643c3dc2 tempest-VolumeQuotasAdminTestJSON-343806598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2cd36eba-ba1d-4603-b1de-4ec47489c6e9" returned: 0 in 1.120s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:18 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-dbe786cc-1517-406c-9923-23a1643c3dc2 tempest-VolumeQuotasAdminTestJSON-343806598 None] Lock "cinder-quobyte-2cd36eba-ba1d-4603-b1de-4ec47489c6e9" released by "delete_volume" :: held 2.074s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:13:18 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-dbe786cc-1517-406c-9923-23a1643c3dc2 tempest-VolumeQuotasAdminTestJSON-343806598 None] Created reservations ['afd0fb69-1b80-466d-8e01-abb72ad14001', '2f2e8b8c-b3e4-4208-a6d2-d0cd35cd7133', '016527f4-500c-4266-a9f3-081761a81a7b', 'b97d4024-1513-44cd-81ec-2e99b0b91092'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:13:18 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-25f60a18-e4c9-43f5-8abd-9e4cdd0305ab tempest-VolumesActionsTest-1547316290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:13:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-25f60a18-e4c9-43f5-8abd-9e4cdd0305ab tempest-VolumesActionsTest-1547316290 None] Flow 'volume_create_manager' (1bc52aad-a381-469a-bb60-33cf9055fabb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:13:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-25f60a18-e4c9-43f5-8abd-9e4cdd0305ab tempest-VolumesActionsTest-1547316290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c512f6a8-129d-4889-878e-41f67ff1ab6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-25f60a18-e4c9-43f5-8abd-9e4cdd0305ab tempest-VolumesActionsTest-1547316290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c512f6a8-129d-4889-878e-41f67ff1ab6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:13:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-245001736',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80a5224f-1a26-498c-b28a-7fa98b84f53f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d7c647a6e6746b1a1936d53da5b3c17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:13:19Z,use_quota=True,user_id='7892e5242ca34398b2945766f2cd4ae7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-25f60a18-e4c9-43f5-8abd-9e4cdd0305ab tempest-VolumesActionsTest-1547316290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af6c67cd-a0ec-4f3a-937c-674b7e621826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-25f60a18-e4c9-43f5-8abd-9e4cdd0305ab tempest-VolumesActionsTest-1547316290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af6c67cd-a0ec-4f3a-937c-674b7e621826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-25f60a18-e4c9-43f5-8abd-9e4cdd0305ab tempest-VolumesActionsTest-1547316290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a8a6cf3-dbba-4567-913e-7d4f0cd15c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-25f60a18-e4c9-43f5-8abd-9e4cdd0305ab tempest-VolumesActionsTest-1547316290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a8a6cf3-dbba-4567-913e-7d4f0cd15c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80a5224f-1a26-498c-b28a-7fa98b84f53f', 'volume_name': 'volume-80a5224f-1a26-498c-b28a-7fa98b84f53f', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-25f60a18-e4c9-43f5-8abd-9e4cdd0305ab tempest-VolumesActionsTest-1547316290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3fb4d20-2220-492a-aad8-1d1a8bbed233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-25f60a18-e4c9-43f5-8abd-9e4cdd0305ab tempest-VolumesActionsTest-1547316290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3fb4d20-2220-492a-aad8-1d1a8bbed233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-25f60a18-e4c9-43f5-8abd-9e4cdd0305ab tempest-VolumesActionsTest-1547316290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b44b490-24bc-4e8e-8769-368079f6f24d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:18 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-25f60a18-e4c9-43f5-8abd-9e4cdd0305ab tempest-VolumesActionsTest-1547316290 None] Volume 80a5224f-1a26-498c-b28a-7fa98b84f53f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80a5224f-1a26-498c-b28a-7fa98b84f53f', 'volume_size': 1}
Jul 03 01:13:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-25f60a18-e4c9-43f5-8abd-9e4cdd0305ab tempest-VolumesActionsTest-1547316290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:13:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-25f60a18-e4c9-43f5-8abd-9e4cdd0305ab tempest-VolumesActionsTest-1547316290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:13:18 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-25f60a18-e4c9-43f5-8abd-9e4cdd0305ab tempest-VolumesActionsTest-1547316290 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:13:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-245001736',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80a5224f-1a26-498c-b28a-7fa98b84f53f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d7c647a6e6746b1a1936d53da5b3c17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:13:19Z,use_quota=True,user_id='7892e5242ca34398b2945766f2cd4ae7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:13:18 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-25f60a18-e4c9-43f5-8abd-9e4cdd0305ab tempest-VolumesActionsTest-1547316290 None] Creating volume 80a5224f-1a26-498c-b28a-7fa98b84f53f {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:13:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-25f60a18-e4c9-43f5-8abd-9e4cdd0305ab tempest-VolumesActionsTest-1547316290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:13:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-25f60a18-e4c9-43f5-8abd-9e4cdd0305ab tempest-VolumesActionsTest-1547316290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:13:18 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-25f60a18-e4c9-43f5-8abd-9e4cdd0305ab tempest-VolumesActionsTest-1547316290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:13:18 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-25f60a18-e4c9-43f5-8abd-9e4cdd0305ab tempest-VolumesActionsTest-1547316290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:13:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-25f60a18-e4c9-43f5-8abd-9e4cdd0305ab tempest-VolumesActionsTest-1547316290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:13:18 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-25f60a18-e4c9-43f5-8abd-9e4cdd0305ab tempest-VolumesActionsTest-1547316290 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:13:18 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-25f60a18-e4c9-43f5-8abd-9e4cdd0305ab tempest-VolumesActionsTest-1547316290 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:13:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-25f60a18-e4c9-43f5-8abd-9e4cdd0305ab tempest-VolumesActionsTest-1547316290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-80a5224f-1a26-498c-b28a-7fa98b84f53f 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:18 devstack sudo[97685]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1ff5579f-f69c-4fdb-8cd7-f9532f469572 tempest-VolumesActionsTest-1293153765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 1.161s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:18 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-1ff5579f-f69c-4fdb-8cd7-f9532f469572 tempest-VolumesActionsTest-1293153765 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:13:18 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-1ff5579f-f69c-4fdb-8cd7-f9532f469572 tempest-VolumesActionsTest-1293153765 None] Deleted volume successfully.
Jul 03 01:13:18 devstack sudo[97692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-80a5224f-1a26-498c-b28a-7fa98b84f53f 1073741824
Jul 03 01:13:18 devstack sudo[97692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-dbe786cc-1517-406c-9923-23a1643c3dc2 tempest-VolumeQuotasAdminTestJSON-343806598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:13:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-dbe786cc-1517-406c-9923-23a1643c3dc2 tempest-VolumeQuotasAdminTestJSON-343806598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:13:18 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-dbe786cc-1517-406c-9923-23a1643c3dc2 tempest-VolumeQuotasAdminTestJSON-343806598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:13:18 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-dbe786cc-1517-406c-9923-23a1643c3dc2 tempest-VolumeQuotasAdminTestJSON-343806598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:13:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-dbe786cc-1517-406c-9923-23a1643c3dc2 tempest-VolumeQuotasAdminTestJSON-343806598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:13:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-dbe786cc-1517-406c-9923-23a1643c3dc2 tempest-VolumeQuotasAdminTestJSON-343806598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:18 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-1ff5579f-f69c-4fdb-8cd7-f9532f469572 tempest-VolumesActionsTest-1293153765 None] Lock "cinder-e73a0a7e-4d6d-4484-8dd1-fa402e327829-delete_volume" released by "delete_volume" :: held 3.349s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:13:18 devstack sudo[97694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:13:18 devstack sudo[97694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b4f2575c-a64b-4f04-bd47-fe794824a44e tempest-SnapshotsActionsTest-1724460990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:13:19 devstack sudo[97694]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:19 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-dbe786cc-1517-406c-9923-23a1643c3dc2 tempest-VolumeQuotasAdminTestJSON-343806598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.779s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:19 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-dbe786cc-1517-406c-9923-23a1643c3dc2 tempest-VolumeQuotasAdminTestJSON-343806598 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:13:19 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-dbe786cc-1517-406c-9923-23a1643c3dc2 tempest-VolumeQuotasAdminTestJSON-343806598 None] Deleted volume successfully.
Jul 03 01:13:19 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-dbe786cc-1517-406c-9923-23a1643c3dc2 tempest-VolumeQuotasAdminTestJSON-343806598 None] Lock "cinder-2cd36eba-ba1d-4603-b1de-4ec47489c6e9-delete_volume" released by "delete_volume" :: held 3.335s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:13:19 devstack sudo[97692]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:19 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-25f60a18-e4c9-43f5-8abd-9e4cdd0305ab tempest-VolumesActionsTest-1547316290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-80a5224f-1a26-498c-b28a-7fa98b84f53f 1073741824" returned: 0 in 1.097s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:19 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-25f60a18-e4c9-43f5-8abd-9e4cdd0305ab tempest-VolumesActionsTest-1547316290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-80a5224f-1a26-498c-b28a-7fa98b84f53f {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:19 devstack sudo[97703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-80a5224f-1a26-498c-b28a-7fa98b84f53f
Jul 03 01:13:19 devstack sudo[97703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:20 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d3ccdf1-307d-42b1-9724-aaf9bdd94bf1 tempest-VolumeQuotasAdminTestJSON-343806598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:13:20 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-4d3ccdf1-307d-42b1-9724-aaf9bdd94bf1 tempest-VolumeQuotasAdminTestJSON-343806598 None] Flow 'volume_create_manager' (df19edc1-8413-406a-84fd-406f4642395f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:13:20 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-4d3ccdf1-307d-42b1-9724-aaf9bdd94bf1 tempest-VolumeQuotasAdminTestJSON-343806598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc889934-9e11-4c14-bb54-ce381f5e5556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:20 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-4d3ccdf1-307d-42b1-9724-aaf9bdd94bf1 tempest-VolumeQuotasAdminTestJSON-343806598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc889934-9e11-4c14-bb54-ce381f5e5556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:13:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2067628985',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c471374-2461-423f-af61-9695861dedfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='925702021d4c44ae813d8db8615631c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:13:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:13:20Z,use_quota=True,user_id='05700ddfb6b94ed3957535dad3eb05b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:20 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-4d3ccdf1-307d-42b1-9724-aaf9bdd94bf1 tempest-VolumeQuotasAdminTestJSON-343806598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cfe91d0-4052-436e-b1cb-f766a638019e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:20 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-4d3ccdf1-307d-42b1-9724-aaf9bdd94bf1 tempest-VolumeQuotasAdminTestJSON-343806598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cfe91d0-4052-436e-b1cb-f766a638019e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:20 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-4d3ccdf1-307d-42b1-9724-aaf9bdd94bf1 tempest-VolumeQuotasAdminTestJSON-343806598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c61a7327-988c-4199-8afa-5b1039d69e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:20 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-4d3ccdf1-307d-42b1-9724-aaf9bdd94bf1 tempest-VolumeQuotasAdminTestJSON-343806598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c61a7327-988c-4199-8afa-5b1039d69e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c471374-2461-423f-af61-9695861dedfc', 'volume_name': 'volume-5c471374-2461-423f-af61-9695861dedfc', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:20 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-4d3ccdf1-307d-42b1-9724-aaf9bdd94bf1 tempest-VolumeQuotasAdminTestJSON-343806598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ab3f233-9356-43c4-9a18-3a83dbb677c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:20 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-4d3ccdf1-307d-42b1-9724-aaf9bdd94bf1 tempest-VolumeQuotasAdminTestJSON-343806598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ab3f233-9356-43c4-9a18-3a83dbb677c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:20 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-4d3ccdf1-307d-42b1-9724-aaf9bdd94bf1 tempest-VolumeQuotasAdminTestJSON-343806598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (169f06ad-d120-46f2-9611-4648e19fa128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:20 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-4d3ccdf1-307d-42b1-9724-aaf9bdd94bf1 tempest-VolumeQuotasAdminTestJSON-343806598 None] Volume 5c471374-2461-423f-af61-9695861dedfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c471374-2461-423f-af61-9695861dedfc', 'volume_size': 1}
Jul 03 01:13:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-4d3ccdf1-307d-42b1-9724-aaf9bdd94bf1 tempest-VolumeQuotasAdminTestJSON-343806598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:13:20 devstack sudo[97703]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-25f60a18-e4c9-43f5-8abd-9e4cdd0305ab tempest-VolumesActionsTest-1547316290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-80a5224f-1a26-498c-b28a-7fa98b84f53f" returned: 0 in 0.754s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:20 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-25f60a18-e4c9-43f5-8abd-9e4cdd0305ab tempest-VolumesActionsTest-1547316290 None] <== create_volume: return (1903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:13:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-25f60a18-e4c9-43f5-8abd-9e4cdd0305ab tempest-VolumesActionsTest-1547316290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.905s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:13:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b4f2575c-a64b-4f04-bd47-fe794824a44e tempest-SnapshotsActionsTest-1724460990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.689s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:13:20 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-b4f2575c-a64b-4f04-bd47-fe794824a44e tempest-SnapshotsActionsTest-1724460990 None] Creating offline snapshot cb61df4c-825f-42e7-9372-b6ece8df5cee of volume 7d1b77c3-b58d-4c30-8075-2e237b09fdf4 {{(pid=86891) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 01:13:20 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-25f60a18-e4c9-43f5-8abd-9e4cdd0305ab tempest-VolumesActionsTest-1547316290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b44b490-24bc-4e8e-8769-368079f6f24d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80a5224f-1a26-498c-b28a-7fa98b84f53f', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:20 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-25f60a18-e4c9-43f5-8abd-9e4cdd0305ab tempest-VolumesActionsTest-1547316290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (507d3a82-f1b9-4b06-8b1f-52805a1fe12f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:20 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21e24d8-d892-41be-a1b3-e5cc1f8a6079]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:13:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b4f2575c-a64b-4f04-bd47-fe794824a44e tempest-SnapshotsActionsTest-1724460990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:20 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-25f60a18-e4c9-43f5-8abd-9e4cdd0305ab tempest-VolumesActionsTest-1547316290 None] Volume volume-80a5224f-1a26-498c-b28a-7fa98b84f53f (80a5224f-1a26-498c-b28a-7fa98b84f53f): created successfully
Jul 03 01:13:20 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-25f60a18-e4c9-43f5-8abd-9e4cdd0305ab tempest-VolumesActionsTest-1547316290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (507d3a82-f1b9-4b06-8b1f-52805a1fe12f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:20 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-25f60a18-e4c9-43f5-8abd-9e4cdd0305ab tempest-VolumesActionsTest-1547316290 None] Flow 'volume_create_manager' (1bc52aad-a381-469a-bb60-33cf9055fabb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:13:20 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-25f60a18-e4c9-43f5-8abd-9e4cdd0305ab tempest-VolumesActionsTest-1547316290 None] Created volume successfully.
Jul 03 01:13:20 devstack sudo[97708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4
Jul 03 01:13:20 devstack sudo[97708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:21 devstack sudo[97708]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b4f2575c-a64b-4f04-bd47-fe794824a44e tempest-SnapshotsActionsTest-1724460990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4" returned: 0 in 0.790s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b4f2575c-a64b-4f04-bd47-fe794824a44e tempest-SnapshotsActionsTest-1724460990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb61df4c-825f-42e7-9372-b6ece8df5cee 1G {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:21 devstack sudo[97713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb61df4c-825f-42e7-9372-b6ece8df5cee 1G
Jul 03 01:13:21 devstack sudo[97713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:21 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-f97a7d6e-d73f-4255-b14d-be2e9ce4d411 tempest-VolumesActionsTest-1293153765 None] Acquiring lock "cinder-80a5224f-1a26-498c-b28a-7fa98b84f53f-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:13:21 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-f97a7d6e-d73f-4255-b14d-be2e9ce4d411 tempest-VolumesActionsTest-1293153765 None] Lock "cinder-80a5224f-1a26-498c-b28a-7fa98b84f53f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:13:22 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-f97a7d6e-d73f-4255-b14d-be2e9ce4d411 tempest-VolumesActionsTest-1293153765 None] Acquiring lock "cinder-quobyte-80a5224f-1a26-498c-b28a-7fa98b84f53f" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:13:22 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-f97a7d6e-d73f-4255-b14d-be2e9ce4d411 tempest-VolumesActionsTest-1293153765 None] Lock "cinder-quobyte-80a5224f-1a26-498c-b28a-7fa98b84f53f" acquired by "delete_volume" :: waited 0.021s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:13:22 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4c267b-925b-4e86-a147-70d3954c0e63]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:13:22 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f97a7d6e-d73f-4255-b14d-be2e9ce4d411 tempest-VolumesActionsTest-1293153765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-80a5224f-1a26-498c-b28a-7fa98b84f53f {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:22 devstack sudo[97717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-80a5224f-1a26-498c-b28a-7fa98b84f53f
Jul 03 01:13:22 devstack sudo[97717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:22 devstack sudo[97713]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:22 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b4f2575c-a64b-4f04-bd47-fe794824a44e tempest-SnapshotsActionsTest-1724460990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb61df4c-825f-42e7-9372-b6ece8df5cee 1G" returned: 0 in 0.820s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:22 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b4f2575c-a64b-4f04-bd47-fe794824a44e tempest-SnapshotsActionsTest-1724460990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb61df4c-825f-42e7-9372-b6ece8df5cee {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:22 devstack sudo[97721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb61df4c-825f-42e7-9372-b6ece8df5cee
Jul 03 01:13:22 devstack sudo[97721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:22 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d3f8df8-daaf-425c-94fa-3e855ac95267 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:13:22 devstack sudo[97717]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:22 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7d3f8df8-daaf-425c-94fa-3e855ac95267 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Flow 'volume_create_manager' (9482fefd-6c57-4f76-a22c-4ace0ddee40a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:13:22 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7d3f8df8-daaf-425c-94fa-3e855ac95267 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7568c65c-5eb9-419b-bf1a-f4d1f66e3173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:22 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f97a7d6e-d73f-4255-b14d-be2e9ce4d411 tempest-VolumesActionsTest-1293153765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-80a5224f-1a26-498c-b28a-7fa98b84f53f" returned: 0 in 0.824s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:22 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f97a7d6e-d73f-4255-b14d-be2e9ce4d411 tempest-VolumesActionsTest-1293153765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-80a5224f-1a26-498c-b28a-7fa98b84f53f {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:22 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7d3f8df8-daaf-425c-94fa-3e855ac95267 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7568c65c-5eb9-419b-bf1a-f4d1f66e3173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:13:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-79843323',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34059693-3be9-4635-a42d-3024199dd976,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28f7d14f35774094ab83f2325e539fc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:13:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:13:23Z,use_quota=True,user_id='11194d834b434291923696a28ccca89b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:22 devstack sudo[97726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-80a5224f-1a26-498c-b28a-7fa98b84f53f
Jul 03 01:13:22 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7d3f8df8-daaf-425c-94fa-3e855ac95267 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cc866ba-fceb-4fd3-a292-3ae3f6892f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:22 devstack sudo[97726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:22 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7d3f8df8-daaf-425c-94fa-3e855ac95267 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cc866ba-fceb-4fd3-a292-3ae3f6892f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:22 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7d3f8df8-daaf-425c-94fa-3e855ac95267 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (032e26d1-823b-448f-a3c0-016b11e53add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:22 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7d3f8df8-daaf-425c-94fa-3e855ac95267 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (032e26d1-823b-448f-a3c0-016b11e53add) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34059693-3be9-4635-a42d-3024199dd976', 'volume_name': 'volume-34059693-3be9-4635-a42d-3024199dd976', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:22 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7d3f8df8-daaf-425c-94fa-3e855ac95267 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1856bdf3-7166-46d8-b2fe-455c695c065e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:22 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7d3f8df8-daaf-425c-94fa-3e855ac95267 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1856bdf3-7166-46d8-b2fe-455c695c065e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:22 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7d3f8df8-daaf-425c-94fa-3e855ac95267 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0148e617-2fa3-40e8-83a8-9ec5dd116884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:22 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-7d3f8df8-daaf-425c-94fa-3e855ac95267 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Volume 34059693-3be9-4635-a42d-3024199dd976: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34059693-3be9-4635-a42d-3024199dd976', 'volume_size': 1}
Jul 03 01:13:22 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-7d3f8df8-daaf-425c-94fa-3e855ac95267 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:13:23 devstack sudo[97721]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b4f2575c-a64b-4f04-bd47-fe794824a44e tempest-SnapshotsActionsTest-1724460990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb61df4c-825f-42e7-9372-b6ece8df5cee" returned: 0 in 0.745s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:23 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-b4f2575c-a64b-4f04-bd47-fe794824a44e tempest-SnapshotsActionsTest-1724460990 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb61df4c-825f-42e7-9372-b6ece8df5cee is being set with open permissions: ugo+rw
Jul 03 01:13:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b4f2575c-a64b-4f04-bd47-fe794824a44e tempest-SnapshotsActionsTest-1724460990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb61df4c-825f-42e7-9372-b6ece8df5cee {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:23 devstack sudo[97731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb61df4c-825f-42e7-9372-b6ece8df5cee
Jul 03 01:13:23 devstack sudo[97731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:23 devstack sudo[97726]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f97a7d6e-d73f-4255-b14d-be2e9ce4d411 tempest-VolumesActionsTest-1293153765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-80a5224f-1a26-498c-b28a-7fa98b84f53f" returned: 0 in 0.625s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:23 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-f97a7d6e-d73f-4255-b14d-be2e9ce4d411 tempest-VolumesActionsTest-1293153765 None] Lock "cinder-quobyte-80a5224f-1a26-498c-b28a-7fa98b84f53f" released by "delete_volume" :: held 1.498s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:13:23 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-f97a7d6e-d73f-4255-b14d-be2e9ce4d411 tempest-VolumesActionsTest-1293153765 None] Created reservations ['5e75809a-171d-4566-8663-40992ec15de8', '90048df4-f94c-4a23-ad45-ea4ff0936244', 'bb58e010-b5c7-4ff1-a52d-2eb91c1c8433', '991cb84f-95b6-4baf-8fa8-14ea70a9826e'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:13:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f97a7d6e-d73f-4255-b14d-be2e9ce4d411 tempest-VolumesActionsTest-1293153765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:13:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f97a7d6e-d73f-4255-b14d-be2e9ce4d411 tempest-VolumesActionsTest-1293153765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:13:23 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-f97a7d6e-d73f-4255-b14d-be2e9ce4d411 tempest-VolumesActionsTest-1293153765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:13:23 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-f97a7d6e-d73f-4255-b14d-be2e9ce4d411 tempest-VolumesActionsTest-1293153765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:13:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f97a7d6e-d73f-4255-b14d-be2e9ce4d411 tempest-VolumesActionsTest-1293153765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:13:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f97a7d6e-d73f-4255-b14d-be2e9ce4d411 tempest-VolumesActionsTest-1293153765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:23 devstack sudo[97735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:13:23 devstack sudo[97735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:23 devstack sudo[97731]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b4f2575c-a64b-4f04-bd47-fe794824a44e tempest-SnapshotsActionsTest-1724460990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb61df4c-825f-42e7-9372-b6ece8df5cee" returned: 0 in 0.651s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b4f2575c-a64b-4f04-bd47-fe794824a44e tempest-SnapshotsActionsTest-1724460990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:23 devstack sudo[97737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.info
Jul 03 01:13:23 devstack sudo[97737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:24 devstack sudo[97735]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f97a7d6e-d73f-4255-b14d-be2e9ce4d411 tempest-VolumesActionsTest-1293153765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.667s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:24 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-f97a7d6e-d73f-4255-b14d-be2e9ce4d411 tempest-VolumesActionsTest-1293153765 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:13:24 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-f97a7d6e-d73f-4255-b14d-be2e9ce4d411 tempest-VolumesActionsTest-1293153765 None] Deleted volume successfully.
Jul 03 01:13:24 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-f97a7d6e-d73f-4255-b14d-be2e9ce4d411 tempest-VolumesActionsTest-1293153765 None] Lock "cinder-80a5224f-1a26-498c-b28a-7fa98b84f53f-delete_volume" released by "delete_volume" :: held 2.391s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:13:24 devstack sudo[97737]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b4f2575c-a64b-4f04-bd47-fe794824a44e tempest-SnapshotsActionsTest-1724460990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.info" returned: 0 in 0.645s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:24 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-b4f2575c-a64b-4f04-bd47-fe794824a44e tempest-SnapshotsActionsTest-1724460990 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.info is being set with open permissions: ugo+rw
Jul 03 01:13:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b4f2575c-a64b-4f04-bd47-fe794824a44e tempest-SnapshotsActionsTest-1724460990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:24 devstack sudo[97741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.info
Jul 03 01:13:24 devstack sudo[97741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:24 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-19f39552-a001-440f-a7ed-941ae6dace9e tempest-VolumesActionsTest-1547316290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:13:24 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-19f39552-a001-440f-a7ed-941ae6dace9e tempest-VolumesActionsTest-1547316290 None] Flow 'volume_create_manager' (b09350f5-1789-4df5-935f-de9296e5b00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:13:24 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-19f39552-a001-440f-a7ed-941ae6dace9e tempest-VolumesActionsTest-1547316290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff1f7421-3d57-4799-8ab2-87d3e356dbdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:24 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-19f39552-a001-440f-a7ed-941ae6dace9e tempest-VolumesActionsTest-1547316290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff1f7421-3d57-4799-8ab2-87d3e356dbdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:13:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-594581249',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d24721c3-5055-4690-92a5-581274f9356b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d7c647a6e6746b1a1936d53da5b3c17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:13:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:13:25Z,use_quota=True,user_id='7892e5242ca34398b2945766f2cd4ae7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:24 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-19f39552-a001-440f-a7ed-941ae6dace9e tempest-VolumesActionsTest-1547316290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eba0d58-1fc2-4ec2-977e-b1c834166dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:24 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-19f39552-a001-440f-a7ed-941ae6dace9e tempest-VolumesActionsTest-1547316290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eba0d58-1fc2-4ec2-977e-b1c834166dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:24 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-19f39552-a001-440f-a7ed-941ae6dace9e tempest-VolumesActionsTest-1547316290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (807f0948-6fbd-46d1-a58d-029f0d2ab01a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:24 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-19f39552-a001-440f-a7ed-941ae6dace9e tempest-VolumesActionsTest-1547316290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (807f0948-6fbd-46d1-a58d-029f0d2ab01a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd24721c3-5055-4690-92a5-581274f9356b', 'volume_name': 'volume-d24721c3-5055-4690-92a5-581274f9356b', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:24 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-19f39552-a001-440f-a7ed-941ae6dace9e tempest-VolumesActionsTest-1547316290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b7749a9-3953-47ca-95df-6384977a4cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:24 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-19f39552-a001-440f-a7ed-941ae6dace9e tempest-VolumesActionsTest-1547316290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b7749a9-3953-47ca-95df-6384977a4cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:24 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-19f39552-a001-440f-a7ed-941ae6dace9e tempest-VolumesActionsTest-1547316290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e429aa57-d4f3-4120-a8b3-0141663b67fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:24 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-19f39552-a001-440f-a7ed-941ae6dace9e tempest-VolumesActionsTest-1547316290 None] Volume d24721c3-5055-4690-92a5-581274f9356b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d24721c3-5055-4690-92a5-581274f9356b', 'volume_size': 1}
Jul 03 01:13:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-19f39552-a001-440f-a7ed-941ae6dace9e tempest-VolumesActionsTest-1547316290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:13:25 devstack sudo[97741]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b4f2575c-a64b-4f04-bd47-fe794824a44e tempest-SnapshotsActionsTest-1724460990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.info" returned: 0 in 0.644s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b4f2575c-a64b-4f04-bd47-fe794824a44e tempest-SnapshotsActionsTest-1724460990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.390s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:13:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-4d3ccdf1-307d-42b1-9724-aaf9bdd94bf1 tempest-VolumeQuotasAdminTestJSON-343806598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.647s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:13:25 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-4d3ccdf1-307d-42b1-9724-aaf9bdd94bf1 tempest-VolumeQuotasAdminTestJSON-343806598 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:13:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2067628985',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c471374-2461-423f-af61-9695861dedfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='925702021d4c44ae813d8db8615631c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:13:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:13:20Z,use_quota=True,user_id='05700ddfb6b94ed3957535dad3eb05b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:13:25 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-4d3ccdf1-307d-42b1-9724-aaf9bdd94bf1 tempest-VolumeQuotasAdminTestJSON-343806598 None] Creating volume 5c471374-2461-423f-af61-9695861dedfc {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:13:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-4d3ccdf1-307d-42b1-9724-aaf9bdd94bf1 tempest-VolumeQuotasAdminTestJSON-343806598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:13:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-4d3ccdf1-307d-42b1-9724-aaf9bdd94bf1 tempest-VolumeQuotasAdminTestJSON-343806598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:13:25 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-4d3ccdf1-307d-42b1-9724-aaf9bdd94bf1 tempest-VolumeQuotasAdminTestJSON-343806598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:13:25 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-4d3ccdf1-307d-42b1-9724-aaf9bdd94bf1 tempest-VolumeQuotasAdminTestJSON-343806598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:13:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-4d3ccdf1-307d-42b1-9724-aaf9bdd94bf1 tempest-VolumeQuotasAdminTestJSON-343806598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:13:25 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-4d3ccdf1-307d-42b1-9724-aaf9bdd94bf1 tempest-VolumeQuotasAdminTestJSON-343806598 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:13:25 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-4d3ccdf1-307d-42b1-9724-aaf9bdd94bf1 tempest-VolumeQuotasAdminTestJSON-343806598 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:13:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-4d3ccdf1-307d-42b1-9724-aaf9bdd94bf1 tempest-VolumeQuotasAdminTestJSON-343806598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-5c471374-2461-423f-af61-9695861dedfc 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:25 devstack sudo[97780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-5c471374-2461-423f-af61-9695861dedfc 1073741824
Jul 03 01:13:25 devstack sudo[97780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:25 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-b4f2575c-a64b-4f04-bd47-fe794824a44e tempest-SnapshotsActionsTest-1724460990 None] Create snapshot completed successfully
Jul 03 01:13:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-30715532-1fba-4ba2-8ed0-42c8d25a9b44 tempest-SnapshotsActionsTest-1724460990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:13:25 devstack sudo[97780]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-4d3ccdf1-307d-42b1-9724-aaf9bdd94bf1 tempest-VolumeQuotasAdminTestJSON-343806598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-5c471374-2461-423f-af61-9695861dedfc 1073741824" returned: 0 in 0.859s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-4d3ccdf1-307d-42b1-9724-aaf9bdd94bf1 tempest-VolumeQuotasAdminTestJSON-343806598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-5c471374-2461-423f-af61-9695861dedfc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:25 devstack sudo[97785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-5c471374-2461-423f-af61-9695861dedfc
Jul 03 01:13:25 devstack sudo[97785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:26 devstack sudo[97785]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:26 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-4d3ccdf1-307d-42b1-9724-aaf9bdd94bf1 tempest-VolumeQuotasAdminTestJSON-343806598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-5c471374-2461-423f-af61-9695861dedfc" returned: 0 in 0.633s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:26 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-4d3ccdf1-307d-42b1-9724-aaf9bdd94bf1 tempest-VolumeQuotasAdminTestJSON-343806598 None] <== create_volume: return (1527ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:13:26 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-4d3ccdf1-307d-42b1-9724-aaf9bdd94bf1 tempest-VolumeQuotasAdminTestJSON-343806598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.530s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:13:26 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-7d3f8df8-daaf-425c-94fa-3e855ac95267 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.652s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:13:26 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-7d3f8df8-daaf-425c-94fa-3e855ac95267 tempest-CreateVolumesFromSnapshotTest-2114505382 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:13:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-79843323',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34059693-3be9-4635-a42d-3024199dd976,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28f7d14f35774094ab83f2325e539fc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:13:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:13:23Z,use_quota=True,user_id='11194d834b434291923696a28ccca89b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:13:26 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-7d3f8df8-daaf-425c-94fa-3e855ac95267 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Creating volume 34059693-3be9-4635-a42d-3024199dd976 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:13:26 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-7d3f8df8-daaf-425c-94fa-3e855ac95267 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:13:26 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-7d3f8df8-daaf-425c-94fa-3e855ac95267 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:13:26 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-7d3f8df8-daaf-425c-94fa-3e855ac95267 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:13:26 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-7d3f8df8-daaf-425c-94fa-3e855ac95267 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:13:26 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-7d3f8df8-daaf-425c-94fa-3e855ac95267 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:13:26 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-7d3f8df8-daaf-425c-94fa-3e855ac95267 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:13:26 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-7d3f8df8-daaf-425c-94fa-3e855ac95267 tempest-CreateVolumesFromSnapshotTest-2114505382 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:13:26 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-7d3f8df8-daaf-425c-94fa-3e855ac95267 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-34059693-3be9-4635-a42d-3024199dd976 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:26 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-4d3ccdf1-307d-42b1-9724-aaf9bdd94bf1 tempest-VolumeQuotasAdminTestJSON-343806598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (169f06ad-d120-46f2-9611-4648e19fa128) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c471374-2461-423f-af61-9695861dedfc', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:26 devstack sudo[97788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-34059693-3be9-4635-a42d-3024199dd976 1073741824
Jul 03 01:13:26 devstack sudo[97788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:26 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-4d3ccdf1-307d-42b1-9724-aaf9bdd94bf1 tempest-VolumeQuotasAdminTestJSON-343806598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d37f16e9-68a4-496c-a0a1-24bb73d98b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:26 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-4d3ccdf1-307d-42b1-9724-aaf9bdd94bf1 tempest-VolumeQuotasAdminTestJSON-343806598 None] Volume volume-5c471374-2461-423f-af61-9695861dedfc (5c471374-2461-423f-af61-9695861dedfc): created successfully
Jul 03 01:13:26 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-4d3ccdf1-307d-42b1-9724-aaf9bdd94bf1 tempest-VolumeQuotasAdminTestJSON-343806598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d37f16e9-68a4-496c-a0a1-24bb73d98b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:26 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-4d3ccdf1-307d-42b1-9724-aaf9bdd94bf1 tempest-VolumeQuotasAdminTestJSON-343806598 None] Flow 'volume_create_manager' (df19edc1-8413-406a-84fd-406f4642395f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:13:26 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-4d3ccdf1-307d-42b1-9724-aaf9bdd94bf1 tempest-VolumeQuotasAdminTestJSON-343806598 None] Created volume successfully.
Jul 03 01:13:27 devstack sudo[97788]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-7d3f8df8-daaf-425c-94fa-3e855ac95267 tempest-CreateVolumesFromSnapshotTest-2114505382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-34059693-3be9-4635-a42d-3024199dd976 1073741824" returned: 0 in 0.801s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-7d3f8df8-daaf-425c-94fa-3e855ac95267 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-34059693-3be9-4635-a42d-3024199dd976 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:27 devstack sudo[97793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-34059693-3be9-4635-a42d-3024199dd976
Jul 03 01:13:27 devstack sudo[97793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:28 devstack sudo[97793]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:28 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-7d3f8df8-daaf-425c-94fa-3e855ac95267 tempest-CreateVolumesFromSnapshotTest-2114505382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-34059693-3be9-4635-a42d-3024199dd976" returned: 0 in 0.659s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:28 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-7d3f8df8-daaf-425c-94fa-3e855ac95267 tempest-CreateVolumesFromSnapshotTest-2114505382 None] <== create_volume: return (1495ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:13:28 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-7d3f8df8-daaf-425c-94fa-3e855ac95267 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.498s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:13:28 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-19f39552-a001-440f-a7ed-941ae6dace9e tempest-VolumesActionsTest-1547316290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.278s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:13:28 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-19f39552-a001-440f-a7ed-941ae6dace9e tempest-VolumesActionsTest-1547316290 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:13:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-594581249',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d24721c3-5055-4690-92a5-581274f9356b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d7c647a6e6746b1a1936d53da5b3c17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:13:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:13:25Z,use_quota=True,user_id='7892e5242ca34398b2945766f2cd4ae7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:13:28 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-19f39552-a001-440f-a7ed-941ae6dace9e tempest-VolumesActionsTest-1547316290 None] Creating volume d24721c3-5055-4690-92a5-581274f9356b {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:13:28 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-19f39552-a001-440f-a7ed-941ae6dace9e tempest-VolumesActionsTest-1547316290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:13:28 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-19f39552-a001-440f-a7ed-941ae6dace9e tempest-VolumesActionsTest-1547316290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:13:28 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-19f39552-a001-440f-a7ed-941ae6dace9e tempest-VolumesActionsTest-1547316290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:13:28 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-19f39552-a001-440f-a7ed-941ae6dace9e tempest-VolumesActionsTest-1547316290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:13:28 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-19f39552-a001-440f-a7ed-941ae6dace9e tempest-VolumesActionsTest-1547316290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:13:28 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-19f39552-a001-440f-a7ed-941ae6dace9e tempest-VolumesActionsTest-1547316290 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:13:28 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-19f39552-a001-440f-a7ed-941ae6dace9e tempest-VolumesActionsTest-1547316290 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:13:28 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-19f39552-a001-440f-a7ed-941ae6dace9e tempest-VolumesActionsTest-1547316290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d24721c3-5055-4690-92a5-581274f9356b 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:28 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7d3f8df8-daaf-425c-94fa-3e855ac95267 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0148e617-2fa3-40e8-83a8-9ec5dd116884) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34059693-3be9-4635-a42d-3024199dd976', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:28 devstack sudo[97797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d24721c3-5055-4690-92a5-581274f9356b 1073741824
Jul 03 01:13:28 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7d3f8df8-daaf-425c-94fa-3e855ac95267 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (767eafd7-e116-4cf8-b392-3b1846625aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:28 devstack sudo[97797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:28 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-7d3f8df8-daaf-425c-94fa-3e855ac95267 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Volume volume-34059693-3be9-4635-a42d-3024199dd976 (34059693-3be9-4635-a42d-3024199dd976): created successfully
Jul 03 01:13:28 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7d3f8df8-daaf-425c-94fa-3e855ac95267 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (767eafd7-e116-4cf8-b392-3b1846625aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:28 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7d3f8df8-daaf-425c-94fa-3e855ac95267 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Flow 'volume_create_manager' (9482fefd-6c57-4f76-a22c-4ace0ddee40a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:13:28 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-7d3f8df8-daaf-425c-94fa-3e855ac95267 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Created volume successfully.
Jul 03 01:13:28 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-45b5d95c-d7ac-42b2-bb1b-8de283c9218a tempest-VolumeQuotasAdminTestJSON-355233011 None] Transfer volume completed successfully.
Jul 03 01:13:28 devstack sudo[97797]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:28 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-19f39552-a001-440f-a7ed-941ae6dace9e tempest-VolumesActionsTest-1547316290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d24721c3-5055-4690-92a5-581274f9356b 1073741824" returned: 0 in 0.872s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-19f39552-a001-440f-a7ed-941ae6dace9e tempest-VolumesActionsTest-1547316290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d24721c3-5055-4690-92a5-581274f9356b {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:29 devstack sudo[97803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d24721c3-5055-4690-92a5-581274f9356b
Jul 03 01:13:29 devstack sudo[97803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:29 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-28dfd279-c344-4b2f-8e24-b6fb11cd0124 tempest-VolumeQuotasAdminTestJSON-1476141644 None] Acquiring lock "cinder-5c471374-2461-423f-af61-9695861dedfc-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:13:29 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-28dfd279-c344-4b2f-8e24-b6fb11cd0124 tempest-VolumeQuotasAdminTestJSON-1476141644 None] Lock "cinder-5c471374-2461-423f-af61-9695861dedfc-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:13:29 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-28dfd279-c344-4b2f-8e24-b6fb11cd0124 tempest-VolumeQuotasAdminTestJSON-1476141644 None] Acquiring lock "cinder-quobyte-5c471374-2461-423f-af61-9695861dedfc" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:13:29 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-28dfd279-c344-4b2f-8e24-b6fb11cd0124 tempest-VolumeQuotasAdminTestJSON-1476141644 None] Lock "cinder-quobyte-5c471374-2461-423f-af61-9695861dedfc" acquired by "delete_volume" :: waited 0.017s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:13:29 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[83cd8c44-dccc-495b-a69c-ff29e618fc2e]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:13:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-28dfd279-c344-4b2f-8e24-b6fb11cd0124 tempest-VolumeQuotasAdminTestJSON-1476141644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-5c471374-2461-423f-af61-9695861dedfc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1f172387-0922-4109-8622-835a835eb793 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:13:29 devstack sudo[97805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-5c471374-2461-423f-af61-9695861dedfc
Jul 03 01:13:29 devstack sudo[97805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:29 devstack sudo[97803]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-19f39552-a001-440f-a7ed-941ae6dace9e tempest-VolumesActionsTest-1547316290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d24721c3-5055-4690-92a5-581274f9356b" returned: 0 in 0.739s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:29 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-19f39552-a001-440f-a7ed-941ae6dace9e tempest-VolumesActionsTest-1547316290 None] <== create_volume: return (1655ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:13:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-19f39552-a001-440f-a7ed-941ae6dace9e tempest-VolumesActionsTest-1547316290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.659s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:13:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-30715532-1fba-4ba2-8ed0-42c8d25a9b44 tempest-SnapshotsActionsTest-1724460990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.998s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:13:29 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-19f39552-a001-440f-a7ed-941ae6dace9e tempest-VolumesActionsTest-1547316290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e429aa57-d4f3-4120-a8b3-0141663b67fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d24721c3-5055-4690-92a5-581274f9356b', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:29 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-19f39552-a001-440f-a7ed-941ae6dace9e tempest-VolumesActionsTest-1547316290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7f28395-9522-411c-acca-9ea7513582f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:29 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-30715532-1fba-4ba2-8ed0-42c8d25a9b44 tempest-SnapshotsActionsTest-1724460990 None] Creating offline snapshot 067b0c6e-073f-449b-9737-2b095d0f97de of volume 7d1b77c3-b58d-4c30-8075-2e237b09fdf4 {{(pid=86891) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 01:13:29 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-19f39552-a001-440f-a7ed-941ae6dace9e tempest-VolumesActionsTest-1547316290 None] Volume volume-d24721c3-5055-4690-92a5-581274f9356b (d24721c3-5055-4690-92a5-581274f9356b): created successfully
Jul 03 01:13:29 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-19f39552-a001-440f-a7ed-941ae6dace9e tempest-VolumesActionsTest-1547316290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7f28395-9522-411c-acca-9ea7513582f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:29 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-19f39552-a001-440f-a7ed-941ae6dace9e tempest-VolumesActionsTest-1547316290 None] Flow 'volume_create_manager' (b09350f5-1789-4df5-935f-de9296e5b00e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:13:29 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e2062c-4ad0-497e-99c3-916e771afd8e]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:13:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-30715532-1fba-4ba2-8ed0-42c8d25a9b44 tempest-SnapshotsActionsTest-1724460990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb61df4c-825f-42e7-9372-b6ece8df5cee {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:29 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-19f39552-a001-440f-a7ed-941ae6dace9e tempest-VolumesActionsTest-1547316290 None] Created volume successfully.
Jul 03 01:13:30 devstack sudo[97808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb61df4c-825f-42e7-9372-b6ece8df5cee
Jul 03 01:13:30 devstack sudo[97808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:30 devstack sudo[97805]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-28dfd279-c344-4b2f-8e24-b6fb11cd0124 tempest-VolumeQuotasAdminTestJSON-1476141644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-5c471374-2461-423f-af61-9695861dedfc" returned: 0 in 0.800s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-28dfd279-c344-4b2f-8e24-b6fb11cd0124 tempest-VolumeQuotasAdminTestJSON-1476141644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-5c471374-2461-423f-af61-9695861dedfc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:30 devstack sudo[97813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-5c471374-2461-423f-af61-9695861dedfc
Jul 03 01:13:30 devstack sudo[97813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:30 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e1ccbadb-e3ee-419d-a170-462cc9628f78 tempest-VolumesActionsTest-1293153765 None] Acquiring lock "cinder-d24721c3-5055-4690-92a5-581274f9356b-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:13:30 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e1ccbadb-e3ee-419d-a170-462cc9628f78 tempest-VolumesActionsTest-1293153765 None] Lock "cinder-d24721c3-5055-4690-92a5-581274f9356b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:13:30 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e1ccbadb-e3ee-419d-a170-462cc9628f78 tempest-VolumesActionsTest-1293153765 None] Acquiring lock "cinder-quobyte-d24721c3-5055-4690-92a5-581274f9356b" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:13:30 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e1ccbadb-e3ee-419d-a170-462cc9628f78 tempest-VolumesActionsTest-1293153765 None] Lock "cinder-quobyte-d24721c3-5055-4690-92a5-581274f9356b" acquired by "delete_volume" :: waited 0.018s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:13:30 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[20bac7fb-42b7-4f59-ae35-02f76b0d0883]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:13:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e1ccbadb-e3ee-419d-a170-462cc9628f78 tempest-VolumesActionsTest-1293153765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d24721c3-5055-4690-92a5-581274f9356b {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:30 devstack sudo[97815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d24721c3-5055-4690-92a5-581274f9356b
Jul 03 01:13:30 devstack sudo[97815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:30 devstack sudo[97808]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-30715532-1fba-4ba2-8ed0-42c8d25a9b44 tempest-SnapshotsActionsTest-1724460990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb61df4c-825f-42e7-9372-b6ece8df5cee" returned: 0 in 0.870s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:30 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-30715532-1fba-4ba2-8ed0-42c8d25a9b44 tempest-SnapshotsActionsTest-1724460990 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:13:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-30715532-1fba-4ba2-8ed0-42c8d25a9b44 tempest-SnapshotsActionsTest-1724460990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb61df4c-825f-42e7-9372-b6ece8df5cee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.067b0c6e-073f-449b-9737-2b095d0f97de 1G {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:30 devstack sudo[97820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb61df4c-825f-42e7-9372-b6ece8df5cee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.067b0c6e-073f-449b-9737-2b095d0f97de 1G
Jul 03 01:13:30 devstack sudo[97820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:30 devstack sudo[97813]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-28dfd279-c344-4b2f-8e24-b6fb11cd0124 tempest-VolumeQuotasAdminTestJSON-1476141644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-5c471374-2461-423f-af61-9695861dedfc" returned: 0 in 0.763s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:30 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-28dfd279-c344-4b2f-8e24-b6fb11cd0124 tempest-VolumeQuotasAdminTestJSON-1476141644 None] Lock "cinder-quobyte-5c471374-2461-423f-af61-9695861dedfc" released by "delete_volume" :: held 1.617s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:13:30 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-28dfd279-c344-4b2f-8e24-b6fb11cd0124 tempest-VolumeQuotasAdminTestJSON-1476141644 None] Created reservations ['1ecf0688-a289-46d4-8653-3ba98ec6a74f', '4a8a45d2-abbb-4661-939d-f2e5267283df', 'e63546b2-2359-45b3-b84a-c0d00fc89d4e', '2be25185-9e61-4f75-a4e6-75bc71a4129a'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:13:31 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-28dfd279-c344-4b2f-8e24-b6fb11cd0124 tempest-VolumeQuotasAdminTestJSON-1476141644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:13:31 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-28dfd279-c344-4b2f-8e24-b6fb11cd0124 tempest-VolumeQuotasAdminTestJSON-1476141644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:13:31 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-28dfd279-c344-4b2f-8e24-b6fb11cd0124 tempest-VolumeQuotasAdminTestJSON-1476141644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:13:31 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-28dfd279-c344-4b2f-8e24-b6fb11cd0124 tempest-VolumeQuotasAdminTestJSON-1476141644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:13:31 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-28dfd279-c344-4b2f-8e24-b6fb11cd0124 tempest-VolumeQuotasAdminTestJSON-1476141644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:13:31 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-28dfd279-c344-4b2f-8e24-b6fb11cd0124 tempest-VolumeQuotasAdminTestJSON-1476141644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:31 devstack sudo[97826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:13:31 devstack sudo[97826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:31 devstack sudo[97815]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:31 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e1ccbadb-e3ee-419d-a170-462cc9628f78 tempest-VolumesActionsTest-1293153765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d24721c3-5055-4690-92a5-581274f9356b" returned: 0 in 0.834s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:31 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e1ccbadb-e3ee-419d-a170-462cc9628f78 tempest-VolumesActionsTest-1293153765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d24721c3-5055-4690-92a5-581274f9356b {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:31 devstack sudo[97828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d24721c3-5055-4690-92a5-581274f9356b
Jul 03 01:13:31 devstack sudo[97828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:31 devstack sudo[97820]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:31 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-30715532-1fba-4ba2-8ed0-42c8d25a9b44 tempest-SnapshotsActionsTest-1724460990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb61df4c-825f-42e7-9372-b6ece8df5cee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.067b0c6e-073f-449b-9737-2b095d0f97de 1G" returned: 0 in 0.949s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:31 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-30715532-1fba-4ba2-8ed0-42c8d25a9b44 tempest-SnapshotsActionsTest-1724460990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb61df4c-825f-42e7-9372-b6ece8df5cee -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.067b0c6e-073f-449b-9737-2b095d0f97de {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:31 devstack sudo[97833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb61df4c-825f-42e7-9372-b6ece8df5cee -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.067b0c6e-073f-449b-9737-2b095d0f97de
Jul 03 01:13:31 devstack sudo[97833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:31 devstack sudo[97828]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:31 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e1ccbadb-e3ee-419d-a170-462cc9628f78 tempest-VolumesActionsTest-1293153765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d24721c3-5055-4690-92a5-581274f9356b" returned: 0 in 0.689s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:31 devstack sudo[97826]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:31 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-28dfd279-c344-4b2f-8e24-b6fb11cd0124 tempest-VolumeQuotasAdminTestJSON-1476141644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.748s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:31 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-28dfd279-c344-4b2f-8e24-b6fb11cd0124 tempest-VolumeQuotasAdminTestJSON-1476141644 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:13:31 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e1ccbadb-e3ee-419d-a170-462cc9628f78 tempest-VolumesActionsTest-1293153765 None] Lock "cinder-quobyte-d24721c3-5055-4690-92a5-581274f9356b" released by "delete_volume" :: held 1.584s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:13:31 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-28dfd279-c344-4b2f-8e24-b6fb11cd0124 tempest-VolumeQuotasAdminTestJSON-1476141644 None] Deleted volume successfully.
Jul 03 01:13:31 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-28dfd279-c344-4b2f-8e24-b6fb11cd0124 tempest-VolumeQuotasAdminTestJSON-1476141644 None] Lock "cinder-5c471374-2461-423f-af61-9695861dedfc-delete_volume" released by "delete_volume" :: held 2.667s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:13:31 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-e1ccbadb-e3ee-419d-a170-462cc9628f78 tempest-VolumesActionsTest-1293153765 None] Created reservations ['09963d27-64cb-41df-b998-ed7d7bdb48a7', '801abc1f-ffd3-4e57-89ce-16b2d2cd456b', '11b1703f-cef1-4a27-9315-73f7f7d42e65', '42cf6fcf-251b-4ef6-b49f-a99878436bd4'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:13:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e1ccbadb-e3ee-419d-a170-462cc9628f78 tempest-VolumesActionsTest-1293153765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:13:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e1ccbadb-e3ee-419d-a170-462cc9628f78 tempest-VolumesActionsTest-1293153765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:13:32 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-e1ccbadb-e3ee-419d-a170-462cc9628f78 tempest-VolumesActionsTest-1293153765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:13:32 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-e1ccbadb-e3ee-419d-a170-462cc9628f78 tempest-VolumesActionsTest-1293153765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:13:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e1ccbadb-e3ee-419d-a170-462cc9628f78 tempest-VolumesActionsTest-1293153765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:13:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e1ccbadb-e3ee-419d-a170-462cc9628f78 tempest-VolumesActionsTest-1293153765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:32 devstack sudo[97837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:13:32 devstack sudo[97837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:32 devstack sudo[97833]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-30715532-1fba-4ba2-8ed0-42c8d25a9b44 tempest-SnapshotsActionsTest-1724460990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb61df4c-825f-42e7-9372-b6ece8df5cee -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.067b0c6e-073f-449b-9737-2b095d0f97de" returned: 0 in 0.755s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:32 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-30715532-1fba-4ba2-8ed0-42c8d25a9b44 tempest-SnapshotsActionsTest-1724460990 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.067b0c6e-073f-449b-9737-2b095d0f97de is being set with open permissions: ugo+rw
Jul 03 01:13:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-30715532-1fba-4ba2-8ed0-42c8d25a9b44 tempest-SnapshotsActionsTest-1724460990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.067b0c6e-073f-449b-9737-2b095d0f97de {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:32 devstack sudo[97843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.067b0c6e-073f-449b-9737-2b095d0f97de
Jul 03 01:13:32 devstack sudo[97843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:32 devstack sudo[97837]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e1ccbadb-e3ee-419d-a170-462cc9628f78 tempest-VolumesActionsTest-1293153765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.813s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:32 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-e1ccbadb-e3ee-419d-a170-462cc9628f78 tempest-VolumesActionsTest-1293153765 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:13:32 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-e1ccbadb-e3ee-419d-a170-462cc9628f78 tempest-VolumesActionsTest-1293153765 None] Deleted volume successfully.
Jul 03 01:13:32 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e1ccbadb-e3ee-419d-a170-462cc9628f78 tempest-VolumesActionsTest-1293153765 None] Lock "cinder-d24721c3-5055-4690-92a5-581274f9356b-delete_volume" released by "delete_volume" :: held 2.667s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:13:33 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6eed494-131a-426b-bff8-14a44a6df8aa tempest-VolumesActionsTest-1547316290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:13:33 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f6eed494-131a-426b-bff8-14a44a6df8aa tempest-VolumesActionsTest-1547316290 None] Flow 'volume_create_manager' (0fc2b024-f3cf-484a-9d3f-2f833095db97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:13:33 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f6eed494-131a-426b-bff8-14a44a6df8aa tempest-VolumesActionsTest-1547316290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a21211f7-5473-462d-951a-0fc85d592a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:33 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f6eed494-131a-426b-bff8-14a44a6df8aa tempest-VolumesActionsTest-1547316290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a21211f7-5473-462d-951a-0fc85d592a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:13:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2044460659',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b5fdd0a-8843-40f6-86d4-bd7ed30a2fa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d7c647a6e6746b1a1936d53da5b3c17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:13:33Z,use_quota=True,user_id='7892e5242ca34398b2945766f2cd4ae7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:33 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f6eed494-131a-426b-bff8-14a44a6df8aa tempest-VolumesActionsTest-1547316290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de3b05e5-d07f-491e-b61c-0ccb9d10772b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:33 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f6eed494-131a-426b-bff8-14a44a6df8aa tempest-VolumesActionsTest-1547316290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de3b05e5-d07f-491e-b61c-0ccb9d10772b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:33 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f6eed494-131a-426b-bff8-14a44a6df8aa tempest-VolumesActionsTest-1547316290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55f03d16-9120-40ba-b17e-f4ba9f2bb51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:33 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f6eed494-131a-426b-bff8-14a44a6df8aa tempest-VolumesActionsTest-1547316290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55f03d16-9120-40ba-b17e-f4ba9f2bb51c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b5fdd0a-8843-40f6-86d4-bd7ed30a2fa4', 'volume_name': 'volume-3b5fdd0a-8843-40f6-86d4-bd7ed30a2fa4', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:33 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f6eed494-131a-426b-bff8-14a44a6df8aa tempest-VolumesActionsTest-1547316290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ed5b0d3-b1f5-44c3-974c-388ec997bb93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:33 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f6eed494-131a-426b-bff8-14a44a6df8aa tempest-VolumesActionsTest-1547316290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ed5b0d3-b1f5-44c3-974c-388ec997bb93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:33 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f6eed494-131a-426b-bff8-14a44a6df8aa tempest-VolumesActionsTest-1547316290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d650e9b-946a-452c-a9f3-14e0e874adb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:33 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-f6eed494-131a-426b-bff8-14a44a6df8aa tempest-VolumesActionsTest-1547316290 None] Volume 3b5fdd0a-8843-40f6-86d4-bd7ed30a2fa4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b5fdd0a-8843-40f6-86d4-bd7ed30a2fa4', 'volume_size': 1}
Jul 03 01:13:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f6eed494-131a-426b-bff8-14a44a6df8aa tempest-VolumesActionsTest-1547316290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:13:33 devstack sudo[97843]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-30715532-1fba-4ba2-8ed0-42c8d25a9b44 tempest-SnapshotsActionsTest-1724460990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.067b0c6e-073f-449b-9737-2b095d0f97de" returned: 0 in 0.737s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-30715532-1fba-4ba2-8ed0-42c8d25a9b44 tempest-SnapshotsActionsTest-1724460990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.450s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:13:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1f172387-0922-4109-8622-835a835eb793 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.795s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:13:33 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-1f172387-0922-4109-8622-835a835eb793 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Creating offline snapshot a6ff2c37-cbc1-4424-bad4-db4fa421d499 of volume 34059693-3be9-4635-a42d-3024199dd976 {{(pid=86891) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 01:13:33 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-30715532-1fba-4ba2-8ed0-42c8d25a9b44 tempest-SnapshotsActionsTest-1724460990 None] Create snapshot completed successfully
Jul 03 01:13:33 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[be64e633-b0bc-4c57-ac3e-3b10f18a44da]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:13:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1f172387-0922-4109-8622-835a835eb793 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-34059693-3be9-4635-a42d-3024199dd976 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:33 devstack sudo[97847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-34059693-3be9-4635-a42d-3024199dd976
Jul 03 01:13:33 devstack sudo[97847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:34 devstack sudo[97847]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1f172387-0922-4109-8622-835a835eb793 tempest-CreateVolumesFromSnapshotTest-2114505382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-34059693-3be9-4635-a42d-3024199dd976" returned: 0 in 0.855s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1f172387-0922-4109-8622-835a835eb793 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-34059693-3be9-4635-a42d-3024199dd976,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-34059693-3be9-4635-a42d-3024199dd976.a6ff2c37-cbc1-4424-bad4-db4fa421d499 1G {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:34 devstack sudo[97852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-34059693-3be9-4635-a42d-3024199dd976,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-34059693-3be9-4635-a42d-3024199dd976.a6ff2c37-cbc1-4424-bad4-db4fa421d499 1G
Jul 03 01:13:34 devstack sudo[97852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:34 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-9546b821-421f-4316-8df5-b5b90ee79778 tempest-SnapshotsActionsTest-647828101 None] Acquiring lock "cinder-067b0c6e-073f-449b-9737-2b095d0f97de-delete_snapshot" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:13:34 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-9546b821-421f-4316-8df5-b5b90ee79778 tempest-SnapshotsActionsTest-647828101 None] Lock "cinder-067b0c6e-073f-449b-9737-2b095d0f97de-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:13:34 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-9546b821-421f-4316-8df5-b5b90ee79778 tempest-SnapshotsActionsTest-647828101 None] Acquiring lock "cinder-quobyte-7d1b77c3-b58d-4c30-8075-2e237b09fdf4" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:13:34 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-9546b821-421f-4316-8df5-b5b90ee79778 tempest-SnapshotsActionsTest-647828101 None] Lock "cinder-quobyte-7d1b77c3-b58d-4c30-8075-2e237b09fdf4" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:13:34 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-9546b821-421f-4316-8df5-b5b90ee79778 tempest-SnapshotsActionsTest-647828101 None] Acquiring lock "cinder-quobyte-067b0c6e-073f-449b-9737-2b095d0f97de" by "_delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:13:34 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-9546b821-421f-4316-8df5-b5b90ee79778 tempest-SnapshotsActionsTest-647828101 None] Lock "cinder-quobyte-067b0c6e-073f-449b-9737-2b095d0f97de" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:13:34 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-9546b821-421f-4316-8df5-b5b90ee79778 tempest-SnapshotsActionsTest-647828101 None] Deleting offline snapshot 067b0c6e-073f-449b-9737-2b095d0f97de of volume 7d1b77c3-b58d-4c30-8075-2e237b09fdf4 {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 01:13:34 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-9546b821-421f-4316-8df5-b5b90ee79778 tempest-SnapshotsActionsTest-647828101 None] snapshot_file for this snap is: volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.067b0c6e-073f-449b-9737-2b095d0f97de {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 01:13:34 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd756026-b597-4bc5-aeff-079d2f006fa5]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:13:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9546b821-421f-4316-8df5-b5b90ee79778 tempest-SnapshotsActionsTest-647828101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.067b0c6e-073f-449b-9737-2b095d0f97de {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:34 devstack sudo[97854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.067b0c6e-073f-449b-9737-2b095d0f97de
Jul 03 01:13:34 devstack sudo[97854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:35 devstack sudo[97852]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1f172387-0922-4109-8622-835a835eb793 tempest-CreateVolumesFromSnapshotTest-2114505382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-34059693-3be9-4635-a42d-3024199dd976,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-34059693-3be9-4635-a42d-3024199dd976.a6ff2c37-cbc1-4424-bad4-db4fa421d499 1G" returned: 0 in 0.948s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1f172387-0922-4109-8622-835a835eb793 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34059693-3be9-4635-a42d-3024199dd976 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-34059693-3be9-4635-a42d-3024199dd976.a6ff2c37-cbc1-4424-bad4-db4fa421d499 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:35 devstack sudo[97859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34059693-3be9-4635-a42d-3024199dd976 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-34059693-3be9-4635-a42d-3024199dd976.a6ff2c37-cbc1-4424-bad4-db4fa421d499
Jul 03 01:13:35 devstack sudo[97859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:35 devstack sudo[97854]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9546b821-421f-4316-8df5-b5b90ee79778 tempest-SnapshotsActionsTest-647828101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.067b0c6e-073f-449b-9737-2b095d0f97de" returned: 0 in 0.967s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:35 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-9546b821-421f-4316-8df5-b5b90ee79778 tempest-SnapshotsActionsTest-647828101 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:13:35 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[21beae38-0dfa-4c9d-8efb-965be707bd7e]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:13:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9546b821-421f-4316-8df5-b5b90ee79778 tempest-SnapshotsActionsTest-647828101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb61df4c-825f-42e7-9372-b6ece8df5cee {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:35 devstack sudo[97865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb61df4c-825f-42e7-9372-b6ece8df5cee
Jul 03 01:13:35 devstack sudo[97865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:35 devstack sudo[97859]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1f172387-0922-4109-8622-835a835eb793 tempest-CreateVolumesFromSnapshotTest-2114505382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34059693-3be9-4635-a42d-3024199dd976 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-34059693-3be9-4635-a42d-3024199dd976.a6ff2c37-cbc1-4424-bad4-db4fa421d499" returned: 0 in 0.765s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:35 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-1f172387-0922-4109-8622-835a835eb793 tempest-CreateVolumesFromSnapshotTest-2114505382 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-34059693-3be9-4635-a42d-3024199dd976.a6ff2c37-cbc1-4424-bad4-db4fa421d499 is being set with open permissions: ugo+rw
Jul 03 01:13:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1f172387-0922-4109-8622-835a835eb793 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-34059693-3be9-4635-a42d-3024199dd976.a6ff2c37-cbc1-4424-bad4-db4fa421d499 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:35 devstack sudo[97870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-34059693-3be9-4635-a42d-3024199dd976.a6ff2c37-cbc1-4424-bad4-db4fa421d499
Jul 03 01:13:35 devstack sudo[97870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:36 devstack sudo[97865]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9546b821-421f-4316-8df5-b5b90ee79778 tempest-SnapshotsActionsTest-647828101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb61df4c-825f-42e7-9372-b6ece8df5cee" returned: 0 in 0.923s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:36 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-9546b821-421f-4316-8df5-b5b90ee79778 tempest-SnapshotsActionsTest-647828101 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:13:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9546b821-421f-4316-8df5-b5b90ee79778 tempest-SnapshotsActionsTest-647828101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.067b0c6e-073f-449b-9737-2b095d0f97de {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:36 devstack sudo[97876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.067b0c6e-073f-449b-9737-2b095d0f97de
Jul 03 01:13:36 devstack sudo[97876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:36 devstack sudo[97870]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1f172387-0922-4109-8622-835a835eb793 tempest-CreateVolumesFromSnapshotTest-2114505382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-34059693-3be9-4635-a42d-3024199dd976.a6ff2c37-cbc1-4424-bad4-db4fa421d499" returned: 0 in 0.758s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1f172387-0922-4109-8622-835a835eb793 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-34059693-3be9-4635-a42d-3024199dd976.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:36 devstack sudo[97879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-34059693-3be9-4635-a42d-3024199dd976.info
Jul 03 01:13:36 devstack sudo[97879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:37 devstack sudo[97876]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9546b821-421f-4316-8df5-b5b90ee79778 tempest-SnapshotsActionsTest-647828101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.067b0c6e-073f-449b-9737-2b095d0f97de" returned: 0 in 0.825s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9546b821-421f-4316-8df5-b5b90ee79778 tempest-SnapshotsActionsTest-647828101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.067b0c6e-073f-449b-9737-2b095d0f97de {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:37 devstack sudo[97884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.067b0c6e-073f-449b-9737-2b095d0f97de
Jul 03 01:13:37 devstack sudo[97884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:37 devstack sudo[97879]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1f172387-0922-4109-8622-835a835eb793 tempest-CreateVolumesFromSnapshotTest-2114505382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-34059693-3be9-4635-a42d-3024199dd976.info" returned: 0 in 0.718s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:37 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-1f172387-0922-4109-8622-835a835eb793 tempest-CreateVolumesFromSnapshotTest-2114505382 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-34059693-3be9-4635-a42d-3024199dd976.info is being set with open permissions: ugo+rw
Jul 03 01:13:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1f172387-0922-4109-8622-835a835eb793 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-34059693-3be9-4635-a42d-3024199dd976.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:37 devstack sudo[97887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-34059693-3be9-4635-a42d-3024199dd976.info
Jul 03 01:13:37 devstack sudo[97887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:37 devstack sudo[97884]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9546b821-421f-4316-8df5-b5b90ee79778 tempest-SnapshotsActionsTest-647828101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.067b0c6e-073f-449b-9737-2b095d0f97de" returned: 0 in 0.714s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:37 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-9546b821-421f-4316-8df5-b5b90ee79778 tempest-SnapshotsActionsTest-647828101 None] Lock "cinder-quobyte-067b0c6e-073f-449b-9737-2b095d0f97de" released by "_delete_snapshot" :: held 3.562s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:13:37 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-9546b821-421f-4316-8df5-b5b90ee79778 tempest-SnapshotsActionsTest-647828101 None] Lock "cinder-quobyte-7d1b77c3-b58d-4c30-8075-2e237b09fdf4" released by "delete_snapshot" :: held 3.596s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:13:37 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-9546b821-421f-4316-8df5-b5b90ee79778 tempest-SnapshotsActionsTest-647828101 None] Created reservations ['8ed89653-fea3-4c92-a7d2-9eed7663946d', 'ac4c02fe-1244-43d1-b453-068f7cc16466', '01783366-3305-4336-b784-a552ac26de77', '64016758-3e2c-4ed6-91b4-700a07824912'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:13:38 devstack sudo[97887]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1f172387-0922-4109-8622-835a835eb793 tempest-CreateVolumesFromSnapshotTest-2114505382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-34059693-3be9-4635-a42d-3024199dd976.info" returned: 0 in 0.707s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1f172387-0922-4109-8622-835a835eb793 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.853s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:13:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f6eed494-131a-426b-bff8-14a44a6df8aa tempest-VolumesActionsTest-1547316290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.939s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:13:38 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-f6eed494-131a-426b-bff8-14a44a6df8aa tempest-VolumesActionsTest-1547316290 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:13:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2044460659',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b5fdd0a-8843-40f6-86d4-bd7ed30a2fa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d7c647a6e6746b1a1936d53da5b3c17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:13:33Z,use_quota=True,user_id='7892e5242ca34398b2945766f2cd4ae7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:13:38 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-f6eed494-131a-426b-bff8-14a44a6df8aa tempest-VolumesActionsTest-1547316290 None] Creating volume 3b5fdd0a-8843-40f6-86d4-bd7ed30a2fa4 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:13:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f6eed494-131a-426b-bff8-14a44a6df8aa tempest-VolumesActionsTest-1547316290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:13:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f6eed494-131a-426b-bff8-14a44a6df8aa tempest-VolumesActionsTest-1547316290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:13:38 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-f6eed494-131a-426b-bff8-14a44a6df8aa tempest-VolumesActionsTest-1547316290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:13:38 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-f6eed494-131a-426b-bff8-14a44a6df8aa tempest-VolumesActionsTest-1547316290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:13:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f6eed494-131a-426b-bff8-14a44a6df8aa tempest-VolumesActionsTest-1547316290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:13:38 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-f6eed494-131a-426b-bff8-14a44a6df8aa tempest-VolumesActionsTest-1547316290 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:13:38 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-f6eed494-131a-426b-bff8-14a44a6df8aa tempest-VolumesActionsTest-1547316290 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:13:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f6eed494-131a-426b-bff8-14a44a6df8aa tempest-VolumesActionsTest-1547316290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3b5fdd0a-8843-40f6-86d4-bd7ed30a2fa4 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:38 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-9546b821-421f-4316-8df5-b5b90ee79778 tempest-SnapshotsActionsTest-647828101 None] Delete snapshot completed successfully.
Jul 03 01:13:38 devstack sudo[97891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3b5fdd0a-8843-40f6-86d4-bd7ed30a2fa4 1073741824
Jul 03 01:13:38 devstack sudo[97891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:38 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-9546b821-421f-4316-8df5-b5b90ee79778 tempest-SnapshotsActionsTest-647828101 None] Lock "cinder-067b0c6e-073f-449b-9737-2b095d0f97de-delete_snapshot" released by "delete_snapshot" :: held 3.825s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:13:38 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-1f172387-0922-4109-8622-835a835eb793 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Create snapshot completed successfully
Jul 03 01:13:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-8ee70017-d3f4-4584-adbe-1bc7ea240f20 tempest-SnapshotsActionsTest-1724460990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:13:39 devstack sudo[97891]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f6eed494-131a-426b-bff8-14a44a6df8aa tempest-VolumesActionsTest-1547316290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3b5fdd0a-8843-40f6-86d4-bd7ed30a2fa4 1073741824" returned: 0 in 0.979s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f6eed494-131a-426b-bff8-14a44a6df8aa tempest-VolumesActionsTest-1547316290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3b5fdd0a-8843-40f6-86d4-bd7ed30a2fa4 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:39 devstack sudo[97898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3b5fdd0a-8843-40f6-86d4-bd7ed30a2fa4
Jul 03 01:13:39 devstack sudo[97898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:39 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f94261b-a2a6-4308-852a-260938c19abc tempest-VolumeRetypeWithoutMigrationTest-575059514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:13:39 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-6f94261b-a2a6-4308-852a-260938c19abc tempest-VolumeRetypeWithoutMigrationTest-575059514 None] Flow 'volume_create_manager' (385e5a7f-dbe0-4327-a025-9678df812b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:13:39 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-6f94261b-a2a6-4308-852a-260938c19abc tempest-VolumeRetypeWithoutMigrationTest-575059514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (907f68d2-e8a2-4a60-8697-7cc4fe6dbaa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:39 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-6f94261b-a2a6-4308-852a-260938c19abc tempest-VolumeRetypeWithoutMigrationTest-575059514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (907f68d2-e8a2-4a60-8697-7cc4fe6dbaa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:13:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1151800015',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0aab362b-f511-4f8c-806d-79a8b5a54539,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13f7a2786b834e6387aff497ae216008',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:13:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:13:39Z,use_quota=True,user_id='5e0ba14073554f6998cb8d4a6517d94e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d31553ab-06c0-423e-b3b2-5d5620074010),volume_type_id=d31553ab-06c0-423e-b3b2-5d5620074010)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:39 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-6f94261b-a2a6-4308-852a-260938c19abc tempest-VolumeRetypeWithoutMigrationTest-575059514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d503642-794d-4aff-af03-33f9bb771da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:39 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-6f94261b-a2a6-4308-852a-260938c19abc tempest-VolumeRetypeWithoutMigrationTest-575059514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d503642-794d-4aff-af03-33f9bb771da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:39 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-6f94261b-a2a6-4308-852a-260938c19abc tempest-VolumeRetypeWithoutMigrationTest-575059514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ab39a12-ecb5-41d4-9855-6693ec6fb24d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:39 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-6f94261b-a2a6-4308-852a-260938c19abc tempest-VolumeRetypeWithoutMigrationTest-575059514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ab39a12-ecb5-41d4-9855-6693ec6fb24d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0aab362b-f511-4f8c-806d-79a8b5a54539', 'volume_name': 'volume-0aab362b-f511-4f8c-806d-79a8b5a54539', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:39 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-6f94261b-a2a6-4308-852a-260938c19abc tempest-VolumeRetypeWithoutMigrationTest-575059514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7558bea6-47fc-4122-9ef4-be87d7339f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:39 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-6f94261b-a2a6-4308-852a-260938c19abc tempest-VolumeRetypeWithoutMigrationTest-575059514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7558bea6-47fc-4122-9ef4-be87d7339f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:39 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-6f94261b-a2a6-4308-852a-260938c19abc tempest-VolumeRetypeWithoutMigrationTest-575059514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6eb8fa7c-1373-4f9c-a434-30cd38052fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:39 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-6f94261b-a2a6-4308-852a-260938c19abc tempest-VolumeRetypeWithoutMigrationTest-575059514 None] Volume 0aab362b-f511-4f8c-806d-79a8b5a54539: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0aab362b-f511-4f8c-806d-79a8b5a54539', 'volume_size': 1}
Jul 03 01:13:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-6f94261b-a2a6-4308-852a-260938c19abc tempest-VolumeRetypeWithoutMigrationTest-575059514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:13:39 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-c534aa94-952d-463e-904b-7689901dc6c4 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:13:39 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c534aa94-952d-463e-904b-7689901dc6c4 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Flow 'volume_create_manager' (fa96455b-4b03-4454-b092-62b18c00d790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:13:39 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c534aa94-952d-463e-904b-7689901dc6c4 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfb07a66-aa3c-4ccb-8113-8e0c8d890fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:39 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c534aa94-952d-463e-904b-7689901dc6c4 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfb07a66-aa3c-4ccb-8113-8e0c8d890fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:13:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1822036453',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68a55ef7-a06e-4df0-83f9-d627d764ce96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28f7d14f35774094ab83f2325e539fc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:13:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:13:39Z,use_quota=True,user_id='11194d834b434291923696a28ccca89b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:39 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c534aa94-952d-463e-904b-7689901dc6c4 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37503ff2-d94c-483f-b63f-02585c22afe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:39 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c534aa94-952d-463e-904b-7689901dc6c4 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37503ff2-d94c-483f-b63f-02585c22afe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:39 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c534aa94-952d-463e-904b-7689901dc6c4 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c32e8af0-ced0-4eef-bfd0-b0fd06280663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:39 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c534aa94-952d-463e-904b-7689901dc6c4 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c32e8af0-ced0-4eef-bfd0-b0fd06280663) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68a55ef7-a06e-4df0-83f9-d627d764ce96', 'volume_name': 'volume-68a55ef7-a06e-4df0-83f9-d627d764ce96', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:39 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c534aa94-952d-463e-904b-7689901dc6c4 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31bc0779-52e0-4bf1-8c70-33cbb2f49cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:39 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c534aa94-952d-463e-904b-7689901dc6c4 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31bc0779-52e0-4bf1-8c70-33cbb2f49cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:39 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c534aa94-952d-463e-904b-7689901dc6c4 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e07b76a0-42e6-4d94-821e-1258b67224c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:39 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-c534aa94-952d-463e-904b-7689901dc6c4 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Volume 68a55ef7-a06e-4df0-83f9-d627d764ce96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68a55ef7-a06e-4df0-83f9-d627d764ce96', 'volume_size': 1}
Jul 03 01:13:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-c534aa94-952d-463e-904b-7689901dc6c4 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:13:39 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-402b5f04-c85a-4514-b15f-f9496455a41c tempest-CreateVolumesFromSnapshotTest-2114505382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:13:39 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-402b5f04-c85a-4514-b15f-f9496455a41c tempest-CreateVolumesFromSnapshotTest-2114505382 None] Flow 'volume_create_manager' (a045875f-d8f6-4302-a5cd-0361c1f01a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:13:39 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-402b5f04-c85a-4514-b15f-f9496455a41c tempest-CreateVolumesFromSnapshotTest-2114505382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42175080-bbea-4a07-a26a-aaeb70a0b99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:39 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-402b5f04-c85a-4514-b15f-f9496455a41c tempest-CreateVolumesFromSnapshotTest-2114505382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42175080-bbea-4a07-a26a-aaeb70a0b99f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:13:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-122541497',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf9e5812-73c4-4e12-ad2e-c50b2b5d238d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28f7d14f35774094ab83f2325e539fc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:13:40Z,use_quota=True,user_id='11194d834b434291923696a28ccca89b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:39 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-402b5f04-c85a-4514-b15f-f9496455a41c tempest-CreateVolumesFromSnapshotTest-2114505382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02f0d740-606c-458c-9f3a-dc954a559941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:39 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-402b5f04-c85a-4514-b15f-f9496455a41c tempest-CreateVolumesFromSnapshotTest-2114505382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02f0d740-606c-458c-9f3a-dc954a559941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:39 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-402b5f04-c85a-4514-b15f-f9496455a41c tempest-CreateVolumesFromSnapshotTest-2114505382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b9ab03c-f56a-4f8e-b1d9-efed33b4d318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:39 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-402b5f04-c85a-4514-b15f-f9496455a41c tempest-CreateVolumesFromSnapshotTest-2114505382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b9ab03c-f56a-4f8e-b1d9-efed33b4d318) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf9e5812-73c4-4e12-ad2e-c50b2b5d238d', 'volume_name': 'volume-bf9e5812-73c4-4e12-ad2e-c50b2b5d238d', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:39 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-402b5f04-c85a-4514-b15f-f9496455a41c tempest-CreateVolumesFromSnapshotTest-2114505382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3732e2b9-edc8-4f04-b513-779ae046e315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:39 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-402b5f04-c85a-4514-b15f-f9496455a41c tempest-CreateVolumesFromSnapshotTest-2114505382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3732e2b9-edc8-4f04-b513-779ae046e315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:39 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-402b5f04-c85a-4514-b15f-f9496455a41c tempest-CreateVolumesFromSnapshotTest-2114505382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6ea5fd9-d5c5-4606-bb30-9de215b73c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:39 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-402b5f04-c85a-4514-b15f-f9496455a41c tempest-CreateVolumesFromSnapshotTest-2114505382 None] Volume bf9e5812-73c4-4e12-ad2e-c50b2b5d238d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf9e5812-73c4-4e12-ad2e-c50b2b5d238d', 'volume_size': 1}
Jul 03 01:13:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-402b5f04-c85a-4514-b15f-f9496455a41c tempest-CreateVolumesFromSnapshotTest-2114505382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:13:39 devstack sudo[97898]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f6eed494-131a-426b-bff8-14a44a6df8aa tempest-VolumesActionsTest-1547316290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3b5fdd0a-8843-40f6-86d4-bd7ed30a2fa4" returned: 0 in 0.832s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:39 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-f6eed494-131a-426b-bff8-14a44a6df8aa tempest-VolumesActionsTest-1547316290 None] <== create_volume: return (1874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:13:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f6eed494-131a-426b-bff8-14a44a6df8aa tempest-VolumesActionsTest-1547316290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.877s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:13:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-8ee70017-d3f4-4584-adbe-1bc7ea240f20 tempest-SnapshotsActionsTest-1724460990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.123s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:13:39 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-8ee70017-d3f4-4584-adbe-1bc7ea240f20 tempest-SnapshotsActionsTest-1724460990 None] Creating offline snapshot 95dbe85d-8332-4bea-928a-89f1719e3400 of volume 7d1b77c3-b58d-4c30-8075-2e237b09fdf4 {{(pid=86891) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 01:13:40 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f6eed494-131a-426b-bff8-14a44a6df8aa tempest-VolumesActionsTest-1547316290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d650e9b-946a-452c-a9f3-14e0e874adb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b5fdd0a-8843-40f6-86d4-bd7ed30a2fa4', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:40 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f6eed494-131a-426b-bff8-14a44a6df8aa tempest-VolumesActionsTest-1547316290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2009e176-8d1b-4da3-ac10-3673fb87a43d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:40 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[685dd719-66d6-4abb-84a0-7778530498d2]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:13:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8ee70017-d3f4-4584-adbe-1bc7ea240f20 tempest-SnapshotsActionsTest-1724460990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb61df4c-825f-42e7-9372-b6ece8df5cee {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:40 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-f6eed494-131a-426b-bff8-14a44a6df8aa tempest-VolumesActionsTest-1547316290 None] Volume volume-3b5fdd0a-8843-40f6-86d4-bd7ed30a2fa4 (3b5fdd0a-8843-40f6-86d4-bd7ed30a2fa4): created successfully
Jul 03 01:13:40 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f6eed494-131a-426b-bff8-14a44a6df8aa tempest-VolumesActionsTest-1547316290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2009e176-8d1b-4da3-ac10-3673fb87a43d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:40 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f6eed494-131a-426b-bff8-14a44a6df8aa tempest-VolumesActionsTest-1547316290 None] Flow 'volume_create_manager' (0fc2b024-f3cf-484a-9d3f-2f833095db97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:13:40 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-f6eed494-131a-426b-bff8-14a44a6df8aa tempest-VolumesActionsTest-1547316290 None] Created volume successfully.
Jul 03 01:13:40 devstack sudo[97907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb61df4c-825f-42e7-9372-b6ece8df5cee
Jul 03 01:13:40 devstack sudo[97907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:40 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-b48aeeba-6606-4a72-a95b-c314c8fc1203 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:13:40 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b48aeeba-6606-4a72-a95b-c314c8fc1203 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Flow 'volume_create_manager' (680f402c-96ce-433f-a6ae-4bb220c4c29e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:13:40 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b48aeeba-6606-4a72-a95b-c314c8fc1203 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c10fb6a-a557-43d0-bf62-9b6ac39ea0a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:40 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b48aeeba-6606-4a72-a95b-c314c8fc1203 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c10fb6a-a557-43d0-bf62-9b6ac39ea0a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:13:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-369870073',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16a66c4c-b193-4d89-a0c2-f051dcb31fa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28f7d14f35774094ab83f2325e539fc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:13:40Z,use_quota=True,user_id='11194d834b434291923696a28ccca89b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:40 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b48aeeba-6606-4a72-a95b-c314c8fc1203 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a34e1bd4-528c-4ce1-ad91-082fdcc27211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:40 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b48aeeba-6606-4a72-a95b-c314c8fc1203 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a34e1bd4-528c-4ce1-ad91-082fdcc27211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:40 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b48aeeba-6606-4a72-a95b-c314c8fc1203 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c08cec39-965f-4806-9330-4de348777f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:40 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b48aeeba-6606-4a72-a95b-c314c8fc1203 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c08cec39-965f-4806-9330-4de348777f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16a66c4c-b193-4d89-a0c2-f051dcb31fa4', 'volume_name': 'volume-16a66c4c-b193-4d89-a0c2-f051dcb31fa4', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:40 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b48aeeba-6606-4a72-a95b-c314c8fc1203 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ace77e0-325c-47ef-9310-861ea8f2b94f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:40 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b48aeeba-6606-4a72-a95b-c314c8fc1203 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ace77e0-325c-47ef-9310-861ea8f2b94f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:40 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b48aeeba-6606-4a72-a95b-c314c8fc1203 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28deaced-de82-4e9a-953e-db743d263ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:40 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-b48aeeba-6606-4a72-a95b-c314c8fc1203 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Volume 16a66c4c-b193-4d89-a0c2-f051dcb31fa4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16a66c4c-b193-4d89-a0c2-f051dcb31fa4', 'volume_size': 1}
Jul 03 01:13:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b48aeeba-6606-4a72-a95b-c314c8fc1203 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:13:40 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-324a5693-5ecc-4356-bcb7-44fb6bb36ca2 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:13:40 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-324a5693-5ecc-4356-bcb7-44fb6bb36ca2 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Flow 'volume_create_manager' (0fbe7d5e-4b98-4d05-a06c-e80ea7e7d59b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:13:40 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-324a5693-5ecc-4356-bcb7-44fb6bb36ca2 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9034762-9e95-40b6-9841-5dd75361dd10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:40 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8153f3e5-fde9-43af-90b2-d5cb27915ed5 tempest-VolumesActionsTest-1293153765 None] Acquiring lock "cinder-3b5fdd0a-8843-40f6-86d4-bd7ed30a2fa4-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:13:40 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-324a5693-5ecc-4356-bcb7-44fb6bb36ca2 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9034762-9e95-40b6-9841-5dd75361dd10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:13:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1051876098',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4fac5f2-2564-4bc2-aeb5-2e55aab2081e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28f7d14f35774094ab83f2325e539fc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:13:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:13:41Z,use_quota=True,user_id='11194d834b434291923696a28ccca89b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:40 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-324a5693-5ecc-4356-bcb7-44fb6bb36ca2 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (020ce651-8e0e-417d-89cf-f34de90478b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:40 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-324a5693-5ecc-4356-bcb7-44fb6bb36ca2 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (020ce651-8e0e-417d-89cf-f34de90478b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:40 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-324a5693-5ecc-4356-bcb7-44fb6bb36ca2 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be39e932-7cb6-4f20-818c-159acf3da5b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:40 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-324a5693-5ecc-4356-bcb7-44fb6bb36ca2 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be39e932-7cb6-4f20-818c-159acf3da5b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4fac5f2-2564-4bc2-aeb5-2e55aab2081e', 'volume_name': 'volume-e4fac5f2-2564-4bc2-aeb5-2e55aab2081e', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:40 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-324a5693-5ecc-4356-bcb7-44fb6bb36ca2 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5cacb3f-45e5-48b3-a0b8-fe13d287a941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:40 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-324a5693-5ecc-4356-bcb7-44fb6bb36ca2 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5cacb3f-45e5-48b3-a0b8-fe13d287a941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:40 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-324a5693-5ecc-4356-bcb7-44fb6bb36ca2 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d12bcb45-909b-4802-8277-1cce7877b1ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:40 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-324a5693-5ecc-4356-bcb7-44fb6bb36ca2 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Volume e4fac5f2-2564-4bc2-aeb5-2e55aab2081e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4fac5f2-2564-4bc2-aeb5-2e55aab2081e', 'volume_size': 1}
Jul 03 01:13:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-324a5693-5ecc-4356-bcb7-44fb6bb36ca2 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:13:40 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8153f3e5-fde9-43af-90b2-d5cb27915ed5 tempest-VolumesActionsTest-1293153765 None] Lock "cinder-3b5fdd0a-8843-40f6-86d4-bd7ed30a2fa4-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:13:40 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8153f3e5-fde9-43af-90b2-d5cb27915ed5 tempest-VolumesActionsTest-1293153765 None] Acquiring lock "cinder-quobyte-3b5fdd0a-8843-40f6-86d4-bd7ed30a2fa4" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:13:40 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8153f3e5-fde9-43af-90b2-d5cb27915ed5 tempest-VolumesActionsTest-1293153765 None] Lock "cinder-quobyte-3b5fdd0a-8843-40f6-86d4-bd7ed30a2fa4" acquired by "delete_volume" :: waited 0.019s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:13:40 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a2b538-c511-4639-bf3a-bd4cc980befb]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:13:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8153f3e5-fde9-43af-90b2-d5cb27915ed5 tempest-VolumesActionsTest-1293153765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3b5fdd0a-8843-40f6-86d4-bd7ed30a2fa4 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:41 devstack sudo[97912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3b5fdd0a-8843-40f6-86d4-bd7ed30a2fa4
Jul 03 01:13:41 devstack sudo[97912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:41 devstack sudo[97907]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:41 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbb6de08-3ff8-4f55-b862-762792110e94 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:13:41 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bbb6de08-3ff8-4f55-b862-762792110e94 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Flow 'volume_create_manager' (c96c67fc-6190-4edc-bb47-dec3eed6d164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:13:41 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bbb6de08-3ff8-4f55-b862-762792110e94 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (595e6f36-81a4-4c0f-99e2-7f1f1946c30a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8ee70017-d3f4-4584-adbe-1bc7ea240f20 tempest-SnapshotsActionsTest-1724460990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb61df4c-825f-42e7-9372-b6ece8df5cee" returned: 0 in 1.083s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:41 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-8ee70017-d3f4-4584-adbe-1bc7ea240f20 tempest-SnapshotsActionsTest-1724460990 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:13:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8ee70017-d3f4-4584-adbe-1bc7ea240f20 tempest-SnapshotsActionsTest-1724460990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb61df4c-825f-42e7-9372-b6ece8df5cee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.95dbe85d-8332-4bea-928a-89f1719e3400 1G {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:41 devstack sudo[97914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb61df4c-825f-42e7-9372-b6ece8df5cee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.95dbe85d-8332-4bea-928a-89f1719e3400 1G
Jul 03 01:13:41 devstack sudo[97914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:41 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bbb6de08-3ff8-4f55-b862-762792110e94 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (595e6f36-81a4-4c0f-99e2-7f1f1946c30a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:13:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1393124536',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=462d5287-3c53-4e44-938a-574e4111379d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28f7d14f35774094ab83f2325e539fc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:13:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:13:41Z,use_quota=True,user_id='11194d834b434291923696a28ccca89b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:41 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bbb6de08-3ff8-4f55-b862-762792110e94 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43ab1a8a-8276-40a7-bc93-325fc71d4c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:41 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bbb6de08-3ff8-4f55-b862-762792110e94 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43ab1a8a-8276-40a7-bc93-325fc71d4c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:41 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bbb6de08-3ff8-4f55-b862-762792110e94 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d5ac75b-7e2f-41ee-a13f-b52b6deff1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:41 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bbb6de08-3ff8-4f55-b862-762792110e94 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d5ac75b-7e2f-41ee-a13f-b52b6deff1bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '462d5287-3c53-4e44-938a-574e4111379d', 'volume_name': 'volume-462d5287-3c53-4e44-938a-574e4111379d', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:41 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bbb6de08-3ff8-4f55-b862-762792110e94 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d91b52a-0ff7-4528-b5a2-a4369089e4d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:41 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bbb6de08-3ff8-4f55-b862-762792110e94 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d91b52a-0ff7-4528-b5a2-a4369089e4d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:41 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bbb6de08-3ff8-4f55-b862-762792110e94 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f24e3751-7b0a-4c90-aa09-5b78bbcff0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:41 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-bbb6de08-3ff8-4f55-b862-762792110e94 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Volume 462d5287-3c53-4e44-938a-574e4111379d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-462d5287-3c53-4e44-938a-574e4111379d', 'volume_size': 1}
Jul 03 01:13:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-bbb6de08-3ff8-4f55-b862-762792110e94 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:13:41 devstack sudo[97912]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8153f3e5-fde9-43af-90b2-d5cb27915ed5 tempest-VolumesActionsTest-1293153765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3b5fdd0a-8843-40f6-86d4-bd7ed30a2fa4" returned: 0 in 0.816s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8153f3e5-fde9-43af-90b2-d5cb27915ed5 tempest-VolumesActionsTest-1293153765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3b5fdd0a-8843-40f6-86d4-bd7ed30a2fa4 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:41 devstack sudo[97922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3b5fdd0a-8843-40f6-86d4-bd7ed30a2fa4
Jul 03 01:13:41 devstack sudo[97922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:41 devstack sudo[97914]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8ee70017-d3f4-4584-adbe-1bc7ea240f20 tempest-SnapshotsActionsTest-1724460990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb61df4c-825f-42e7-9372-b6ece8df5cee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.95dbe85d-8332-4bea-928a-89f1719e3400 1G" returned: 0 in 0.861s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8ee70017-d3f4-4584-adbe-1bc7ea240f20 tempest-SnapshotsActionsTest-1724460990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb61df4c-825f-42e7-9372-b6ece8df5cee -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.95dbe85d-8332-4bea-928a-89f1719e3400 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:42 devstack sudo[97925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb61df4c-825f-42e7-9372-b6ece8df5cee -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.95dbe85d-8332-4bea-928a-89f1719e3400
Jul 03 01:13:42 devstack sudo[97925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:42 devstack sudo[97922]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8153f3e5-fde9-43af-90b2-d5cb27915ed5 tempest-VolumesActionsTest-1293153765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3b5fdd0a-8843-40f6-86d4-bd7ed30a2fa4" returned: 0 in 0.691s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:42 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8153f3e5-fde9-43af-90b2-d5cb27915ed5 tempest-VolumesActionsTest-1293153765 None] Lock "cinder-quobyte-3b5fdd0a-8843-40f6-86d4-bd7ed30a2fa4" released by "delete_volume" :: held 1.573s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:13:42 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-8153f3e5-fde9-43af-90b2-d5cb27915ed5 tempest-VolumesActionsTest-1293153765 None] Created reservations ['d6939faf-27cb-410c-a30a-e2eb6c84de43', 'f493529b-fcb5-4fe0-9bef-3da50f0e2789', '25e5e9af-6f74-42e2-8ca3-899293a2f794', '6ea490d1-1462-441f-a807-ee52c79074eb'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:13:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-8153f3e5-fde9-43af-90b2-d5cb27915ed5 tempest-VolumesActionsTest-1293153765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:13:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-8153f3e5-fde9-43af-90b2-d5cb27915ed5 tempest-VolumesActionsTest-1293153765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:13:42 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-8153f3e5-fde9-43af-90b2-d5cb27915ed5 tempest-VolumesActionsTest-1293153765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:13:42 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-8153f3e5-fde9-43af-90b2-d5cb27915ed5 tempest-VolumesActionsTest-1293153765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:13:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-8153f3e5-fde9-43af-90b2-d5cb27915ed5 tempest-VolumesActionsTest-1293153765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:13:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8153f3e5-fde9-43af-90b2-d5cb27915ed5 tempest-VolumesActionsTest-1293153765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:42 devstack sudo[97932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:13:42 devstack sudo[97932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:42 devstack sudo[97925]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8ee70017-d3f4-4584-adbe-1bc7ea240f20 tempest-SnapshotsActionsTest-1724460990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb61df4c-825f-42e7-9372-b6ece8df5cee -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.95dbe85d-8332-4bea-928a-89f1719e3400" returned: 0 in 0.742s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:42 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-8ee70017-d3f4-4584-adbe-1bc7ea240f20 tempest-SnapshotsActionsTest-1724460990 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.95dbe85d-8332-4bea-928a-89f1719e3400 is being set with open permissions: ugo+rw
Jul 03 01:13:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8ee70017-d3f4-4584-adbe-1bc7ea240f20 tempest-SnapshotsActionsTest-1724460990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.95dbe85d-8332-4bea-928a-89f1719e3400 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:42 devstack sudo[97934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.95dbe85d-8332-4bea-928a-89f1719e3400
Jul 03 01:13:42 devstack sudo[97934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:43 devstack sudo[97932]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8153f3e5-fde9-43af-90b2-d5cb27915ed5 tempest-VolumesActionsTest-1293153765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.726s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:43 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-8153f3e5-fde9-43af-90b2-d5cb27915ed5 tempest-VolumesActionsTest-1293153765 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:13:43 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-8153f3e5-fde9-43af-90b2-d5cb27915ed5 tempest-VolumesActionsTest-1293153765 None] Deleted volume successfully.
Jul 03 01:13:43 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8153f3e5-fde9-43af-90b2-d5cb27915ed5 tempest-VolumesActionsTest-1293153765 None] Lock "cinder-3b5fdd0a-8843-40f6-86d4-bd7ed30a2fa4-delete_volume" released by "delete_volume" :: held 2.543s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:13:43 devstack sudo[97934]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8ee70017-d3f4-4584-adbe-1bc7ea240f20 tempest-SnapshotsActionsTest-1724460990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.95dbe85d-8332-4bea-928a-89f1719e3400" returned: 0 in 0.774s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:43 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-5672a6de-2eac-4290-9260-e8d755866071 tempest-VolumesActionsTest-1547316290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:13:43 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-5672a6de-2eac-4290-9260-e8d755866071 tempest-VolumesActionsTest-1547316290 None] Flow 'volume_create_manager' (75362e79-ca61-4309-a96a-4b9c4664a5af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:13:43 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-5672a6de-2eac-4290-9260-e8d755866071 tempest-VolumesActionsTest-1547316290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b11e56cc-bafa-4ab3-9f4c-ce95d00f8954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-8ee70017-d3f4-4584-adbe-1bc7ea240f20 tempest-SnapshotsActionsTest-1724460990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.633s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:13:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-6f94261b-a2a6-4308-852a-260938c19abc tempest-VolumeRetypeWithoutMigrationTest-575059514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.026s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:13:43 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-6f94261b-a2a6-4308-852a-260938c19abc tempest-VolumeRetypeWithoutMigrationTest-575059514 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:13:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1151800015',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0aab362b-f511-4f8c-806d-79a8b5a54539,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13f7a2786b834e6387aff497ae216008',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:13:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:13:39Z,use_quota=True,user_id='5e0ba14073554f6998cb8d4a6517d94e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d31553ab-06c0-423e-b3b2-5d5620074010),volume_type_id=d31553ab-06c0-423e-b3b2-5d5620074010)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:13:43 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-6f94261b-a2a6-4308-852a-260938c19abc tempest-VolumeRetypeWithoutMigrationTest-575059514 None] Creating volume 0aab362b-f511-4f8c-806d-79a8b5a54539 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:13:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-6f94261b-a2a6-4308-852a-260938c19abc tempest-VolumeRetypeWithoutMigrationTest-575059514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:13:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-6f94261b-a2a6-4308-852a-260938c19abc tempest-VolumeRetypeWithoutMigrationTest-575059514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:13:43 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-6f94261b-a2a6-4308-852a-260938c19abc tempest-VolumeRetypeWithoutMigrationTest-575059514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:13:43 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-6f94261b-a2a6-4308-852a-260938c19abc tempest-VolumeRetypeWithoutMigrationTest-575059514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:13:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-6f94261b-a2a6-4308-852a-260938c19abc tempest-VolumeRetypeWithoutMigrationTest-575059514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:13:43 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-6f94261b-a2a6-4308-852a-260938c19abc tempest-VolumeRetypeWithoutMigrationTest-575059514 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:13:43 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-6f94261b-a2a6-4308-852a-260938c19abc tempest-VolumeRetypeWithoutMigrationTest-575059514 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:13:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6f94261b-a2a6-4308-852a-260938c19abc tempest-VolumeRetypeWithoutMigrationTest-575059514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0aab362b-f511-4f8c-806d-79a8b5a54539 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:43 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-5672a6de-2eac-4290-9260-e8d755866071 tempest-VolumesActionsTest-1547316290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b11e56cc-bafa-4ab3-9f4c-ce95d00f8954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:13:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2074163140',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51fcc34f-f467-4695-a1a7-31a581705bd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d7c647a6e6746b1a1936d53da5b3c17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:13:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:13:43Z,use_quota=True,user_id='7892e5242ca34398b2945766f2cd4ae7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:43 devstack sudo[97938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0aab362b-f511-4f8c-806d-79a8b5a54539 1073741824
Jul 03 01:13:43 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-5672a6de-2eac-4290-9260-e8d755866071 tempest-VolumesActionsTest-1547316290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e36d045-ef29-4f61-b4d9-c72695c577aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:43 devstack sudo[97938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:43 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-5672a6de-2eac-4290-9260-e8d755866071 tempest-VolumesActionsTest-1547316290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e36d045-ef29-4f61-b4d9-c72695c577aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:43 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-5672a6de-2eac-4290-9260-e8d755866071 tempest-VolumesActionsTest-1547316290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5a2ab7b-8afa-46d5-8f0a-54034ce8216e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:43 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-5672a6de-2eac-4290-9260-e8d755866071 tempest-VolumesActionsTest-1547316290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5a2ab7b-8afa-46d5-8f0a-54034ce8216e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51fcc34f-f467-4695-a1a7-31a581705bd5', 'volume_name': 'volume-51fcc34f-f467-4695-a1a7-31a581705bd5', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:43 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-5672a6de-2eac-4290-9260-e8d755866071 tempest-VolumesActionsTest-1547316290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a589664-ff12-43af-920b-bda4f7ef0727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:43 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-5672a6de-2eac-4290-9260-e8d755866071 tempest-VolumesActionsTest-1547316290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a589664-ff12-43af-920b-bda4f7ef0727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:43 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-5672a6de-2eac-4290-9260-e8d755866071 tempest-VolumesActionsTest-1547316290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6be54d0-ea8e-450f-978b-443309b307ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:43 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-5672a6de-2eac-4290-9260-e8d755866071 tempest-VolumesActionsTest-1547316290 None] Volume 51fcc34f-f467-4695-a1a7-31a581705bd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51fcc34f-f467-4695-a1a7-31a581705bd5', 'volume_size': 1}
Jul 03 01:13:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-5672a6de-2eac-4290-9260-e8d755866071 tempest-VolumesActionsTest-1547316290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:13:43 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-8ee70017-d3f4-4584-adbe-1bc7ea240f20 tempest-SnapshotsActionsTest-1724460990 None] Create snapshot completed successfully
Jul 03 01:13:44 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-69d970f7-8f1b-4420-b92a-19382b6e070a tempest-SnapshotsActionsTest-647828101 None] Acquiring lock "cinder-95dbe85d-8332-4bea-928a-89f1719e3400-delete_snapshot" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:13:44 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-69d970f7-8f1b-4420-b92a-19382b6e070a tempest-SnapshotsActionsTest-647828101 None] Lock "cinder-95dbe85d-8332-4bea-928a-89f1719e3400-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:13:44 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-69d970f7-8f1b-4420-b92a-19382b6e070a tempest-SnapshotsActionsTest-647828101 None] Acquiring lock "cinder-quobyte-7d1b77c3-b58d-4c30-8075-2e237b09fdf4" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:13:44 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-69d970f7-8f1b-4420-b92a-19382b6e070a tempest-SnapshotsActionsTest-647828101 None] Lock "cinder-quobyte-7d1b77c3-b58d-4c30-8075-2e237b09fdf4" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:13:44 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-69d970f7-8f1b-4420-b92a-19382b6e070a tempest-SnapshotsActionsTest-647828101 None] Acquiring lock "cinder-quobyte-95dbe85d-8332-4bea-928a-89f1719e3400" by "_delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:13:44 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-69d970f7-8f1b-4420-b92a-19382b6e070a tempest-SnapshotsActionsTest-647828101 None] Lock "cinder-quobyte-95dbe85d-8332-4bea-928a-89f1719e3400" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:13:44 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-69d970f7-8f1b-4420-b92a-19382b6e070a tempest-SnapshotsActionsTest-647828101 None] Deleting offline snapshot 95dbe85d-8332-4bea-928a-89f1719e3400 of volume 7d1b77c3-b58d-4c30-8075-2e237b09fdf4 {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 01:13:44 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-69d970f7-8f1b-4420-b92a-19382b6e070a tempest-SnapshotsActionsTest-647828101 None] snapshot_file for this snap is: volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.95dbe85d-8332-4bea-928a-89f1719e3400 {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 01:13:44 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[bffe173a-97e1-4254-a41f-f27367991dd8]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:13:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-69d970f7-8f1b-4420-b92a-19382b6e070a tempest-SnapshotsActionsTest-647828101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.95dbe85d-8332-4bea-928a-89f1719e3400 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:44 devstack sudo[97944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.95dbe85d-8332-4bea-928a-89f1719e3400
Jul 03 01:13:44 devstack sudo[97944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:44 devstack sudo[97938]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6f94261b-a2a6-4308-852a-260938c19abc tempest-VolumeRetypeWithoutMigrationTest-575059514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0aab362b-f511-4f8c-806d-79a8b5a54539 1073741824" returned: 0 in 0.886s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6f94261b-a2a6-4308-852a-260938c19abc tempest-VolumeRetypeWithoutMigrationTest-575059514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0aab362b-f511-4f8c-806d-79a8b5a54539 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:44 devstack sudo[97946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0aab362b-f511-4f8c-806d-79a8b5a54539
Jul 03 01:13:44 devstack sudo[97946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:45 devstack sudo[97944]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-69d970f7-8f1b-4420-b92a-19382b6e070a tempest-SnapshotsActionsTest-647828101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.95dbe85d-8332-4bea-928a-89f1719e3400" returned: 0 in 0.813s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:45 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-69d970f7-8f1b-4420-b92a-19382b6e070a tempest-SnapshotsActionsTest-647828101 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:13:45 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc77f304-e363-4666-b1e8-e8bda4c8baae]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:13:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-69d970f7-8f1b-4420-b92a-19382b6e070a tempest-SnapshotsActionsTest-647828101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb61df4c-825f-42e7-9372-b6ece8df5cee {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:45 devstack sudo[97946]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6f94261b-a2a6-4308-852a-260938c19abc tempest-VolumeRetypeWithoutMigrationTest-575059514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0aab362b-f511-4f8c-806d-79a8b5a54539" returned: 0 in 0.665s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:45 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-6f94261b-a2a6-4308-852a-260938c19abc tempest-VolumeRetypeWithoutMigrationTest-575059514 None] <== create_volume: return (1604ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:13:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-6f94261b-a2a6-4308-852a-260938c19abc tempest-VolumeRetypeWithoutMigrationTest-575059514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.609s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:13:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-c534aa94-952d-463e-904b-7689901dc6c4 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.527s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:13:45 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-c534aa94-952d-463e-904b-7689901dc6c4 tempest-CreateVolumesFromSnapshotTest-2114505382 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:13:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1822036453',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68a55ef7-a06e-4df0-83f9-d627d764ce96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28f7d14f35774094ab83f2325e539fc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:13:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:13:39Z,use_quota=True,user_id='11194d834b434291923696a28ccca89b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:13:45 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-c534aa94-952d-463e-904b-7689901dc6c4 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Creating volume 68a55ef7-a06e-4df0-83f9-d627d764ce96 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:13:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-c534aa94-952d-463e-904b-7689901dc6c4 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:13:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-c534aa94-952d-463e-904b-7689901dc6c4 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:13:45 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-c534aa94-952d-463e-904b-7689901dc6c4 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:13:45 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-c534aa94-952d-463e-904b-7689901dc6c4 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:13:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-c534aa94-952d-463e-904b-7689901dc6c4 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:13:45 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-c534aa94-952d-463e-904b-7689901dc6c4 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:13:45 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-c534aa94-952d-463e-904b-7689901dc6c4 tempest-CreateVolumesFromSnapshotTest-2114505382 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:13:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c534aa94-952d-463e-904b-7689901dc6c4 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-68a55ef7-a06e-4df0-83f9-d627d764ce96 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:45 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-6f94261b-a2a6-4308-852a-260938c19abc tempest-VolumeRetypeWithoutMigrationTest-575059514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6eb8fa7c-1373-4f9c-a434-30cd38052fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0aab362b-f511-4f8c-806d-79a8b5a54539', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:45 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-6f94261b-a2a6-4308-852a-260938c19abc tempest-VolumeRetypeWithoutMigrationTest-575059514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33c11803-9aa3-4466-8c60-8bcf53a866fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:45 devstack sudo[97953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-68a55ef7-a06e-4df0-83f9-d627d764ce96 1073741824
Jul 03 01:13:45 devstack sudo[97953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:45 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-6f94261b-a2a6-4308-852a-260938c19abc tempest-VolumeRetypeWithoutMigrationTest-575059514 None] Volume volume-0aab362b-f511-4f8c-806d-79a8b5a54539 (0aab362b-f511-4f8c-806d-79a8b5a54539): created successfully
Jul 03 01:13:45 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-6f94261b-a2a6-4308-852a-260938c19abc tempest-VolumeRetypeWithoutMigrationTest-575059514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33c11803-9aa3-4466-8c60-8bcf53a866fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:45 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-6f94261b-a2a6-4308-852a-260938c19abc tempest-VolumeRetypeWithoutMigrationTest-575059514 None] Flow 'volume_create_manager' (385e5a7f-dbe0-4327-a025-9678df812b60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:13:45 devstack sudo[97952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb61df4c-825f-42e7-9372-b6ece8df5cee
Jul 03 01:13:45 devstack sudo[97952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:45 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-6f94261b-a2a6-4308-852a-260938c19abc tempest-VolumeRetypeWithoutMigrationTest-575059514 None] Created volume successfully.
Jul 03 01:13:45 devstack sudo[97952]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-69d970f7-8f1b-4420-b92a-19382b6e070a tempest-SnapshotsActionsTest-647828101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb61df4c-825f-42e7-9372-b6ece8df5cee" returned: 0 in 0.818s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:45 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-69d970f7-8f1b-4420-b92a-19382b6e070a tempest-SnapshotsActionsTest-647828101 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:13:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-69d970f7-8f1b-4420-b92a-19382b6e070a tempest-SnapshotsActionsTest-647828101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.95dbe85d-8332-4bea-928a-89f1719e3400 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-258a2e30-7610-4825-a7b2-46458fc11492 tempest-VolumeRetypeWithoutMigrationTest-575059514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:13:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-258a2e30-7610-4825-a7b2-46458fc11492 tempest-VolumeRetypeWithoutMigrationTest-575059514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:13:46 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-258a2e30-7610-4825-a7b2-46458fc11492 tempest-VolumeRetypeWithoutMigrationTest-575059514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:13:46 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-258a2e30-7610-4825-a7b2-46458fc11492 tempest-VolumeRetypeWithoutMigrationTest-575059514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:13:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-258a2e30-7610-4825-a7b2-46458fc11492 tempest-VolumeRetypeWithoutMigrationTest-575059514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:13:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-258a2e30-7610-4825-a7b2-46458fc11492 tempest-VolumeRetypeWithoutMigrationTest-575059514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:46 devstack sudo[97963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.95dbe85d-8332-4bea-928a-89f1719e3400
Jul 03 01:13:46 devstack sudo[97963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:46 devstack sudo[97965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:13:46 devstack sudo[97965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:46 devstack sudo[97953]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c534aa94-952d-463e-904b-7689901dc6c4 tempest-CreateVolumesFromSnapshotTest-2114505382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-68a55ef7-a06e-4df0-83f9-d627d764ce96 1073741824" returned: 0 in 0.928s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c534aa94-952d-463e-904b-7689901dc6c4 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-68a55ef7-a06e-4df0-83f9-d627d764ce96 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:46 devstack sudo[97967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-68a55ef7-a06e-4df0-83f9-d627d764ce96
Jul 03 01:13:46 devstack sudo[97967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:46 devstack sudo[97965]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-258a2e30-7610-4825-a7b2-46458fc11492 tempest-VolumeRetypeWithoutMigrationTest-575059514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.673s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:46 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-258a2e30-7610-4825-a7b2-46458fc11492 tempest-VolumeRetypeWithoutMigrationTest-575059514 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:13:46 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-258a2e30-7610-4825-a7b2-46458fc11492 tempest-VolumeRetypeWithoutMigrationTest-575059514 None] Retype volume completed successfully.
Jul 03 01:13:46 devstack sudo[97963]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-69d970f7-8f1b-4420-b92a-19382b6e070a tempest-SnapshotsActionsTest-647828101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.95dbe85d-8332-4bea-928a-89f1719e3400" returned: 0 in 0.840s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-69d970f7-8f1b-4420-b92a-19382b6e070a tempest-SnapshotsActionsTest-647828101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.95dbe85d-8332-4bea-928a-89f1719e3400 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:46 devstack sudo[97975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.95dbe85d-8332-4bea-928a-89f1719e3400
Jul 03 01:13:46 devstack sudo[97975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:46 devstack sudo[97967]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c534aa94-952d-463e-904b-7689901dc6c4 tempest-CreateVolumesFromSnapshotTest-2114505382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-68a55ef7-a06e-4df0-83f9-d627d764ce96" returned: 0 in 0.732s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:46 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-c534aa94-952d-463e-904b-7689901dc6c4 tempest-CreateVolumesFromSnapshotTest-2114505382 None] <== create_volume: return (1707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:13:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-c534aa94-952d-463e-904b-7689901dc6c4 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.711s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:13:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-402b5f04-c85a-4514-b15f-f9496455a41c tempest-CreateVolumesFromSnapshotTest-2114505382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.049s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:13:46 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-402b5f04-c85a-4514-b15f-f9496455a41c tempest-CreateVolumesFromSnapshotTest-2114505382 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:13:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-122541497',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf9e5812-73c4-4e12-ad2e-c50b2b5d238d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28f7d14f35774094ab83f2325e539fc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:13:40Z,use_quota=True,user_id='11194d834b434291923696a28ccca89b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:13:46 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-402b5f04-c85a-4514-b15f-f9496455a41c tempest-CreateVolumesFromSnapshotTest-2114505382 None] Creating volume bf9e5812-73c4-4e12-ad2e-c50b2b5d238d {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:13:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-402b5f04-c85a-4514-b15f-f9496455a41c tempest-CreateVolumesFromSnapshotTest-2114505382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:13:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-402b5f04-c85a-4514-b15f-f9496455a41c tempest-CreateVolumesFromSnapshotTest-2114505382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:13:46 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-402b5f04-c85a-4514-b15f-f9496455a41c tempest-CreateVolumesFromSnapshotTest-2114505382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:13:46 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-402b5f04-c85a-4514-b15f-f9496455a41c tempest-CreateVolumesFromSnapshotTest-2114505382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:13:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-402b5f04-c85a-4514-b15f-f9496455a41c tempest-CreateVolumesFromSnapshotTest-2114505382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:13:46 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-402b5f04-c85a-4514-b15f-f9496455a41c tempest-CreateVolumesFromSnapshotTest-2114505382 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:13:46 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-402b5f04-c85a-4514-b15f-f9496455a41c tempest-CreateVolumesFromSnapshotTest-2114505382 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:13:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-402b5f04-c85a-4514-b15f-f9496455a41c tempest-CreateVolumesFromSnapshotTest-2114505382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-bf9e5812-73c4-4e12-ad2e-c50b2b5d238d 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:46 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c534aa94-952d-463e-904b-7689901dc6c4 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e07b76a0-42e6-4d94-821e-1258b67224c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68a55ef7-a06e-4df0-83f9-d627d764ce96', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:46 devstack sudo[97977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-bf9e5812-73c4-4e12-ad2e-c50b2b5d238d 1073741824
Jul 03 01:13:46 devstack sudo[97977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:46 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c534aa94-952d-463e-904b-7689901dc6c4 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f061103e-b06c-4693-ac3b-dad945cc7980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:46 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-c534aa94-952d-463e-904b-7689901dc6c4 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Volume volume-68a55ef7-a06e-4df0-83f9-d627d764ce96 (68a55ef7-a06e-4df0-83f9-d627d764ce96): created successfully
Jul 03 01:13:46 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c534aa94-952d-463e-904b-7689901dc6c4 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f061103e-b06c-4693-ac3b-dad945cc7980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:46 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c534aa94-952d-463e-904b-7689901dc6c4 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Flow 'volume_create_manager' (fa96455b-4b03-4454-b092-62b18c00d790) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:13:47 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-c534aa94-952d-463e-904b-7689901dc6c4 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Created volume successfully.
Jul 03 01:13:47 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-03481337-0e28-4dcc-b0bc-7c51d821ae0a tempest-VolumeRetypeWithoutMigrationTest-575059514 None] Acquiring lock "cinder-0aab362b-f511-4f8c-806d-79a8b5a54539-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:13:47 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-03481337-0e28-4dcc-b0bc-7c51d821ae0a tempest-VolumeRetypeWithoutMigrationTest-575059514 None] Lock "cinder-0aab362b-f511-4f8c-806d-79a8b5a54539-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:13:47 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-03481337-0e28-4dcc-b0bc-7c51d821ae0a tempest-VolumeRetypeWithoutMigrationTest-575059514 None] Acquiring lock "cinder-quobyte-0aab362b-f511-4f8c-806d-79a8b5a54539" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:13:47 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-03481337-0e28-4dcc-b0bc-7c51d821ae0a tempest-VolumeRetypeWithoutMigrationTest-575059514 None] Lock "cinder-quobyte-0aab362b-f511-4f8c-806d-79a8b5a54539" acquired by "delete_volume" :: waited 0.020s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:13:47 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b82bec0-52f9-46c2-b0de-c59bc884e1a5]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:13:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-03481337-0e28-4dcc-b0bc-7c51d821ae0a tempest-VolumeRetypeWithoutMigrationTest-575059514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0aab362b-f511-4f8c-806d-79a8b5a54539 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:47 devstack sudo[97979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0aab362b-f511-4f8c-806d-79a8b5a54539
Jul 03 01:13:47 devstack sudo[97979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:47 devstack sudo[97975]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-69d970f7-8f1b-4420-b92a-19382b6e070a tempest-SnapshotsActionsTest-647828101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.95dbe85d-8332-4bea-928a-89f1719e3400" returned: 0 in 0.739s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:47 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-69d970f7-8f1b-4420-b92a-19382b6e070a tempest-SnapshotsActionsTest-647828101 None] Lock "cinder-quobyte-95dbe85d-8332-4bea-928a-89f1719e3400" released by "_delete_snapshot" :: held 3.318s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:13:47 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-69d970f7-8f1b-4420-b92a-19382b6e070a tempest-SnapshotsActionsTest-647828101 None] Lock "cinder-quobyte-7d1b77c3-b58d-4c30-8075-2e237b09fdf4" released by "delete_snapshot" :: held 3.341s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:13:47 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-69d970f7-8f1b-4420-b92a-19382b6e070a tempest-SnapshotsActionsTest-647828101 None] Created reservations ['8ee194f5-993c-4029-b29f-4c736cde28da', '7737b57b-a123-40b1-8b0b-a4e51212a96d', '96eb59e3-ec8c-42c8-b6d5-08eaaae07d27', '1f72f669-4ba6-48bf-ac3b-b9fab84c0f71'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:13:47 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-69d970f7-8f1b-4420-b92a-19382b6e070a tempest-SnapshotsActionsTest-647828101 None] Delete snapshot completed successfully.
Jul 03 01:13:47 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-69d970f7-8f1b-4420-b92a-19382b6e070a tempest-SnapshotsActionsTest-647828101 None] Lock "cinder-95dbe85d-8332-4bea-928a-89f1719e3400-delete_snapshot" released by "delete_snapshot" :: held 3.511s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:13:47 devstack sudo[97977]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-402b5f04-c85a-4514-b15f-f9496455a41c tempest-CreateVolumesFromSnapshotTest-2114505382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-bf9e5812-73c4-4e12-ad2e-c50b2b5d238d 1073741824" returned: 0 in 0.976s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-402b5f04-c85a-4514-b15f-f9496455a41c tempest-CreateVolumesFromSnapshotTest-2114505382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-bf9e5812-73c4-4e12-ad2e-c50b2b5d238d {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:47 devstack sudo[97985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-bf9e5812-73c4-4e12-ad2e-c50b2b5d238d
Jul 03 01:13:47 devstack sudo[97985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:48 devstack sudo[97979]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-03481337-0e28-4dcc-b0bc-7c51d821ae0a tempest-VolumeRetypeWithoutMigrationTest-575059514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0aab362b-f511-4f8c-806d-79a8b5a54539" returned: 0 in 0.806s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-03481337-0e28-4dcc-b0bc-7c51d821ae0a tempest-VolumeRetypeWithoutMigrationTest-575059514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0aab362b-f511-4f8c-806d-79a8b5a54539 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:48 devstack sudo[97991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0aab362b-f511-4f8c-806d-79a8b5a54539
Jul 03 01:13:48 devstack sudo[97991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:48 devstack sudo[97985]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-402b5f04-c85a-4514-b15f-f9496455a41c tempest-CreateVolumesFromSnapshotTest-2114505382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-bf9e5812-73c4-4e12-ad2e-c50b2b5d238d" returned: 0 in 0.695s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:48 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-402b5f04-c85a-4514-b15f-f9496455a41c tempest-CreateVolumesFromSnapshotTest-2114505382 None] <== create_volume: return (1715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:13:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-402b5f04-c85a-4514-b15f-f9496455a41c tempest-CreateVolumesFromSnapshotTest-2114505382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.720s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:13:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b48aeeba-6606-4a72-a95b-c314c8fc1203 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.373s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:13:48 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-b48aeeba-6606-4a72-a95b-c314c8fc1203 tempest-CreateVolumesFromSnapshotTest-2114505382 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:13:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-369870073',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16a66c4c-b193-4d89-a0c2-f051dcb31fa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28f7d14f35774094ab83f2325e539fc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:13:40Z,use_quota=True,user_id='11194d834b434291923696a28ccca89b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:13:48 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-b48aeeba-6606-4a72-a95b-c314c8fc1203 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Creating volume 16a66c4c-b193-4d89-a0c2-f051dcb31fa4 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:13:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b48aeeba-6606-4a72-a95b-c314c8fc1203 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:13:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b48aeeba-6606-4a72-a95b-c314c8fc1203 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:13:48 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-b48aeeba-6606-4a72-a95b-c314c8fc1203 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:13:48 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-b48aeeba-6606-4a72-a95b-c314c8fc1203 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:13:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b48aeeba-6606-4a72-a95b-c314c8fc1203 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:13:48 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-b48aeeba-6606-4a72-a95b-c314c8fc1203 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:13:48 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-b48aeeba-6606-4a72-a95b-c314c8fc1203 tempest-CreateVolumesFromSnapshotTest-2114505382 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:13:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b48aeeba-6606-4a72-a95b-c314c8fc1203 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-16a66c4c-b193-4d89-a0c2-f051dcb31fa4 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:48 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-402b5f04-c85a-4514-b15f-f9496455a41c tempest-CreateVolumesFromSnapshotTest-2114505382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6ea5fd9-d5c5-4606-bb30-9de215b73c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf9e5812-73c4-4e12-ad2e-c50b2b5d238d', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:48 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-402b5f04-c85a-4514-b15f-f9496455a41c tempest-CreateVolumesFromSnapshotTest-2114505382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79001c60-756d-4a58-83ae-7d9d50bd367a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:48 devstack sudo[97994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-16a66c4c-b193-4d89-a0c2-f051dcb31fa4 1073741824
Jul 03 01:13:48 devstack sudo[97994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:48 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-402b5f04-c85a-4514-b15f-f9496455a41c tempest-CreateVolumesFromSnapshotTest-2114505382 None] Volume volume-bf9e5812-73c4-4e12-ad2e-c50b2b5d238d (bf9e5812-73c4-4e12-ad2e-c50b2b5d238d): created successfully
Jul 03 01:13:48 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-402b5f04-c85a-4514-b15f-f9496455a41c tempest-CreateVolumesFromSnapshotTest-2114505382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79001c60-756d-4a58-83ae-7d9d50bd367a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:48 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-402b5f04-c85a-4514-b15f-f9496455a41c tempest-CreateVolumesFromSnapshotTest-2114505382 None] Flow 'volume_create_manager' (a045875f-d8f6-4302-a5cd-0361c1f01a80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:13:48 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-402b5f04-c85a-4514-b15f-f9496455a41c tempest-CreateVolumesFromSnapshotTest-2114505382 None] Created volume successfully.
Jul 03 01:13:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-cccf8253-3aba-4d19-b660-297fc5932bf0 tempest-SnapshotsActionsTest-1724460990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:13:48 devstack sudo[97991]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-03481337-0e28-4dcc-b0bc-7c51d821ae0a tempest-VolumeRetypeWithoutMigrationTest-575059514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0aab362b-f511-4f8c-806d-79a8b5a54539" returned: 0 in 0.695s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:48 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-03481337-0e28-4dcc-b0bc-7c51d821ae0a tempest-VolumeRetypeWithoutMigrationTest-575059514 None] Lock "cinder-quobyte-0aab362b-f511-4f8c-806d-79a8b5a54539" released by "delete_volume" :: held 1.558s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:13:48 devstack cinder-volume[86891]: WARNING cinder.quota [None req-03481337-0e28-4dcc-b0bc-7c51d821ae0a tempest-VolumeRetypeWithoutMigrationTest-575059514 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jul 03 01:13:48 devstack cinder-volume[86891]: WARNING cinder.quota [None req-03481337-0e28-4dcc-b0bc-7c51d821ae0a tempest-VolumeRetypeWithoutMigrationTest-575059514 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jul 03 01:13:48 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-03481337-0e28-4dcc-b0bc-7c51d821ae0a tempest-VolumeRetypeWithoutMigrationTest-575059514 None] Created reservations ['952eb6a3-69c6-401c-a2ca-0d7e26016586', '639d66be-284e-4599-b840-74f6d33db988', '202de3e4-3d9c-44cf-a886-b014f369ccfb', 'be45821d-d6aa-4e49-9242-5405d6e631e2'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:13:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-03481337-0e28-4dcc-b0bc-7c51d821ae0a tempest-VolumeRetypeWithoutMigrationTest-575059514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:13:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-03481337-0e28-4dcc-b0bc-7c51d821ae0a tempest-VolumeRetypeWithoutMigrationTest-575059514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:13:49 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-03481337-0e28-4dcc-b0bc-7c51d821ae0a tempest-VolumeRetypeWithoutMigrationTest-575059514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:13:49 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-03481337-0e28-4dcc-b0bc-7c51d821ae0a tempest-VolumeRetypeWithoutMigrationTest-575059514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:13:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-03481337-0e28-4dcc-b0bc-7c51d821ae0a tempest-VolumeRetypeWithoutMigrationTest-575059514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:13:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-03481337-0e28-4dcc-b0bc-7c51d821ae0a tempest-VolumeRetypeWithoutMigrationTest-575059514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:49 devstack sudo[97997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:13:49 devstack sudo[97997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:49 devstack sudo[97994]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b48aeeba-6606-4a72-a95b-c314c8fc1203 tempest-CreateVolumesFromSnapshotTest-2114505382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-16a66c4c-b193-4d89-a0c2-f051dcb31fa4 1073741824" returned: 0 in 0.903s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b48aeeba-6606-4a72-a95b-c314c8fc1203 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-16a66c4c-b193-4d89-a0c2-f051dcb31fa4 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:49 devstack sudo[98003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-16a66c4c-b193-4d89-a0c2-f051dcb31fa4
Jul 03 01:13:49 devstack sudo[98003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:49 devstack sudo[97997]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-03481337-0e28-4dcc-b0bc-7c51d821ae0a tempest-VolumeRetypeWithoutMigrationTest-575059514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.707s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:49 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-03481337-0e28-4dcc-b0bc-7c51d821ae0a tempest-VolumeRetypeWithoutMigrationTest-575059514 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:13:49 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-03481337-0e28-4dcc-b0bc-7c51d821ae0a tempest-VolumeRetypeWithoutMigrationTest-575059514 None] Deleted volume successfully.
Jul 03 01:13:49 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-03481337-0e28-4dcc-b0bc-7c51d821ae0a tempest-VolumeRetypeWithoutMigrationTest-575059514 None] Lock "cinder-0aab362b-f511-4f8c-806d-79a8b5a54539-delete_volume" released by "delete_volume" :: held 2.515s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:13:50 devstack sudo[98003]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b48aeeba-6606-4a72-a95b-c314c8fc1203 tempest-CreateVolumesFromSnapshotTest-2114505382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-16a66c4c-b193-4d89-a0c2-f051dcb31fa4" returned: 0 in 0.698s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:50 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-b48aeeba-6606-4a72-a95b-c314c8fc1203 tempest-CreateVolumesFromSnapshotTest-2114505382 None] <== create_volume: return (1664ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:13:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b48aeeba-6606-4a72-a95b-c314c8fc1203 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.669s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:13:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-324a5693-5ecc-4356-bcb7-44fb6bb36ca2 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.504s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:13:50 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-324a5693-5ecc-4356-bcb7-44fb6bb36ca2 tempest-CreateVolumesFromSnapshotTest-2114505382 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:13:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1051876098',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4fac5f2-2564-4bc2-aeb5-2e55aab2081e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28f7d14f35774094ab83f2325e539fc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:13:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:13:41Z,use_quota=True,user_id='11194d834b434291923696a28ccca89b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:13:50 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-324a5693-5ecc-4356-bcb7-44fb6bb36ca2 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Creating volume e4fac5f2-2564-4bc2-aeb5-2e55aab2081e {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:13:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-324a5693-5ecc-4356-bcb7-44fb6bb36ca2 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:13:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-324a5693-5ecc-4356-bcb7-44fb6bb36ca2 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:13:50 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-324a5693-5ecc-4356-bcb7-44fb6bb36ca2 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:13:50 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-324a5693-5ecc-4356-bcb7-44fb6bb36ca2 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:13:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-324a5693-5ecc-4356-bcb7-44fb6bb36ca2 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:13:50 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-324a5693-5ecc-4356-bcb7-44fb6bb36ca2 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:13:50 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-324a5693-5ecc-4356-bcb7-44fb6bb36ca2 tempest-CreateVolumesFromSnapshotTest-2114505382 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:13:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-324a5693-5ecc-4356-bcb7-44fb6bb36ca2 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e4fac5f2-2564-4bc2-aeb5-2e55aab2081e 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:50 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b48aeeba-6606-4a72-a95b-c314c8fc1203 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28deaced-de82-4e9a-953e-db743d263ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16a66c4c-b193-4d89-a0c2-f051dcb31fa4', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:50 devstack sudo[98006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e4fac5f2-2564-4bc2-aeb5-2e55aab2081e 1073741824
Jul 03 01:13:50 devstack sudo[98006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:50 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b48aeeba-6606-4a72-a95b-c314c8fc1203 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dce0dc3-da1a-44d4-afdf-d594b3806a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:50 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-b48aeeba-6606-4a72-a95b-c314c8fc1203 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Volume volume-16a66c4c-b193-4d89-a0c2-f051dcb31fa4 (16a66c4c-b193-4d89-a0c2-f051dcb31fa4): created successfully
Jul 03 01:13:50 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b48aeeba-6606-4a72-a95b-c314c8fc1203 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dce0dc3-da1a-44d4-afdf-d594b3806a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:50 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b48aeeba-6606-4a72-a95b-c314c8fc1203 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Flow 'volume_create_manager' (680f402c-96ce-433f-a6ae-4bb220c4c29e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:13:50 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-b48aeeba-6606-4a72-a95b-c314c8fc1203 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Created volume successfully.
Jul 03 01:13:51 devstack sudo[98006]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:51 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-324a5693-5ecc-4356-bcb7-44fb6bb36ca2 tempest-CreateVolumesFromSnapshotTest-2114505382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e4fac5f2-2564-4bc2-aeb5-2e55aab2081e 1073741824" returned: 0 in 0.877s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:51 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-324a5693-5ecc-4356-bcb7-44fb6bb36ca2 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e4fac5f2-2564-4bc2-aeb5-2e55aab2081e {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:51 devstack sudo[98012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e4fac5f2-2564-4bc2-aeb5-2e55aab2081e
Jul 03 01:13:51 devstack sudo[98012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:51 devstack sudo[98012]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:51 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-324a5693-5ecc-4356-bcb7-44fb6bb36ca2 tempest-CreateVolumesFromSnapshotTest-2114505382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e4fac5f2-2564-4bc2-aeb5-2e55aab2081e" returned: 0 in 0.725s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:51 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-324a5693-5ecc-4356-bcb7-44fb6bb36ca2 tempest-CreateVolumesFromSnapshotTest-2114505382 None] <== create_volume: return (1661ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:13:51 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-324a5693-5ecc-4356-bcb7-44fb6bb36ca2 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.665s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:13:51 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-bbb6de08-3ff8-4f55-b862-762792110e94 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.803s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:13:51 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-bbb6de08-3ff8-4f55-b862-762792110e94 tempest-CreateVolumesFromSnapshotTest-2114505382 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:13:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1393124536',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=462d5287-3c53-4e44-938a-574e4111379d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28f7d14f35774094ab83f2325e539fc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:13:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:13:41Z,use_quota=True,user_id='11194d834b434291923696a28ccca89b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:13:52 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-bbb6de08-3ff8-4f55-b862-762792110e94 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Creating volume 462d5287-3c53-4e44-938a-574e4111379d {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:13:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-bbb6de08-3ff8-4f55-b862-762792110e94 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:13:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-bbb6de08-3ff8-4f55-b862-762792110e94 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:13:52 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-bbb6de08-3ff8-4f55-b862-762792110e94 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:13:52 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-bbb6de08-3ff8-4f55-b862-762792110e94 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:13:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-bbb6de08-3ff8-4f55-b862-762792110e94 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:13:52 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-bbb6de08-3ff8-4f55-b862-762792110e94 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:13:52 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-bbb6de08-3ff8-4f55-b862-762792110e94 tempest-CreateVolumesFromSnapshotTest-2114505382 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:13:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bbb6de08-3ff8-4f55-b862-762792110e94 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-462d5287-3c53-4e44-938a-574e4111379d 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:52 devstack sudo[98015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-462d5287-3c53-4e44-938a-574e4111379d 1073741824
Jul 03 01:13:52 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-324a5693-5ecc-4356-bcb7-44fb6bb36ca2 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d12bcb45-909b-4802-8277-1cce7877b1ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4fac5f2-2564-4bc2-aeb5-2e55aab2081e', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:52 devstack sudo[98015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:52 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-324a5693-5ecc-4356-bcb7-44fb6bb36ca2 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eee3aff-6511-43f9-9a0d-6355ca03e177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:52 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-324a5693-5ecc-4356-bcb7-44fb6bb36ca2 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Volume volume-e4fac5f2-2564-4bc2-aeb5-2e55aab2081e (e4fac5f2-2564-4bc2-aeb5-2e55aab2081e): created successfully
Jul 03 01:13:52 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-324a5693-5ecc-4356-bcb7-44fb6bb36ca2 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eee3aff-6511-43f9-9a0d-6355ca03e177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:52 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-324a5693-5ecc-4356-bcb7-44fb6bb36ca2 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Flow 'volume_create_manager' (0fbe7d5e-4b98-4d05-a06c-e80ea7e7d59b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:13:52 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-324a5693-5ecc-4356-bcb7-44fb6bb36ca2 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Created volume successfully.
Jul 03 01:13:52 devstack sudo[98015]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bbb6de08-3ff8-4f55-b862-762792110e94 tempest-CreateVolumesFromSnapshotTest-2114505382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-462d5287-3c53-4e44-938a-574e4111379d 1073741824" returned: 0 in 0.860s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bbb6de08-3ff8-4f55-b862-762792110e94 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-462d5287-3c53-4e44-938a-574e4111379d {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:52 devstack sudo[98021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-462d5287-3c53-4e44-938a-574e4111379d
Jul 03 01:13:52 devstack sudo[98021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:53 devstack sudo[98021]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bbb6de08-3ff8-4f55-b862-762792110e94 tempest-CreateVolumesFromSnapshotTest-2114505382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-462d5287-3c53-4e44-938a-574e4111379d" returned: 0 in 0.651s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:53 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-bbb6de08-3ff8-4f55-b862-762792110e94 tempest-CreateVolumesFromSnapshotTest-2114505382 None] <== create_volume: return (1558ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:13:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-bbb6de08-3ff8-4f55-b862-762792110e94 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.563s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:13:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-5672a6de-2eac-4290-9260-e8d755866071 tempest-VolumesActionsTest-1547316290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.894s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:13:53 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-5672a6de-2eac-4290-9260-e8d755866071 tempest-VolumesActionsTest-1547316290 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:13:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2074163140',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51fcc34f-f467-4695-a1a7-31a581705bd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d7c647a6e6746b1a1936d53da5b3c17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:13:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:13:43Z,use_quota=True,user_id='7892e5242ca34398b2945766f2cd4ae7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:13:53 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-5672a6de-2eac-4290-9260-e8d755866071 tempest-VolumesActionsTest-1547316290 None] Creating volume 51fcc34f-f467-4695-a1a7-31a581705bd5 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:13:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-5672a6de-2eac-4290-9260-e8d755866071 tempest-VolumesActionsTest-1547316290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:13:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-5672a6de-2eac-4290-9260-e8d755866071 tempest-VolumesActionsTest-1547316290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:13:53 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-5672a6de-2eac-4290-9260-e8d755866071 tempest-VolumesActionsTest-1547316290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:13:53 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-5672a6de-2eac-4290-9260-e8d755866071 tempest-VolumesActionsTest-1547316290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:13:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-5672a6de-2eac-4290-9260-e8d755866071 tempest-VolumesActionsTest-1547316290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:13:53 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-5672a6de-2eac-4290-9260-e8d755866071 tempest-VolumesActionsTest-1547316290 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:13:53 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-5672a6de-2eac-4290-9260-e8d755866071 tempest-VolumesActionsTest-1547316290 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:13:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5672a6de-2eac-4290-9260-e8d755866071 tempest-VolumesActionsTest-1547316290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-51fcc34f-f467-4695-a1a7-31a581705bd5 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:53 devstack sudo[98024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-51fcc34f-f467-4695-a1a7-31a581705bd5 1073741824
Jul 03 01:13:53 devstack sudo[98024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:53 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bbb6de08-3ff8-4f55-b862-762792110e94 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f24e3751-7b0a-4c90-aa09-5b78bbcff0fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-462d5287-3c53-4e44-938a-574e4111379d', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:53 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bbb6de08-3ff8-4f55-b862-762792110e94 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b29bbd8c-07e6-47db-ab0b-cb953c72d11e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:53 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-bbb6de08-3ff8-4f55-b862-762792110e94 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Volume volume-462d5287-3c53-4e44-938a-574e4111379d (462d5287-3c53-4e44-938a-574e4111379d): created successfully
Jul 03 01:13:53 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bbb6de08-3ff8-4f55-b862-762792110e94 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b29bbd8c-07e6-47db-ab0b-cb953c72d11e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:53 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bbb6de08-3ff8-4f55-b862-762792110e94 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Flow 'volume_create_manager' (c96c67fc-6190-4edc-bb47-dec3eed6d164) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:13:53 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-bbb6de08-3ff8-4f55-b862-762792110e94 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Created volume successfully.
Jul 03 01:13:54 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-a8829183-8a06-4ee5-9e2e-80ec787f5e40 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Acquiring lock "cinder-462d5287-3c53-4e44-938a-574e4111379d-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:13:54 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-a8829183-8a06-4ee5-9e2e-80ec787f5e40 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Lock "cinder-462d5287-3c53-4e44-938a-574e4111379d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:13:54 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:SELECT=125,cinder:UPDATE=148,cinder:INSERT=36,cinder:DELETE=13 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:13:54 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:SELECT=136,cinder:UPDATE=178,cinder:INSERT=36,cinder:DELETE=15 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:13:54 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-a8829183-8a06-4ee5-9e2e-80ec787f5e40 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Acquiring lock "cinder-quobyte-462d5287-3c53-4e44-938a-574e4111379d" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:13:54 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-a8829183-8a06-4ee5-9e2e-80ec787f5e40 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Lock "cinder-quobyte-462d5287-3c53-4e44-938a-574e4111379d" acquired by "delete_volume" :: waited 0.024s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:13:54 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd68226a-c7e4-4fa7-b0ea-b94ab79b4855]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:13:54 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a8829183-8a06-4ee5-9e2e-80ec787f5e40 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-462d5287-3c53-4e44-938a-574e4111379d {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:54 devstack sudo[98024]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:54 devstack sudo[98030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-462d5287-3c53-4e44-938a-574e4111379d
Jul 03 01:13:54 devstack sudo[98030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:54 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5672a6de-2eac-4290-9260-e8d755866071 tempest-VolumesActionsTest-1547316290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-51fcc34f-f467-4695-a1a7-31a581705bd5 1073741824" returned: 0 in 0.939s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:54 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5672a6de-2eac-4290-9260-e8d755866071 tempest-VolumesActionsTest-1547316290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-51fcc34f-f467-4695-a1a7-31a581705bd5 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:54 devstack sudo[98032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-51fcc34f-f467-4695-a1a7-31a581705bd5
Jul 03 01:13:54 devstack sudo[98032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:55 devstack sudo[98030]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a8829183-8a06-4ee5-9e2e-80ec787f5e40 tempest-CreateVolumesFromSnapshotTest-2114505382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-462d5287-3c53-4e44-938a-574e4111379d" returned: 0 in 0.783s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a8829183-8a06-4ee5-9e2e-80ec787f5e40 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-462d5287-3c53-4e44-938a-574e4111379d {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:55 devstack sudo[98039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-462d5287-3c53-4e44-938a-574e4111379d
Jul 03 01:13:55 devstack sudo[98039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:55 devstack sudo[98032]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5672a6de-2eac-4290-9260-e8d755866071 tempest-VolumesActionsTest-1547316290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-51fcc34f-f467-4695-a1a7-31a581705bd5" returned: 0 in 0.721s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:55 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-5672a6de-2eac-4290-9260-e8d755866071 tempest-VolumesActionsTest-1547316290 None] <== create_volume: return (1714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:13:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-5672a6de-2eac-4290-9260-e8d755866071 tempest-VolumesActionsTest-1547316290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.720s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:13:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-cccf8253-3aba-4d19-b660-297fc5932bf0 tempest-SnapshotsActionsTest-1724460990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.436s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:13:55 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-5672a6de-2eac-4290-9260-e8d755866071 tempest-VolumesActionsTest-1547316290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6be54d0-ea8e-450f-978b-443309b307ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51fcc34f-f467-4695-a1a7-31a581705bd5', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:55 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-5672a6de-2eac-4290-9260-e8d755866071 tempest-VolumesActionsTest-1547316290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4f0fcc9-b29b-4509-be35-6cce6ee24ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:13:55 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-cccf8253-3aba-4d19-b660-297fc5932bf0 tempest-SnapshotsActionsTest-1724460990 None] Creating offline snapshot cb59325b-df60-4558-9b37-aa15490e70bb of volume 7d1b77c3-b58d-4c30-8075-2e237b09fdf4 {{(pid=86891) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 01:13:55 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-5672a6de-2eac-4290-9260-e8d755866071 tempest-VolumesActionsTest-1547316290 None] Volume volume-51fcc34f-f467-4695-a1a7-31a581705bd5 (51fcc34f-f467-4695-a1a7-31a581705bd5): created successfully
Jul 03 01:13:55 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-5672a6de-2eac-4290-9260-e8d755866071 tempest-VolumesActionsTest-1547316290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4f0fcc9-b29b-4509-be35-6cce6ee24ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:13:55 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-5672a6de-2eac-4290-9260-e8d755866071 tempest-VolumesActionsTest-1547316290 None] Flow 'volume_create_manager' (75362e79-ca61-4309-a96a-4b9c4664a5af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:13:55 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ae34bb-5596-470a-813e-e55b8fcb95b3]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:13:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-cccf8253-3aba-4d19-b660-297fc5932bf0 tempest-SnapshotsActionsTest-1724460990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb61df4c-825f-42e7-9372-b6ece8df5cee {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:55 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-5672a6de-2eac-4290-9260-e8d755866071 tempest-VolumesActionsTest-1547316290 None] Created volume successfully.
Jul 03 01:13:55 devstack sudo[98041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb61df4c-825f-42e7-9372-b6ece8df5cee
Jul 03 01:13:55 devstack sudo[98041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:55 devstack sudo[98039]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a8829183-8a06-4ee5-9e2e-80ec787f5e40 tempest-CreateVolumesFromSnapshotTest-2114505382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-462d5287-3c53-4e44-938a-574e4111379d" returned: 0 in 0.698s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:55 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-a8829183-8a06-4ee5-9e2e-80ec787f5e40 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Lock "cinder-quobyte-462d5287-3c53-4e44-938a-574e4111379d" released by "delete_volume" :: held 1.526s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:13:55 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-a8829183-8a06-4ee5-9e2e-80ec787f5e40 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Created reservations ['5fd9d06e-151b-4334-9326-7492734330a3', 'd4594ec6-36bc-4be2-8226-9b8c63fd12db', 'a97d30cc-264f-46df-a3f7-6123b527401d', 'f0bcb225-6f4e-4cb9-8e4a-94de37f28ec9'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:13:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a8829183-8a06-4ee5-9e2e-80ec787f5e40 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:13:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a8829183-8a06-4ee5-9e2e-80ec787f5e40 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:13:56 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-a8829183-8a06-4ee5-9e2e-80ec787f5e40 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:13:56 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-a8829183-8a06-4ee5-9e2e-80ec787f5e40 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:13:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a8829183-8a06-4ee5-9e2e-80ec787f5e40 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:13:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a8829183-8a06-4ee5-9e2e-80ec787f5e40 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:56 devstack sudo[98046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:13:56 devstack sudo[98046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:56 devstack sudo[98041]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-cccf8253-3aba-4d19-b660-297fc5932bf0 tempest-SnapshotsActionsTest-1724460990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb61df4c-825f-42e7-9372-b6ece8df5cee" returned: 0 in 0.826s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:56 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-cccf8253-3aba-4d19-b660-297fc5932bf0 tempest-SnapshotsActionsTest-1724460990 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:13:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-cccf8253-3aba-4d19-b660-297fc5932bf0 tempest-SnapshotsActionsTest-1724460990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb61df4c-825f-42e7-9372-b6ece8df5cee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb59325b-df60-4558-9b37-aa15490e70bb 1G {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:56 devstack sudo[98049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb61df4c-825f-42e7-9372-b6ece8df5cee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb59325b-df60-4558-9b37-aa15490e70bb 1G
Jul 03 01:13:56 devstack sudo[98049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:56 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-db74d77f-be58-47b8-8721-14188df0afd6 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Acquiring lock "cinder-e4fac5f2-2564-4bc2-aeb5-2e55aab2081e-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:13:56 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-db74d77f-be58-47b8-8721-14188df0afd6 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Lock "cinder-e4fac5f2-2564-4bc2-aeb5-2e55aab2081e-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:13:56 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-db74d77f-be58-47b8-8721-14188df0afd6 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Acquiring lock "cinder-quobyte-e4fac5f2-2564-4bc2-aeb5-2e55aab2081e" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:13:56 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-db74d77f-be58-47b8-8721-14188df0afd6 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Lock "cinder-quobyte-e4fac5f2-2564-4bc2-aeb5-2e55aab2081e" acquired by "delete_volume" :: waited 0.028s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:13:56 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[4089f717-eac1-47e1-a7b4-e33bb4c1d20d]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:13:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-db74d77f-be58-47b8-8721-14188df0afd6 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e4fac5f2-2564-4bc2-aeb5-2e55aab2081e {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:56 devstack sudo[98046]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a8829183-8a06-4ee5-9e2e-80ec787f5e40 tempest-CreateVolumesFromSnapshotTest-2114505382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.915s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:56 devstack sudo[98052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e4fac5f2-2564-4bc2-aeb5-2e55aab2081e
Jul 03 01:13:56 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-a8829183-8a06-4ee5-9e2e-80ec787f5e40 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:13:56 devstack sudo[98052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:56 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-a8829183-8a06-4ee5-9e2e-80ec787f5e40 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Deleted volume successfully.
Jul 03 01:13:57 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-a8829183-8a06-4ee5-9e2e-80ec787f5e40 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Lock "cinder-462d5287-3c53-4e44-938a-574e4111379d-delete_volume" released by "delete_volume" :: held 2.721s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:13:57 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-f267a810-31f6-4a8d-8d43-62619d6ca03a tempest-VolumesActionsTest-1547316290 None] Acquiring lock "cinder-51fcc34f-f467-4695-a1a7-31a581705bd5-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:13:57 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-f267a810-31f6-4a8d-8d43-62619d6ca03a tempest-VolumesActionsTest-1547316290 None] Lock "cinder-51fcc34f-f467-4695-a1a7-31a581705bd5-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:13:57 devstack sudo[98049]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:57 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-f267a810-31f6-4a8d-8d43-62619d6ca03a tempest-VolumesActionsTest-1547316290 None] Acquiring lock "cinder-quobyte-51fcc34f-f467-4695-a1a7-31a581705bd5" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:13:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-cccf8253-3aba-4d19-b660-297fc5932bf0 tempest-SnapshotsActionsTest-1724460990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb61df4c-825f-42e7-9372-b6ece8df5cee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb59325b-df60-4558-9b37-aa15490e70bb 1G" returned: 0 in 1.281s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-cccf8253-3aba-4d19-b660-297fc5932bf0 tempest-SnapshotsActionsTest-1724460990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb61df4c-825f-42e7-9372-b6ece8df5cee -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb59325b-df60-4558-9b37-aa15490e70bb {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:57 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-f267a810-31f6-4a8d-8d43-62619d6ca03a tempest-VolumesActionsTest-1547316290 None] Lock "cinder-quobyte-51fcc34f-f467-4695-a1a7-31a581705bd5" acquired by "delete_volume" :: waited 0.033s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:13:57 devstack sudo[98058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb61df4c-825f-42e7-9372-b6ece8df5cee -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb59325b-df60-4558-9b37-aa15490e70bb
Jul 03 01:13:57 devstack sudo[98058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:57 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c228a4-4559-4e23-bfed-01eba1bad04c]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:13:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f267a810-31f6-4a8d-8d43-62619d6ca03a tempest-VolumesActionsTest-1547316290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-51fcc34f-f467-4695-a1a7-31a581705bd5 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:57 devstack sudo[98060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-51fcc34f-f467-4695-a1a7-31a581705bd5
Jul 03 01:13:57 devstack sudo[98060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:57 devstack sudo[98052]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-db74d77f-be58-47b8-8721-14188df0afd6 tempest-CreateVolumesFromSnapshotTest-2114505382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e4fac5f2-2564-4bc2-aeb5-2e55aab2081e" returned: 0 in 1.016s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-db74d77f-be58-47b8-8721-14188df0afd6 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e4fac5f2-2564-4bc2-aeb5-2e55aab2081e {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:57 devstack sudo[98066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e4fac5f2-2564-4bc2-aeb5-2e55aab2081e
Jul 03 01:13:57 devstack sudo[98066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:58 devstack sudo[98060]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f267a810-31f6-4a8d-8d43-62619d6ca03a tempest-VolumesActionsTest-1547316290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-51fcc34f-f467-4695-a1a7-31a581705bd5" returned: 0 in 0.835s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f267a810-31f6-4a8d-8d43-62619d6ca03a tempest-VolumesActionsTest-1547316290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-51fcc34f-f467-4695-a1a7-31a581705bd5 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:58 devstack sudo[98058]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-cccf8253-3aba-4d19-b660-297fc5932bf0 tempest-SnapshotsActionsTest-1724460990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb61df4c-825f-42e7-9372-b6ece8df5cee -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb59325b-df60-4558-9b37-aa15490e70bb" returned: 0 in 0.931s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:58 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-cccf8253-3aba-4d19-b660-297fc5932bf0 tempest-SnapshotsActionsTest-1724460990 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb59325b-df60-4558-9b37-aa15490e70bb is being set with open permissions: ugo+rw
Jul 03 01:13:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-cccf8253-3aba-4d19-b660-297fc5932bf0 tempest-SnapshotsActionsTest-1724460990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb59325b-df60-4558-9b37-aa15490e70bb {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:58 devstack sudo[98075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-51fcc34f-f467-4695-a1a7-31a581705bd5
Jul 03 01:13:58 devstack sudo[98075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:58 devstack sudo[98076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb59325b-df60-4558-9b37-aa15490e70bb
Jul 03 01:13:58 devstack sudo[98076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:58 devstack sudo[98066]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-db74d77f-be58-47b8-8721-14188df0afd6 tempest-CreateVolumesFromSnapshotTest-2114505382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e4fac5f2-2564-4bc2-aeb5-2e55aab2081e" returned: 0 in 0.849s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:58 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-db74d77f-be58-47b8-8721-14188df0afd6 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Lock "cinder-quobyte-e4fac5f2-2564-4bc2-aeb5-2e55aab2081e" released by "delete_volume" :: held 1.936s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:13:58 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-db74d77f-be58-47b8-8721-14188df0afd6 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Created reservations ['b457e813-5421-4360-84aa-81599b09df43', '7ba704f8-208e-47e8-aae6-af77645bad48', '11ee812c-7a11-43b8-bc9b-c349a6601db5', 'd9d4438e-015e-43c4-b819-558f4705aeb4'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:13:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-db74d77f-be58-47b8-8721-14188df0afd6 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:13:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-db74d77f-be58-47b8-8721-14188df0afd6 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:13:58 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-db74d77f-be58-47b8-8721-14188df0afd6 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:13:58 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-db74d77f-be58-47b8-8721-14188df0afd6 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:13:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-db74d77f-be58-47b8-8721-14188df0afd6 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:13:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-db74d77f-be58-47b8-8721-14188df0afd6 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:58 devstack sudo[98080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:13:58 devstack sudo[98080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:59 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-cfbda5e1-d23b-4ff1-baa3-5efe4f987824 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Acquiring lock "cinder-16a66c4c-b193-4d89-a0c2-f051dcb31fa4-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:13:59 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-cfbda5e1-d23b-4ff1-baa3-5efe4f987824 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Lock "cinder-16a66c4c-b193-4d89-a0c2-f051dcb31fa4-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:13:59 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-cfbda5e1-d23b-4ff1-baa3-5efe4f987824 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Acquiring lock "cinder-quobyte-16a66c4c-b193-4d89-a0c2-f051dcb31fa4" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:13:59 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-cfbda5e1-d23b-4ff1-baa3-5efe4f987824 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Lock "cinder-quobyte-16a66c4c-b193-4d89-a0c2-f051dcb31fa4" acquired by "delete_volume" :: waited 0.033s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:13:59 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[787cd8c3-c248-4cbb-b541-bc49add251a8]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:13:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-cfbda5e1-d23b-4ff1-baa3-5efe4f987824 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-16a66c4c-b193-4d89-a0c2-f051dcb31fa4 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:59 devstack sudo[98076]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-cccf8253-3aba-4d19-b660-297fc5932bf0 tempest-SnapshotsActionsTest-1724460990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb59325b-df60-4558-9b37-aa15490e70bb" returned: 0 in 0.785s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:59 devstack sudo[98075]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-cccf8253-3aba-4d19-b660-297fc5932bf0 tempest-SnapshotsActionsTest-1724460990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.979s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:13:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f267a810-31f6-4a8d-8d43-62619d6ca03a tempest-VolumesActionsTest-1547316290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-51fcc34f-f467-4695-a1a7-31a581705bd5" returned: 0 in 0.867s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:59 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-f267a810-31f6-4a8d-8d43-62619d6ca03a tempest-VolumesActionsTest-1547316290 None] Lock "cinder-quobyte-51fcc34f-f467-4695-a1a7-31a581705bd5" released by "delete_volume" :: held 1.760s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:13:59 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-cccf8253-3aba-4d19-b660-297fc5932bf0 tempest-SnapshotsActionsTest-1724460990 None] Create snapshot completed successfully
Jul 03 01:13:59 devstack sudo[98084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-16a66c4c-b193-4d89-a0c2-f051dcb31fa4
Jul 03 01:13:59 devstack sudo[98084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:59 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-f267a810-31f6-4a8d-8d43-62619d6ca03a tempest-VolumesActionsTest-1547316290 None] Created reservations ['2bf49035-5e17-44ea-a798-f00a2cb96a36', 'b3619de5-53c6-42c5-b6d9-af04ea178665', '8a554773-cec7-4de8-961b-4ece27e76c16', 'b55277de-8f6d-4ce2-8f40-5ff5a08a29e3'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:13:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f267a810-31f6-4a8d-8d43-62619d6ca03a tempest-VolumesActionsTest-1547316290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:13:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f267a810-31f6-4a8d-8d43-62619d6ca03a tempest-VolumesActionsTest-1547316290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:13:59 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-f267a810-31f6-4a8d-8d43-62619d6ca03a tempest-VolumesActionsTest-1547316290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:13:59 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-f267a810-31f6-4a8d-8d43-62619d6ca03a tempest-VolumesActionsTest-1547316290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:13:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f267a810-31f6-4a8d-8d43-62619d6ca03a tempest-VolumesActionsTest-1547316290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:13:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f267a810-31f6-4a8d-8d43-62619d6ca03a tempest-VolumesActionsTest-1547316290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:13:59 devstack sudo[98086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:13:59 devstack sudo[98086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:13:59 devstack sudo[98080]: pam_unix(sudo:session): session closed for user root
Jul 03 01:13:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-db74d77f-be58-47b8-8721-14188df0afd6 tempest-CreateVolumesFromSnapshotTest-2114505382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.998s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:13:59 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-db74d77f-be58-47b8-8721-14188df0afd6 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:13:59 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-db74d77f-be58-47b8-8721-14188df0afd6 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Deleted volume successfully.
Jul 03 01:13:59 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-db74d77f-be58-47b8-8721-14188df0afd6 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Lock "cinder-e4fac5f2-2564-4bc2-aeb5-2e55aab2081e-delete_volume" released by "delete_volume" :: held 3.241s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:14:00 devstack sudo[98084]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:00 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-cfbda5e1-d23b-4ff1-baa3-5efe4f987824 tempest-CreateVolumesFromSnapshotTest-2114505382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-16a66c4c-b193-4d89-a0c2-f051dcb31fa4" returned: 0 in 1.028s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:00 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-cfbda5e1-d23b-4ff1-baa3-5efe4f987824 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-16a66c4c-b193-4d89-a0c2-f051dcb31fa4 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:00 devstack sudo[98086]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:00 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f267a810-31f6-4a8d-8d43-62619d6ca03a tempest-VolumesActionsTest-1547316290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.783s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:00 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-f267a810-31f6-4a8d-8d43-62619d6ca03a tempest-VolumesActionsTest-1547316290 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:14:00 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-f267a810-31f6-4a8d-8d43-62619d6ca03a tempest-VolumesActionsTest-1547316290 None] Deleted volume successfully.
Jul 03 01:14:00 devstack sudo[98093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-16a66c4c-b193-4d89-a0c2-f051dcb31fa4
Jul 03 01:14:00 devstack sudo[98093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:00 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-f267a810-31f6-4a8d-8d43-62619d6ca03a tempest-VolumesActionsTest-1547316290 None] Lock "cinder-51fcc34f-f467-4695-a1a7-31a581705bd5-delete_volume" released by "delete_volume" :: held 2.839s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:14:00 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-680294f6-8a55-4743-85fe-cd679f57ab72 tempest-SnapshotsActionsTest-647828101 None] Acquiring lock "cinder-cb59325b-df60-4558-9b37-aa15490e70bb-delete_snapshot" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:14:00 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-680294f6-8a55-4743-85fe-cd679f57ab72 tempest-SnapshotsActionsTest-647828101 None] Lock "cinder-cb59325b-df60-4558-9b37-aa15490e70bb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:14:00 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-680294f6-8a55-4743-85fe-cd679f57ab72 tempest-SnapshotsActionsTest-647828101 None] Acquiring lock "cinder-quobyte-7d1b77c3-b58d-4c30-8075-2e237b09fdf4" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:14:00 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-680294f6-8a55-4743-85fe-cd679f57ab72 tempest-SnapshotsActionsTest-647828101 None] Lock "cinder-quobyte-7d1b77c3-b58d-4c30-8075-2e237b09fdf4" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:14:00 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-680294f6-8a55-4743-85fe-cd679f57ab72 tempest-SnapshotsActionsTest-647828101 None] Acquiring lock "cinder-quobyte-cb59325b-df60-4558-9b37-aa15490e70bb" by "_delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:14:00 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-680294f6-8a55-4743-85fe-cd679f57ab72 tempest-SnapshotsActionsTest-647828101 None] Lock "cinder-quobyte-cb59325b-df60-4558-9b37-aa15490e70bb" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:14:00 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-680294f6-8a55-4743-85fe-cd679f57ab72 tempest-SnapshotsActionsTest-647828101 None] Deleting offline snapshot cb59325b-df60-4558-9b37-aa15490e70bb of volume 7d1b77c3-b58d-4c30-8075-2e237b09fdf4 {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 01:14:00 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-680294f6-8a55-4743-85fe-cd679f57ab72 tempest-SnapshotsActionsTest-647828101 None] snapshot_file for this snap is: volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb59325b-df60-4558-9b37-aa15490e70bb {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 01:14:00 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[3028961c-ce60-4b12-9aa7-06fdda57abf7]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:14:00 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-680294f6-8a55-4743-85fe-cd679f57ab72 tempest-SnapshotsActionsTest-647828101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb59325b-df60-4558-9b37-aa15490e70bb {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:00 devstack sudo[98095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb59325b-df60-4558-9b37-aa15490e70bb
Jul 03 01:14:00 devstack sudo[98095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:01 devstack sudo[98093]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-cfbda5e1-d23b-4ff1-baa3-5efe4f987824 tempest-CreateVolumesFromSnapshotTest-2114505382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-16a66c4c-b193-4d89-a0c2-f051dcb31fa4" returned: 0 in 0.906s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:01 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-cfbda5e1-d23b-4ff1-baa3-5efe4f987824 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Lock "cinder-quobyte-16a66c4c-b193-4d89-a0c2-f051dcb31fa4" released by "delete_volume" :: held 1.985s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:14:01 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-cfbda5e1-d23b-4ff1-baa3-5efe4f987824 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Created reservations ['fc4587fc-a06c-4846-8f83-946d4cb6ef41', 'e433cb3a-bfc6-4d3c-b9f9-9a8a6554eddf', 'a5d608e1-6a40-4dba-b4ee-25ed4450d31a', '92d8eb51-e81c-41b1-b391-257b7850721c'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:14:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-cfbda5e1-d23b-4ff1-baa3-5efe4f987824 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:14:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-cfbda5e1-d23b-4ff1-baa3-5efe4f987824 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:14:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-cfbda5e1-d23b-4ff1-baa3-5efe4f987824 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:14:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-cfbda5e1-d23b-4ff1-baa3-5efe4f987824 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:14:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-cfbda5e1-d23b-4ff1-baa3-5efe4f987824 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:14:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-cfbda5e1-d23b-4ff1-baa3-5efe4f987824 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:01 devstack sudo[98098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:14:01 devstack sudo[98098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:01 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-3a378b60-30c7-4596-ac70-c1030ddc3070 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Acquiring lock "cinder-bf9e5812-73c4-4e12-ad2e-c50b2b5d238d-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:14:01 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-3a378b60-30c7-4596-ac70-c1030ddc3070 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Lock "cinder-bf9e5812-73c4-4e12-ad2e-c50b2b5d238d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:14:01 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-3a378b60-30c7-4596-ac70-c1030ddc3070 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Acquiring lock "cinder-quobyte-bf9e5812-73c4-4e12-ad2e-c50b2b5d238d" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:14:01 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-3a378b60-30c7-4596-ac70-c1030ddc3070 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Lock "cinder-quobyte-bf9e5812-73c4-4e12-ad2e-c50b2b5d238d" acquired by "delete_volume" :: waited 0.017s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:14:01 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[46445e8a-6efe-462a-b9dc-15583e950e93]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:14:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-3a378b60-30c7-4596-ac70-c1030ddc3070 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-bf9e5812-73c4-4e12-ad2e-c50b2b5d238d {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:01 devstack sudo[98095]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-680294f6-8a55-4743-85fe-cd679f57ab72 tempest-SnapshotsActionsTest-647828101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb59325b-df60-4558-9b37-aa15490e70bb" returned: 0 in 1.079s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-680294f6-8a55-4743-85fe-cd679f57ab72 tempest-SnapshotsActionsTest-647828101 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:14:01 devstack sudo[98104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-bf9e5812-73c4-4e12-ad2e-c50b2b5d238d
Jul 03 01:14:01 devstack sudo[98104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:01 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[4986958d-7d2c-4ab8-8073-3a75227ec61c]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:14:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-680294f6-8a55-4743-85fe-cd679f57ab72 tempest-SnapshotsActionsTest-647828101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb61df4c-825f-42e7-9372-b6ece8df5cee {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:01 devstack cinder-volume[86891]: DEBUG oslo_service.periodic_task [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86891) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 01:14:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:14:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:14:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:14:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:14:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:14:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:01 devstack sudo[98107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:14:01 devstack sudo[98107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:02 devstack sudo[98106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb61df4c-825f-42e7-9372-b6ece8df5cee
Jul 03 01:14:02 devstack sudo[98106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:02 devstack sudo[98104]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-3a378b60-30c7-4596-ac70-c1030ddc3070 tempest-CreateVolumesFromSnapshotTest-2114505382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-bf9e5812-73c4-4e12-ad2e-c50b2b5d238d" returned: 0 in 1.036s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-3a378b60-30c7-4596-ac70-c1030ddc3070 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-bf9e5812-73c4-4e12-ad2e-c50b2b5d238d {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:02 devstack sudo[98098]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-cfbda5e1-d23b-4ff1-baa3-5efe4f987824 tempest-CreateVolumesFromSnapshotTest-2114505382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 1.329s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:02 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-cfbda5e1-d23b-4ff1-baa3-5efe4f987824 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:14:02 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-cfbda5e1-d23b-4ff1-baa3-5efe4f987824 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Deleted volume successfully.
Jul 03 01:14:02 devstack sudo[98114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-bf9e5812-73c4-4e12-ad2e-c50b2b5d238d
Jul 03 01:14:02 devstack sudo[98114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:02 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-cfbda5e1-d23b-4ff1-baa3-5efe4f987824 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Lock "cinder-16a66c4c-b193-4d89-a0c2-f051dcb31fa4-delete_volume" released by "delete_volume" :: held 3.677s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:14:03 devstack sudo[98107]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 1.174s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:03 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:14:03 devstack cinder-volume[86891]: DEBUG oslo_service.periodic_task [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running periodic task VolumeManager._thread_info {{(pid=86891) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 01:14:03 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] thread count: 28 {{(pid=86891) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 01:14:03 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] thread info: [<_MainThread(MainThread, started 136731296534656)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136731184953280)>, <Thread(Thread-3 (stat_writer), started daemon 136731184058816)>, <Thread(Rabbit-heartbeat, started daemon 136731184846080)>, <Thread(Thread-5 (_runner), started daemon 136731182936576)>, <Thread(Thread-7 (_runner), started daemon 136731182954944)>, <Thread(fd_logger, started daemon 136731181916416)>, <Thread(privsep_reader, started daemon 136731180942208)>, <Thread(tpool_thread_0, started daemon 136731172161216)>, <Thread(tpool_thread_1, started daemon 136731163768512)>, <Thread(tpool_thread_2, started daemon 136731155375808)>, <Thread(tpool_thread_3, started daemon 136731146983104)>, <Thread(tpool_thread_4, started daemon 136731138590400)>, <Thread(tpool_thread_5, started daemon 136731130197696)>, <Thread(tpool_thread_6, started daemon 136731121804992)>, <Thread(tpool_thread_7, started daemon 136731113412288)>, <Thread(tpool_thread_8, started daemon 136731105003200)>, <Thread(tpool_thread_9, started daemon 136731096594112)>, <Thread(tpool_thread_10, started daemon 136731088185024)>, <Thread(tpool_thread_11, started daemon 136731079775936)>, <Thread(tpool_thread_12, started daemon 136731071366848)>, <Thread(tpool_thread_13, started daemon 136731062957760)>, <Thread(tpool_thread_14, started daemon 136731054548672)>, <Thread(tpool_thread_15, started daemon 136731046139584)>, <Thread(tpool_thread_16, started daemon 136731037730496)>, <Thread(tpool_thread_17, started daemon 136731029321408)>, <Thread(tpool_thread_18, started daemon 136731020912320)>, <Thread(tpool_thread_19, started daemon 136731012503232)>] {{(pid=86891) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 01:14:03 devstack sudo[98106]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-680294f6-8a55-4743-85fe-cd679f57ab72 tempest-SnapshotsActionsTest-647828101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb61df4c-825f-42e7-9372-b6ece8df5cee" returned: 0 in 1.437s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:03 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-680294f6-8a55-4743-85fe-cd679f57ab72 tempest-SnapshotsActionsTest-647828101 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:14:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-680294f6-8a55-4743-85fe-cd679f57ab72 tempest-SnapshotsActionsTest-647828101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb59325b-df60-4558-9b37-aa15490e70bb {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:03 devstack sudo[98120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb59325b-df60-4558-9b37-aa15490e70bb
Jul 03 01:14:03 devstack sudo[98120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:03 devstack sudo[98114]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-3a378b60-30c7-4596-ac70-c1030ddc3070 tempest-CreateVolumesFromSnapshotTest-2114505382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-bf9e5812-73c4-4e12-ad2e-c50b2b5d238d" returned: 0 in 0.873s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:03 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-3a378b60-30c7-4596-ac70-c1030ddc3070 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Lock "cinder-quobyte-bf9e5812-73c4-4e12-ad2e-c50b2b5d238d" released by "delete_volume" :: held 2.002s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:14:03 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-3a378b60-30c7-4596-ac70-c1030ddc3070 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Created reservations ['6450cdc0-29d4-446a-9e70-8c4879c71c8b', 'c9533351-5eff-42b8-80ed-a17f0f195692', '7cfb0381-7833-4b31-a380-380873c4a2ed', '756e3150-4c71-4c2a-a9e9-3a6b65f09dd1'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:14:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-3a378b60-30c7-4596-ac70-c1030ddc3070 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:14:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-3a378b60-30c7-4596-ac70-c1030ddc3070 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:14:03 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-3a378b60-30c7-4596-ac70-c1030ddc3070 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:14:03 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-3a378b60-30c7-4596-ac70-c1030ddc3070 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:14:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-3a378b60-30c7-4596-ac70-c1030ddc3070 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:14:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-3a378b60-30c7-4596-ac70-c1030ddc3070 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:03 devstack sudo[98124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:14:03 devstack sudo[98124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:03 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-a3184da9-6e8d-4e0e-bde4-0402ee9b7e9c tempest-CreateVolumesFromSnapshotTest-2114505382 None] Acquiring lock "cinder-68a55ef7-a06e-4df0-83f9-d627d764ce96-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:14:03 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-a3184da9-6e8d-4e0e-bde4-0402ee9b7e9c tempest-CreateVolumesFromSnapshotTest-2114505382 None] Lock "cinder-68a55ef7-a06e-4df0-83f9-d627d764ce96-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:14:04 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-a3184da9-6e8d-4e0e-bde4-0402ee9b7e9c tempest-CreateVolumesFromSnapshotTest-2114505382 None] Acquiring lock "cinder-quobyte-68a55ef7-a06e-4df0-83f9-d627d764ce96" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:14:04 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-a3184da9-6e8d-4e0e-bde4-0402ee9b7e9c tempest-CreateVolumesFromSnapshotTest-2114505382 None] Lock "cinder-quobyte-68a55ef7-a06e-4df0-83f9-d627d764ce96" acquired by "delete_volume" :: waited 0.016s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:14:04 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf87b05-9785-4795-b4bf-57648e9a0b8a]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:14:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a3184da9-6e8d-4e0e-bde4-0402ee9b7e9c tempest-CreateVolumesFromSnapshotTest-2114505382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-68a55ef7-a06e-4df0-83f9-d627d764ce96 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:04 devstack sudo[98129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-68a55ef7-a06e-4df0-83f9-d627d764ce96
Jul 03 01:14:04 devstack sudo[98129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:04 devstack sudo[98120]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-680294f6-8a55-4743-85fe-cd679f57ab72 tempest-SnapshotsActionsTest-647828101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb59325b-df60-4558-9b37-aa15490e70bb" returned: 0 in 1.216s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-680294f6-8a55-4743-85fe-cd679f57ab72 tempest-SnapshotsActionsTest-647828101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb59325b-df60-4558-9b37-aa15490e70bb {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:04 devstack sudo[98132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb59325b-df60-4558-9b37-aa15490e70bb
Jul 03 01:14:04 devstack sudo[98132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:04 devstack sudo[98124]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-3a378b60-30c7-4596-ac70-c1030ddc3070 tempest-CreateVolumesFromSnapshotTest-2114505382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 1.173s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:04 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-3a378b60-30c7-4596-ac70-c1030ddc3070 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:14:04 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-3a378b60-30c7-4596-ac70-c1030ddc3070 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Deleted volume successfully.
Jul 03 01:14:04 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-3a378b60-30c7-4596-ac70-c1030ddc3070 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Lock "cinder-bf9e5812-73c4-4e12-ad2e-c50b2b5d238d-delete_volume" released by "delete_volume" :: held 3.497s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:14:05 devstack sudo[98129]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:05 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a3184da9-6e8d-4e0e-bde4-0402ee9b7e9c tempest-CreateVolumesFromSnapshotTest-2114505382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-68a55ef7-a06e-4df0-83f9-d627d764ce96" returned: 0 in 1.198s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:05 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a3184da9-6e8d-4e0e-bde4-0402ee9b7e9c tempest-CreateVolumesFromSnapshotTest-2114505382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-68a55ef7-a06e-4df0-83f9-d627d764ce96 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:05 devstack sudo[98140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-68a55ef7-a06e-4df0-83f9-d627d764ce96
Jul 03 01:14:05 devstack sudo[98140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:05 devstack sudo[98132]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:05 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-680294f6-8a55-4743-85fe-cd679f57ab72 tempest-SnapshotsActionsTest-647828101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb59325b-df60-4558-9b37-aa15490e70bb" returned: 0 in 0.951s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:05 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-680294f6-8a55-4743-85fe-cd679f57ab72 tempest-SnapshotsActionsTest-647828101 None] Lock "cinder-quobyte-cb59325b-df60-4558-9b37-aa15490e70bb" released by "_delete_snapshot" :: held 4.847s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:14:05 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-680294f6-8a55-4743-85fe-cd679f57ab72 tempest-SnapshotsActionsTest-647828101 None] Lock "cinder-quobyte-7d1b77c3-b58d-4c30-8075-2e237b09fdf4" released by "delete_snapshot" :: held 4.879s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:14:05 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-680294f6-8a55-4743-85fe-cd679f57ab72 tempest-SnapshotsActionsTest-647828101 None] Created reservations ['02706ae0-a5d0-4e14-9c14-b8729833bfa6', '29205a43-5b00-4626-9c94-7569b99fb1d0', 'af8de9aa-aacd-4a1c-b66e-df7690212817', 'a18959ad-40c7-401e-ab13-0d8542ac45ac'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:14:05 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-680294f6-8a55-4743-85fe-cd679f57ab72 tempest-SnapshotsActionsTest-647828101 None] Delete snapshot completed successfully.
Jul 03 01:14:05 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-680294f6-8a55-4743-85fe-cd679f57ab72 tempest-SnapshotsActionsTest-647828101 None] Lock "cinder-cb59325b-df60-4558-9b37-aa15490e70bb-delete_snapshot" released by "delete_snapshot" :: held 5.152s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:14:06 devstack sudo[98140]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a3184da9-6e8d-4e0e-bde4-0402ee9b7e9c tempest-CreateVolumesFromSnapshotTest-2114505382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-68a55ef7-a06e-4df0-83f9-d627d764ce96" returned: 0 in 0.958s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:06 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-a3184da9-6e8d-4e0e-bde4-0402ee9b7e9c tempest-CreateVolumesFromSnapshotTest-2114505382 None] Lock "cinder-quobyte-68a55ef7-a06e-4df0-83f9-d627d764ce96" released by "delete_volume" :: held 2.250s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:14:06 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-a3184da9-6e8d-4e0e-bde4-0402ee9b7e9c tempest-CreateVolumesFromSnapshotTest-2114505382 None] Created reservations ['26071646-e50c-46e8-b8cd-78e31c02842f', '72738a39-8d13-4941-84d8-f09b10e17e14', '1652dbf1-c0ba-4364-8d7c-3e537ce70d53', '6de67ddc-0445-4589-ace7-036660bc6c0f'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:14:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-5e545799-24a4-4716-882f-0fc6c9133d41 tempest-SnapshotsActionsTest-1724460990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:14:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-5e545799-24a4-4716-882f-0fc6c9133d41 tempest-SnapshotsActionsTest-1724460990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:14:06 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-5e545799-24a4-4716-882f-0fc6c9133d41 tempest-SnapshotsActionsTest-1724460990 None] Creating offline snapshot 4ce137a9-f9d4-42ad-bc05-7381f934f830 of volume 7d1b77c3-b58d-4c30-8075-2e237b09fdf4 {{(pid=86891) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 01:14:06 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5fe5e3b-f1f2-4a28-959c-88f10beb218f]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:14:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5e545799-24a4-4716-882f-0fc6c9133d41 tempest-SnapshotsActionsTest-1724460990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb61df4c-825f-42e7-9372-b6ece8df5cee {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a3184da9-6e8d-4e0e-bde4-0402ee9b7e9c tempest-CreateVolumesFromSnapshotTest-2114505382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:14:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a3184da9-6e8d-4e0e-bde4-0402ee9b7e9c tempest-CreateVolumesFromSnapshotTest-2114505382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:14:06 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-a3184da9-6e8d-4e0e-bde4-0402ee9b7e9c tempest-CreateVolumesFromSnapshotTest-2114505382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:14:06 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-a3184da9-6e8d-4e0e-bde4-0402ee9b7e9c tempest-CreateVolumesFromSnapshotTest-2114505382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:14:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a3184da9-6e8d-4e0e-bde4-0402ee9b7e9c tempest-CreateVolumesFromSnapshotTest-2114505382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:14:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a3184da9-6e8d-4e0e-bde4-0402ee9b7e9c tempest-CreateVolumesFromSnapshotTest-2114505382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:06 devstack sudo[98145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:14:06 devstack sudo[98145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:06 devstack sudo[98144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb61df4c-825f-42e7-9372-b6ece8df5cee
Jul 03 01:14:06 devstack sudo[98144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:07 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-31f7bf3a-7613-4957-8efe-e8f926635d73 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Acquiring lock "cinder-a6ff2c37-cbc1-4424-bad4-db4fa421d499-delete_snapshot" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:14:07 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-31f7bf3a-7613-4957-8efe-e8f926635d73 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Lock "cinder-a6ff2c37-cbc1-4424-bad4-db4fa421d499-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:14:07 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-31f7bf3a-7613-4957-8efe-e8f926635d73 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Acquiring lock "cinder-quobyte-34059693-3be9-4635-a42d-3024199dd976" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:14:07 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-31f7bf3a-7613-4957-8efe-e8f926635d73 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Lock "cinder-quobyte-34059693-3be9-4635-a42d-3024199dd976" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:14:07 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-31f7bf3a-7613-4957-8efe-e8f926635d73 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Acquiring lock "cinder-quobyte-a6ff2c37-cbc1-4424-bad4-db4fa421d499" by "_delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:14:07 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-31f7bf3a-7613-4957-8efe-e8f926635d73 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Lock "cinder-quobyte-a6ff2c37-cbc1-4424-bad4-db4fa421d499" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:14:07 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-31f7bf3a-7613-4957-8efe-e8f926635d73 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Deleting offline snapshot a6ff2c37-cbc1-4424-bad4-db4fa421d499 of volume 34059693-3be9-4635-a42d-3024199dd976 {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 01:14:07 devstack sudo[98145]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:07 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-31f7bf3a-7613-4957-8efe-e8f926635d73 tempest-CreateVolumesFromSnapshotTest-2114505382 None] snapshot_file for this snap is: volume-34059693-3be9-4635-a42d-3024199dd976.a6ff2c37-cbc1-4424-bad4-db4fa421d499 {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 01:14:07 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a3184da9-6e8d-4e0e-bde4-0402ee9b7e9c tempest-CreateVolumesFromSnapshotTest-2114505382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.958s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:07 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-a3184da9-6e8d-4e0e-bde4-0402ee9b7e9c tempest-CreateVolumesFromSnapshotTest-2114505382 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:14:07 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-a3184da9-6e8d-4e0e-bde4-0402ee9b7e9c tempest-CreateVolumesFromSnapshotTest-2114505382 None] Deleted volume successfully.
Jul 03 01:14:07 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[048bc2fe-4d83-4227-a104-346e6f91cb17]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:14:07 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-31f7bf3a-7613-4957-8efe-e8f926635d73 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-34059693-3be9-4635-a42d-3024199dd976.a6ff2c37-cbc1-4424-bad4-db4fa421d499 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:07 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-a3184da9-6e8d-4e0e-bde4-0402ee9b7e9c tempest-CreateVolumesFromSnapshotTest-2114505382 None] Lock "cinder-68a55ef7-a06e-4df0-83f9-d627d764ce96-delete_volume" released by "delete_volume" :: held 3.696s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:14:07 devstack sudo[98144]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:07 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5e545799-24a4-4716-882f-0fc6c9133d41 tempest-SnapshotsActionsTest-1724460990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb61df4c-825f-42e7-9372-b6ece8df5cee" returned: 0 in 1.154s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:07 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-5e545799-24a4-4716-882f-0fc6c9133d41 tempest-SnapshotsActionsTest-1724460990 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:14:07 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5e545799-24a4-4716-882f-0fc6c9133d41 tempest-SnapshotsActionsTest-1724460990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb61df4c-825f-42e7-9372-b6ece8df5cee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.4ce137a9-f9d4-42ad-bc05-7381f934f830 1G {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:07 devstack sudo[98153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb61df4c-825f-42e7-9372-b6ece8df5cee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.4ce137a9-f9d4-42ad-bc05-7381f934f830 1G
Jul 03 01:14:07 devstack sudo[98153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:07 devstack sudo[98152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-34059693-3be9-4635-a42d-3024199dd976.a6ff2c37-cbc1-4424-bad4-db4fa421d499
Jul 03 01:14:07 devstack sudo[98152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:08 devstack sudo[98152]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:08 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-31f7bf3a-7613-4957-8efe-e8f926635d73 tempest-CreateVolumesFromSnapshotTest-2114505382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-34059693-3be9-4635-a42d-3024199dd976.a6ff2c37-cbc1-4424-bad4-db4fa421d499" returned: 0 in 1.037s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:08 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-31f7bf3a-7613-4957-8efe-e8f926635d73 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34059693-3be9-4635-a42d-3024199dd976(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:14:08 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b82b96-035c-4727-802f-38154d5ca0fb]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:14:08 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-31f7bf3a-7613-4957-8efe-e8f926635d73 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-34059693-3be9-4635-a42d-3024199dd976 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:08 devstack sudo[98153]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:08 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5e545799-24a4-4716-882f-0fc6c9133d41 tempest-SnapshotsActionsTest-1724460990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb61df4c-825f-42e7-9372-b6ece8df5cee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.4ce137a9-f9d4-42ad-bc05-7381f934f830 1G" returned: 0 in 1.050s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:08 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5e545799-24a4-4716-882f-0fc6c9133d41 tempest-SnapshotsActionsTest-1724460990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb61df4c-825f-42e7-9372-b6ece8df5cee -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.4ce137a9-f9d4-42ad-bc05-7381f934f830 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:08 devstack sudo[98166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb61df4c-825f-42e7-9372-b6ece8df5cee -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.4ce137a9-f9d4-42ad-bc05-7381f934f830
Jul 03 01:14:08 devstack sudo[98166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:08 devstack sudo[98165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-34059693-3be9-4635-a42d-3024199dd976
Jul 03 01:14:08 devstack sudo[98165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:09 devstack sudo[98165]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-31f7bf3a-7613-4957-8efe-e8f926635d73 tempest-CreateVolumesFromSnapshotTest-2114505382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-34059693-3be9-4635-a42d-3024199dd976" returned: 0 in 1.027s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-31f7bf3a-7613-4957-8efe-e8f926635d73 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-34059693-3be9-4635-a42d-3024199dd976.a6ff2c37-cbc1-4424-bad4-db4fa421d499 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:09 devstack sudo[98176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-34059693-3be9-4635-a42d-3024199dd976.a6ff2c37-cbc1-4424-bad4-db4fa421d499
Jul 03 01:14:09 devstack sudo[98176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:09 devstack sudo[98166]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5e545799-24a4-4716-882f-0fc6c9133d41 tempest-SnapshotsActionsTest-1724460990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb61df4c-825f-42e7-9372-b6ece8df5cee -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.4ce137a9-f9d4-42ad-bc05-7381f934f830" returned: 0 in 1.030s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:09 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-5e545799-24a4-4716-882f-0fc6c9133d41 tempest-SnapshotsActionsTest-1724460990 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.4ce137a9-f9d4-42ad-bc05-7381f934f830 is being set with open permissions: ugo+rw
Jul 03 01:14:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5e545799-24a4-4716-882f-0fc6c9133d41 tempest-SnapshotsActionsTest-1724460990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.4ce137a9-f9d4-42ad-bc05-7381f934f830 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:09 devstack sudo[98178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.4ce137a9-f9d4-42ad-bc05-7381f934f830
Jul 03 01:14:09 devstack sudo[98178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:10 devstack sudo[98178]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:10 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5e545799-24a4-4716-882f-0fc6c9133d41 tempest-SnapshotsActionsTest-1724460990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.4ce137a9-f9d4-42ad-bc05-7381f934f830" returned: 0 in 0.823s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:10 devstack sudo[98176]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:10 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-5e545799-24a4-4716-882f-0fc6c9133d41 tempest-SnapshotsActionsTest-1724460990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.236s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:14:10 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-31f7bf3a-7613-4957-8efe-e8f926635d73 tempest-CreateVolumesFromSnapshotTest-2114505382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-34059693-3be9-4635-a42d-3024199dd976.a6ff2c37-cbc1-4424-bad4-db4fa421d499" returned: 0 in 0.976s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:10 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-31f7bf3a-7613-4957-8efe-e8f926635d73 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-34059693-3be9-4635-a42d-3024199dd976.a6ff2c37-cbc1-4424-bad4-db4fa421d499 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:10 devstack sudo[98186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-34059693-3be9-4635-a42d-3024199dd976.a6ff2c37-cbc1-4424-bad4-db4fa421d499
Jul 03 01:14:10 devstack sudo[98186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:10 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-5e545799-24a4-4716-882f-0fc6c9133d41 tempest-SnapshotsActionsTest-1724460990 None] Create snapshot completed successfully
Jul 03 01:14:11 devstack sudo[98186]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:11 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-31f7bf3a-7613-4957-8efe-e8f926635d73 tempest-CreateVolumesFromSnapshotTest-2114505382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-34059693-3be9-4635-a42d-3024199dd976.a6ff2c37-cbc1-4424-bad4-db4fa421d499" returned: 0 in 0.727s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:11 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-31f7bf3a-7613-4957-8efe-e8f926635d73 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Lock "cinder-quobyte-a6ff2c37-cbc1-4424-bad4-db4fa421d499" released by "_delete_snapshot" :: held 3.916s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:14:11 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-31f7bf3a-7613-4957-8efe-e8f926635d73 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Lock "cinder-quobyte-34059693-3be9-4635-a42d-3024199dd976" released by "delete_snapshot" :: held 3.955s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:14:11 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-31f7bf3a-7613-4957-8efe-e8f926635d73 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Created reservations ['c0b5b9d8-6e6b-4ff3-91d0-0cda3d3c20f5', '2f73974e-1809-478b-9347-1ba49ff3118a', 'e9f6dbff-ec44-4138-85fd-b3ad89a97c2c', 'c7239fba-8b3a-4c90-adb2-493c762c7d27'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:14:11 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-31f7bf3a-7613-4957-8efe-e8f926635d73 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Delete snapshot completed successfully.
Jul 03 01:14:11 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-31f7bf3a-7613-4957-8efe-e8f926635d73 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Lock "cinder-a6ff2c37-cbc1-4424-bad4-db4fa421d499-delete_snapshot" released by "delete_snapshot" :: held 4.161s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:14:11 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-c846c83d-0af5-4901-98d6-63ef1504b735 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Acquiring lock "cinder-34059693-3be9-4635-a42d-3024199dd976-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:14:11 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-c846c83d-0af5-4901-98d6-63ef1504b735 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Lock "cinder-34059693-3be9-4635-a42d-3024199dd976-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:14:11 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-3c542374-f47a-43e8-ad84-4c8b118bd5b4 tempest-SnapshotsActionsTest-647828101 None] Acquiring lock "cinder-4ce137a9-f9d4-42ad-bc05-7381f934f830-delete_snapshot" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:14:11 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-c846c83d-0af5-4901-98d6-63ef1504b735 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Acquiring lock "cinder-quobyte-34059693-3be9-4635-a42d-3024199dd976" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:14:12 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-c846c83d-0af5-4901-98d6-63ef1504b735 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Lock "cinder-quobyte-34059693-3be9-4635-a42d-3024199dd976" acquired by "delete_volume" :: waited 0.022s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:14:12 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-3c542374-f47a-43e8-ad84-4c8b118bd5b4 tempest-SnapshotsActionsTest-647828101 None] Lock "cinder-4ce137a9-f9d4-42ad-bc05-7381f934f830-delete_snapshot" acquired by "delete_snapshot" :: waited 0.073s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:14:12 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-3c542374-f47a-43e8-ad84-4c8b118bd5b4 tempest-SnapshotsActionsTest-647828101 None] Acquiring lock "cinder-quobyte-7d1b77c3-b58d-4c30-8075-2e237b09fdf4" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:14:12 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7b2909-99f0-469a-ba48-caed6fd54431]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:14:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c846c83d-0af5-4901-98d6-63ef1504b735 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-34059693-3be9-4635-a42d-3024199dd976 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:12 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-3c542374-f47a-43e8-ad84-4c8b118bd5b4 tempest-SnapshotsActionsTest-647828101 None] Lock "cinder-quobyte-7d1b77c3-b58d-4c30-8075-2e237b09fdf4" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:14:12 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-3c542374-f47a-43e8-ad84-4c8b118bd5b4 tempest-SnapshotsActionsTest-647828101 None] Acquiring lock "cinder-quobyte-4ce137a9-f9d4-42ad-bc05-7381f934f830" by "_delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:14:12 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-3c542374-f47a-43e8-ad84-4c8b118bd5b4 tempest-SnapshotsActionsTest-647828101 None] Lock "cinder-quobyte-4ce137a9-f9d4-42ad-bc05-7381f934f830" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:14:12 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-3c542374-f47a-43e8-ad84-4c8b118bd5b4 tempest-SnapshotsActionsTest-647828101 None] Deleting offline snapshot 4ce137a9-f9d4-42ad-bc05-7381f934f830 of volume 7d1b77c3-b58d-4c30-8075-2e237b09fdf4 {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 01:14:12 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-3c542374-f47a-43e8-ad84-4c8b118bd5b4 tempest-SnapshotsActionsTest-647828101 None] snapshot_file for this snap is: volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.4ce137a9-f9d4-42ad-bc05-7381f934f830 {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 01:14:12 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef56dec-1998-4b48-b2cc-b2fab3dea6e8]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:14:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-3c542374-f47a-43e8-ad84-4c8b118bd5b4 tempest-SnapshotsActionsTest-647828101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.4ce137a9-f9d4-42ad-bc05-7381f934f830 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:12 devstack sudo[98189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-34059693-3be9-4635-a42d-3024199dd976
Jul 03 01:14:12 devstack sudo[98189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:12 devstack sudo[98191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.4ce137a9-f9d4-42ad-bc05-7381f934f830
Jul 03 01:14:12 devstack sudo[98191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:13 devstack sudo[98189]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c846c83d-0af5-4901-98d6-63ef1504b735 tempest-CreateVolumesFromSnapshotTest-2114505382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-34059693-3be9-4635-a42d-3024199dd976" returned: 0 in 1.077s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c846c83d-0af5-4901-98d6-63ef1504b735 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-34059693-3be9-4635-a42d-3024199dd976 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:13 devstack sudo[98200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-34059693-3be9-4635-a42d-3024199dd976
Jul 03 01:14:13 devstack sudo[98200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:13 devstack sudo[98191]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-3c542374-f47a-43e8-ad84-4c8b118bd5b4 tempest-SnapshotsActionsTest-647828101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.4ce137a9-f9d4-42ad-bc05-7381f934f830" returned: 0 in 1.110s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:13 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-3c542374-f47a-43e8-ad84-4c8b118bd5b4 tempest-SnapshotsActionsTest-647828101 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:14:13 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d33e07-4aaf-4bf3-8936-8984d67c72f4]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:14:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-3c542374-f47a-43e8-ad84-4c8b118bd5b4 tempest-SnapshotsActionsTest-647828101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb61df4c-825f-42e7-9372-b6ece8df5cee {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:13 devstack sudo[98202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb61df4c-825f-42e7-9372-b6ece8df5cee
Jul 03 01:14:13 devstack sudo[98202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:13 devstack sudo[98200]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c846c83d-0af5-4901-98d6-63ef1504b735 tempest-CreateVolumesFromSnapshotTest-2114505382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-34059693-3be9-4635-a42d-3024199dd976" returned: 0 in 0.783s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:13 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-c846c83d-0af5-4901-98d6-63ef1504b735 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Lock "cinder-quobyte-34059693-3be9-4635-a42d-3024199dd976" released by "delete_volume" :: held 1.957s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:14:14 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-c846c83d-0af5-4901-98d6-63ef1504b735 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Created reservations ['f218b24b-84e0-498c-8c56-d4383ba76a8e', '7f15d180-eb86-49c4-8b0d-17bc7b1d6dcd', 'b1e56dee-99cd-4d54-ae43-d48223b2bbce', '35ca8e6d-5283-4151-82f9-551e342c7419'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:14:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-c846c83d-0af5-4901-98d6-63ef1504b735 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:14:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-c846c83d-0af5-4901-98d6-63ef1504b735 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:14:14 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-c846c83d-0af5-4901-98d6-63ef1504b735 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:14:14 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-c846c83d-0af5-4901-98d6-63ef1504b735 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:14:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-c846c83d-0af5-4901-98d6-63ef1504b735 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:14:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c846c83d-0af5-4901-98d6-63ef1504b735 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:14 devstack sudo[98208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:14:14 devstack sudo[98208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:14 devstack sudo[98202]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-3c542374-f47a-43e8-ad84-4c8b118bd5b4 tempest-SnapshotsActionsTest-647828101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb61df4c-825f-42e7-9372-b6ece8df5cee" returned: 0 in 0.969s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:14 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-3c542374-f47a-43e8-ad84-4c8b118bd5b4 tempest-SnapshotsActionsTest-647828101 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:14:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-3c542374-f47a-43e8-ad84-4c8b118bd5b4 tempest-SnapshotsActionsTest-647828101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.4ce137a9-f9d4-42ad-bc05-7381f934f830 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:14 devstack sudo[98210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.4ce137a9-f9d4-42ad-bc05-7381f934f830
Jul 03 01:14:14 devstack sudo[98210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:15 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c5d79ef-f686-4e29-b4ef-04c016632041 tempest-VolumesMetadataTest-1311551532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:14:15 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7c5d79ef-f686-4e29-b4ef-04c016632041 tempest-VolumesMetadataTest-1311551532 None] Flow 'volume_create_manager' (2bb05457-4c5a-4cc3-856f-0dea776193b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:14:15 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7c5d79ef-f686-4e29-b4ef-04c016632041 tempest-VolumesMetadataTest-1311551532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44a2907f-94ee-42fa-a3b1-8fc946025acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:14:15 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7c5d79ef-f686-4e29-b4ef-04c016632041 tempest-VolumesMetadataTest-1311551532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44a2907f-94ee-42fa-a3b1-8fc946025acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:14:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1580814265',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=173aa775-ab12-4768-ab72-566666d3f666,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='298fbf129f9145ce9d5b7146cf3a17bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:14:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:14:15Z,use_quota=True,user_id='3506c0a66c214045b6e7bfd02d6f7377',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:14:15 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7c5d79ef-f686-4e29-b4ef-04c016632041 tempest-VolumesMetadataTest-1311551532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8be714d4-81ea-41fb-a421-68274f851c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:14:15 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7c5d79ef-f686-4e29-b4ef-04c016632041 tempest-VolumesMetadataTest-1311551532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8be714d4-81ea-41fb-a421-68274f851c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:14:15 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7c5d79ef-f686-4e29-b4ef-04c016632041 tempest-VolumesMetadataTest-1311551532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7e21718-760a-4acb-ba8c-0c1697cdb058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:14:15 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7c5d79ef-f686-4e29-b4ef-04c016632041 tempest-VolumesMetadataTest-1311551532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7e21718-760a-4acb-ba8c-0c1697cdb058) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '173aa775-ab12-4768-ab72-566666d3f666', 'volume_name': 'volume-173aa775-ab12-4768-ab72-566666d3f666', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:14:15 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7c5d79ef-f686-4e29-b4ef-04c016632041 tempest-VolumesMetadataTest-1311551532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a272d876-1c92-4753-847b-186201f07b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:14:15 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7c5d79ef-f686-4e29-b4ef-04c016632041 tempest-VolumesMetadataTest-1311551532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a272d876-1c92-4753-847b-186201f07b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:14:15 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7c5d79ef-f686-4e29-b4ef-04c016632041 tempest-VolumesMetadataTest-1311551532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4cb3bb7-b8ff-402d-ad37-ef55c9d19c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:14:15 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-7c5d79ef-f686-4e29-b4ef-04c016632041 tempest-VolumesMetadataTest-1311551532 None] Volume 173aa775-ab12-4768-ab72-566666d3f666: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-173aa775-ab12-4768-ab72-566666d3f666', 'volume_size': 1}
Jul 03 01:14:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-7c5d79ef-f686-4e29-b4ef-04c016632041 tempest-VolumesMetadataTest-1311551532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:14:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-7c5d79ef-f686-4e29-b4ef-04c016632041 tempest-VolumesMetadataTest-1311551532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:14:15 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-7c5d79ef-f686-4e29-b4ef-04c016632041 tempest-VolumesMetadataTest-1311551532 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:14:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1580814265',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=173aa775-ab12-4768-ab72-566666d3f666,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='298fbf129f9145ce9d5b7146cf3a17bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:14:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:14:15Z,use_quota=True,user_id='3506c0a66c214045b6e7bfd02d6f7377',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:14:15 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-7c5d79ef-f686-4e29-b4ef-04c016632041 tempest-VolumesMetadataTest-1311551532 None] Creating volume 173aa775-ab12-4768-ab72-566666d3f666 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:14:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-7c5d79ef-f686-4e29-b4ef-04c016632041 tempest-VolumesMetadataTest-1311551532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:14:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-7c5d79ef-f686-4e29-b4ef-04c016632041 tempest-VolumesMetadataTest-1311551532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:14:15 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-7c5d79ef-f686-4e29-b4ef-04c016632041 tempest-VolumesMetadataTest-1311551532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:14:15 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-7c5d79ef-f686-4e29-b4ef-04c016632041 tempest-VolumesMetadataTest-1311551532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:14:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-7c5d79ef-f686-4e29-b4ef-04c016632041 tempest-VolumesMetadataTest-1311551532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:14:15 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-7c5d79ef-f686-4e29-b4ef-04c016632041 tempest-VolumesMetadataTest-1311551532 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:14:15 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-7c5d79ef-f686-4e29-b4ef-04c016632041 tempest-VolumesMetadataTest-1311551532 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:14:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-7c5d79ef-f686-4e29-b4ef-04c016632041 tempest-VolumesMetadataTest-1311551532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-173aa775-ab12-4768-ab72-566666d3f666 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:15 devstack sudo[98215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-173aa775-ab12-4768-ab72-566666d3f666 1073741824
Jul 03 01:14:15 devstack sudo[98215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:15 devstack sudo[98208]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c846c83d-0af5-4901-98d6-63ef1504b735 tempest-CreateVolumesFromSnapshotTest-2114505382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 1.124s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:15 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-c846c83d-0af5-4901-98d6-63ef1504b735 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:14:15 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-c846c83d-0af5-4901-98d6-63ef1504b735 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Deleted volume successfully.
Jul 03 01:14:15 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-c846c83d-0af5-4901-98d6-63ef1504b735 tempest-CreateVolumesFromSnapshotTest-2114505382 None] Lock "cinder-34059693-3be9-4635-a42d-3024199dd976-delete_volume" released by "delete_volume" :: held 3.416s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:14:15 devstack sudo[98210]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-3c542374-f47a-43e8-ad84-4c8b118bd5b4 tempest-SnapshotsActionsTest-647828101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.4ce137a9-f9d4-42ad-bc05-7381f934f830" returned: 0 in 1.250s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-3c542374-f47a-43e8-ad84-4c8b118bd5b4 tempest-SnapshotsActionsTest-647828101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.4ce137a9-f9d4-42ad-bc05-7381f934f830 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:15 devstack sudo[98219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.4ce137a9-f9d4-42ad-bc05-7381f934f830
Jul 03 01:14:15 devstack sudo[98219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:16 devstack sudo[98215]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-7c5d79ef-f686-4e29-b4ef-04c016632041 tempest-VolumesMetadataTest-1311551532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-173aa775-ab12-4768-ab72-566666d3f666 1073741824" returned: 0 in 1.034s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-7c5d79ef-f686-4e29-b4ef-04c016632041 tempest-VolumesMetadataTest-1311551532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-173aa775-ab12-4768-ab72-566666d3f666 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:16 devstack sudo[98225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-173aa775-ab12-4768-ab72-566666d3f666
Jul 03 01:14:16 devstack sudo[98225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:16 devstack sudo[98219]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-3c542374-f47a-43e8-ad84-4c8b118bd5b4 tempest-SnapshotsActionsTest-647828101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.4ce137a9-f9d4-42ad-bc05-7381f934f830" returned: 0 in 0.902s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:16 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-3c542374-f47a-43e8-ad84-4c8b118bd5b4 tempest-SnapshotsActionsTest-647828101 None] Lock "cinder-quobyte-4ce137a9-f9d4-42ad-bc05-7381f934f830" released by "_delete_snapshot" :: held 4.381s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:14:16 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-3c542374-f47a-43e8-ad84-4c8b118bd5b4 tempest-SnapshotsActionsTest-647828101 None] Lock "cinder-quobyte-7d1b77c3-b58d-4c30-8075-2e237b09fdf4" released by "delete_snapshot" :: held 4.415s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:14:16 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-3c542374-f47a-43e8-ad84-4c8b118bd5b4 tempest-SnapshotsActionsTest-647828101 None] Created reservations ['0e9c1a19-37c1-4f67-8784-935e819e5307', '34e9e68e-f29e-4698-aae9-bfa2b6b55f3a', '1bb03ca1-d465-4126-a4c8-ea0873b0e750', '62961c5c-b1f2-4b26-adc2-65fd0d77d70f'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:14:16 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-3c542374-f47a-43e8-ad84-4c8b118bd5b4 tempest-SnapshotsActionsTest-647828101 None] Delete snapshot completed successfully.
Jul 03 01:14:16 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-3c542374-f47a-43e8-ad84-4c8b118bd5b4 tempest-SnapshotsActionsTest-647828101 None] Lock "cinder-4ce137a9-f9d4-42ad-bc05-7381f934f830-delete_snapshot" released by "delete_snapshot" :: held 4.654s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:14:17 devstack sudo[98225]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-7c5d79ef-f686-4e29-b4ef-04c016632041 tempest-VolumesMetadataTest-1311551532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-173aa775-ab12-4768-ab72-566666d3f666" returned: 0 in 0.786s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:17 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-7c5d79ef-f686-4e29-b4ef-04c016632041 tempest-VolumesMetadataTest-1311551532 None] <== create_volume: return (1879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:14:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-7c5d79ef-f686-4e29-b4ef-04c016632041 tempest-VolumesMetadataTest-1311551532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.882s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:14:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7c5d79ef-f686-4e29-b4ef-04c016632041 tempest-VolumesMetadataTest-1311551532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4cb3bb7-b8ff-402d-ad37-ef55c9d19c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-173aa775-ab12-4768-ab72-566666d3f666', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:14:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7c5d79ef-f686-4e29-b4ef-04c016632041 tempest-VolumesMetadataTest-1311551532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa1c1d03-f05c-470b-88c5-3304a771a407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:14:17 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-7c5d79ef-f686-4e29-b4ef-04c016632041 tempest-VolumesMetadataTest-1311551532 None] Volume volume-173aa775-ab12-4768-ab72-566666d3f666 (173aa775-ab12-4768-ab72-566666d3f666): created successfully
Jul 03 01:14:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7c5d79ef-f686-4e29-b4ef-04c016632041 tempest-VolumesMetadataTest-1311551532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa1c1d03-f05c-470b-88c5-3304a771a407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:14:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7c5d79ef-f686-4e29-b4ef-04c016632041 tempest-VolumesMetadataTest-1311551532 None] Flow 'volume_create_manager' (2bb05457-4c5a-4cc3-856f-0dea776193b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:14:17 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-7c5d79ef-f686-4e29-b4ef-04c016632041 tempest-VolumesMetadataTest-1311551532 None] Created volume successfully.
Jul 03 01:14:17 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-85ee62c6-1a77-48bf-906d-8b044e92cc67 tempest-VolumesListAdminTestJSON-1160832187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:14:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-85ee62c6-1a77-48bf-906d-8b044e92cc67 tempest-VolumesListAdminTestJSON-1160832187 None] Flow 'volume_create_manager' (e04f5391-53e9-4f68-805d-a02ea7f4e47b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:14:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-85ee62c6-1a77-48bf-906d-8b044e92cc67 tempest-VolumesListAdminTestJSON-1160832187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd405880-be7e-4b2d-984b-6c57db594b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:14:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-85ee62c6-1a77-48bf-906d-8b044e92cc67 tempest-VolumesListAdminTestJSON-1160832187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd405880-be7e-4b2d-984b-6c57db594b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:14:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-525167636',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5bf078f-8244-483c-8f34-1b8630791869,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a682961596245e492a9fdf558ea284b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:14:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:14:17Z,use_quota=True,user_id='bac2678d14e14af294992d1aff0997ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:14:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-85ee62c6-1a77-48bf-906d-8b044e92cc67 tempest-VolumesListAdminTestJSON-1160832187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2d4873a-874a-4d39-a2be-9ec863ae5f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:14:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-85ee62c6-1a77-48bf-906d-8b044e92cc67 tempest-VolumesListAdminTestJSON-1160832187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2d4873a-874a-4d39-a2be-9ec863ae5f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:14:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-85ee62c6-1a77-48bf-906d-8b044e92cc67 tempest-VolumesListAdminTestJSON-1160832187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94600124-720f-4d70-be12-b09ada707f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:14:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-85ee62c6-1a77-48bf-906d-8b044e92cc67 tempest-VolumesListAdminTestJSON-1160832187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94600124-720f-4d70-be12-b09ada707f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5bf078f-8244-483c-8f34-1b8630791869', 'volume_name': 'volume-e5bf078f-8244-483c-8f34-1b8630791869', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:14:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-85ee62c6-1a77-48bf-906d-8b044e92cc67 tempest-VolumesListAdminTestJSON-1160832187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47af54c9-70b3-47ce-bb08-5e6d4a5b5322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:14:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-85ee62c6-1a77-48bf-906d-8b044e92cc67 tempest-VolumesListAdminTestJSON-1160832187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47af54c9-70b3-47ce-bb08-5e6d4a5b5322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:14:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-85ee62c6-1a77-48bf-906d-8b044e92cc67 tempest-VolumesListAdminTestJSON-1160832187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27010170-5c3c-4109-99ae-92b9c1e3d57e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:14:17 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-85ee62c6-1a77-48bf-906d-8b044e92cc67 tempest-VolumesListAdminTestJSON-1160832187 None] Volume e5bf078f-8244-483c-8f34-1b8630791869: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5bf078f-8244-483c-8f34-1b8630791869', 'volume_size': 1}
Jul 03 01:14:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-85ee62c6-1a77-48bf-906d-8b044e92cc67 tempest-VolumesListAdminTestJSON-1160832187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:14:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-85ee62c6-1a77-48bf-906d-8b044e92cc67 tempest-VolumesListAdminTestJSON-1160832187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:14:17 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-85ee62c6-1a77-48bf-906d-8b044e92cc67 tempest-VolumesListAdminTestJSON-1160832187 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:14:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-525167636',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5bf078f-8244-483c-8f34-1b8630791869,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a682961596245e492a9fdf558ea284b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:14:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:14:17Z,use_quota=True,user_id='bac2678d14e14af294992d1aff0997ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:14:17 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-85ee62c6-1a77-48bf-906d-8b044e92cc67 tempest-VolumesListAdminTestJSON-1160832187 None] Creating volume e5bf078f-8244-483c-8f34-1b8630791869 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:14:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-85ee62c6-1a77-48bf-906d-8b044e92cc67 tempest-VolumesListAdminTestJSON-1160832187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:14:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-85ee62c6-1a77-48bf-906d-8b044e92cc67 tempest-VolumesListAdminTestJSON-1160832187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:14:17 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-85ee62c6-1a77-48bf-906d-8b044e92cc67 tempest-VolumesListAdminTestJSON-1160832187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:14:17 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-85ee62c6-1a77-48bf-906d-8b044e92cc67 tempest-VolumesListAdminTestJSON-1160832187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:14:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-85ee62c6-1a77-48bf-906d-8b044e92cc67 tempest-VolumesListAdminTestJSON-1160832187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:14:17 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-85ee62c6-1a77-48bf-906d-8b044e92cc67 tempest-VolumesListAdminTestJSON-1160832187 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:14:17 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-85ee62c6-1a77-48bf-906d-8b044e92cc67 tempest-VolumesListAdminTestJSON-1160832187 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:14:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-85ee62c6-1a77-48bf-906d-8b044e92cc67 tempest-VolumesListAdminTestJSON-1160832187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e5bf078f-8244-483c-8f34-1b8630791869 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:17 devstack sudo[98229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e5bf078f-8244-483c-8f34-1b8630791869 1073741824
Jul 03 01:14:17 devstack sudo[98229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:17 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-89231556-618d-4a6f-8080-b546eacc986b tempest-SnapshotsActionsTest-1724460990 None] Acquiring lock "cinder-cb61df4c-825f-42e7-9372-b6ece8df5cee-delete_snapshot" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:14:17 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-89231556-618d-4a6f-8080-b546eacc986b tempest-SnapshotsActionsTest-1724460990 None] Lock "cinder-cb61df4c-825f-42e7-9372-b6ece8df5cee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:14:17 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-89231556-618d-4a6f-8080-b546eacc986b tempest-SnapshotsActionsTest-1724460990 None] Acquiring lock "cinder-quobyte-7d1b77c3-b58d-4c30-8075-2e237b09fdf4" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:14:17 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-89231556-618d-4a6f-8080-b546eacc986b tempest-SnapshotsActionsTest-1724460990 None] Lock "cinder-quobyte-7d1b77c3-b58d-4c30-8075-2e237b09fdf4" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:14:17 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-89231556-618d-4a6f-8080-b546eacc986b tempest-SnapshotsActionsTest-1724460990 None] Acquiring lock "cinder-quobyte-cb61df4c-825f-42e7-9372-b6ece8df5cee" by "_delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:14:17 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-89231556-618d-4a6f-8080-b546eacc986b tempest-SnapshotsActionsTest-1724460990 None] Lock "cinder-quobyte-cb61df4c-825f-42e7-9372-b6ece8df5cee" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:14:17 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-89231556-618d-4a6f-8080-b546eacc986b tempest-SnapshotsActionsTest-1724460990 None] Deleting offline snapshot cb61df4c-825f-42e7-9372-b6ece8df5cee of volume 7d1b77c3-b58d-4c30-8075-2e237b09fdf4 {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 01:14:17 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-89231556-618d-4a6f-8080-b546eacc986b tempest-SnapshotsActionsTest-1724460990 None] snapshot_file for this snap is: volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb61df4c-825f-42e7-9372-b6ece8df5cee {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 01:14:17 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f0f838-2403-4af3-9d01-52e74b59641e]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:14:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-89231556-618d-4a6f-8080-b546eacc986b tempest-SnapshotsActionsTest-1724460990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb61df4c-825f-42e7-9372-b6ece8df5cee {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:18 devstack sudo[98234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb61df4c-825f-42e7-9372-b6ece8df5cee
Jul 03 01:14:18 devstack sudo[98234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:18 devstack sudo[98229]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-85ee62c6-1a77-48bf-906d-8b044e92cc67 tempest-VolumesListAdminTestJSON-1160832187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e5bf078f-8244-483c-8f34-1b8630791869 1073741824" returned: 0 in 1.002s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-85ee62c6-1a77-48bf-906d-8b044e92cc67 tempest-VolumesListAdminTestJSON-1160832187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e5bf078f-8244-483c-8f34-1b8630791869 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:18 devstack sudo[98239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e5bf078f-8244-483c-8f34-1b8630791869
Jul 03 01:14:18 devstack sudo[98239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:18 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-d30332eb-2c17-47c1-b486-5fba6037df72 tempest-ProjectReaderTests-1513662778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:14:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-d30332eb-2c17-47c1-b486-5fba6037df72 tempest-ProjectReaderTests-1513662778 None] Flow 'volume_create_manager' (4c714d5d-b2e9-4d68-8df0-1e405f0511de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:14:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-d30332eb-2c17-47c1-b486-5fba6037df72 tempest-ProjectReaderTests-1513662778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f3a6043-ccac-46c5-adb5-620a82bde245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:14:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-d30332eb-2c17-47c1-b486-5fba6037df72 tempest-ProjectReaderTests-1513662778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f3a6043-ccac-46c5-adb5-620a82bde245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1983718485',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c58ddb02-f3e8-4d23-b6af-849e30c4f249,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eef18ae0ec594fe18b502dbc7627409c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:14:19Z,use_quota=True,user_id='dadc77d6a8f14a59b7acc8ff1c063fd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:14:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-d30332eb-2c17-47c1-b486-5fba6037df72 tempest-ProjectReaderTests-1513662778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a17f998f-1d10-4c62-9cd7-9365d9171a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:14:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-d30332eb-2c17-47c1-b486-5fba6037df72 tempest-ProjectReaderTests-1513662778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a17f998f-1d10-4c62-9cd7-9365d9171a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:14:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-d30332eb-2c17-47c1-b486-5fba6037df72 tempest-ProjectReaderTests-1513662778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72626ef1-cbad-428b-af7b-8d1b229e0e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:14:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-d30332eb-2c17-47c1-b486-5fba6037df72 tempest-ProjectReaderTests-1513662778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72626ef1-cbad-428b-af7b-8d1b229e0e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c58ddb02-f3e8-4d23-b6af-849e30c4f249', 'volume_name': 'volume-c58ddb02-f3e8-4d23-b6af-849e30c4f249', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:14:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-d30332eb-2c17-47c1-b486-5fba6037df72 tempest-ProjectReaderTests-1513662778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d71449e-2e2e-4a78-84b8-45c337f0ac8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:14:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-d30332eb-2c17-47c1-b486-5fba6037df72 tempest-ProjectReaderTests-1513662778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d71449e-2e2e-4a78-84b8-45c337f0ac8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:14:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-d30332eb-2c17-47c1-b486-5fba6037df72 tempest-ProjectReaderTests-1513662778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b84196bf-1c58-42cc-b6bd-d370df17009a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:14:18 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-d30332eb-2c17-47c1-b486-5fba6037df72 tempest-ProjectReaderTests-1513662778 None] Volume c58ddb02-f3e8-4d23-b6af-849e30c4f249: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c58ddb02-f3e8-4d23-b6af-849e30c4f249', 'volume_size': 1}
Jul 03 01:14:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-d30332eb-2c17-47c1-b486-5fba6037df72 tempest-ProjectReaderTests-1513662778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:14:18 devstack sudo[98234]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-89231556-618d-4a6f-8080-b546eacc986b tempest-SnapshotsActionsTest-1724460990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb61df4c-825f-42e7-9372-b6ece8df5cee" returned: 0 in 0.899s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:18 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-89231556-618d-4a6f-8080-b546eacc986b tempest-SnapshotsActionsTest-1724460990 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:14:18 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[0263392e-70e2-43b7-bf83-98b98c97fd72]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:14:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-89231556-618d-4a6f-8080-b546eacc986b tempest-SnapshotsActionsTest-1724460990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:19 devstack sudo[98244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4
Jul 03 01:14:19 devstack sudo[98244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:19 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-678c43c5-2de9-4395-ac64-b3e728409394 tempest-VolumesMetadataTest-1311551532 None] Acquiring lock "cinder-173aa775-ab12-4768-ab72-566666d3f666-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:14:19 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-678c43c5-2de9-4395-ac64-b3e728409394 tempest-VolumesMetadataTest-1311551532 None] Lock "cinder-173aa775-ab12-4768-ab72-566666d3f666-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:14:19 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-678c43c5-2de9-4395-ac64-b3e728409394 tempest-VolumesMetadataTest-1311551532 None] Acquiring lock "cinder-quobyte-173aa775-ab12-4768-ab72-566666d3f666" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:14:19 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-678c43c5-2de9-4395-ac64-b3e728409394 tempest-VolumesMetadataTest-1311551532 None] Lock "cinder-quobyte-173aa775-ab12-4768-ab72-566666d3f666" acquired by "delete_volume" :: waited 0.027s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:14:19 devstack sudo[98239]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:19 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-85ee62c6-1a77-48bf-906d-8b044e92cc67 tempest-VolumesListAdminTestJSON-1160832187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e5bf078f-8244-483c-8f34-1b8630791869" returned: 0 in 0.815s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:19 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-85ee62c6-1a77-48bf-906d-8b044e92cc67 tempest-VolumesListAdminTestJSON-1160832187 None] <== create_volume: return (1892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:14:19 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-85ee62c6-1a77-48bf-906d-8b044e92cc67 tempest-VolumesListAdminTestJSON-1160832187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.895s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:14:19 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-d30332eb-2c17-47c1-b486-5fba6037df72 tempest-ProjectReaderTests-1513662778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.435s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:14:19 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-d30332eb-2c17-47c1-b486-5fba6037df72 tempest-ProjectReaderTests-1513662778 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1983718485',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c58ddb02-f3e8-4d23-b6af-849e30c4f249,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eef18ae0ec594fe18b502dbc7627409c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:14:19Z,use_quota=True,user_id='dadc77d6a8f14a59b7acc8ff1c063fd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:14:19 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-d30332eb-2c17-47c1-b486-5fba6037df72 tempest-ProjectReaderTests-1513662778 None] Creating volume c58ddb02-f3e8-4d23-b6af-849e30c4f249 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:14:19 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-d30332eb-2c17-47c1-b486-5fba6037df72 tempest-ProjectReaderTests-1513662778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:14:19 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-d30332eb-2c17-47c1-b486-5fba6037df72 tempest-ProjectReaderTests-1513662778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:14:19 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-d30332eb-2c17-47c1-b486-5fba6037df72 tempest-ProjectReaderTests-1513662778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:14:19 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-d30332eb-2c17-47c1-b486-5fba6037df72 tempest-ProjectReaderTests-1513662778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:14:19 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-d30332eb-2c17-47c1-b486-5fba6037df72 tempest-ProjectReaderTests-1513662778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:14:19 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-d30332eb-2c17-47c1-b486-5fba6037df72 tempest-ProjectReaderTests-1513662778 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:14:19 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-d30332eb-2c17-47c1-b486-5fba6037df72 tempest-ProjectReaderTests-1513662778 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:14:19 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d30332eb-2c17-47c1-b486-5fba6037df72 tempest-ProjectReaderTests-1513662778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c58ddb02-f3e8-4d23-b6af-849e30c4f249 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:19 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[0320da3f-22b9-4878-8336-08e9ef90e28a]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:14:19 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-678c43c5-2de9-4395-ac64-b3e728409394 tempest-VolumesMetadataTest-1311551532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-173aa775-ab12-4768-ab72-566666d3f666 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:19 devstack sudo[98247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c58ddb02-f3e8-4d23-b6af-849e30c4f249 1073741824
Jul 03 01:14:19 devstack sudo[98247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:19 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-85ee62c6-1a77-48bf-906d-8b044e92cc67 tempest-VolumesListAdminTestJSON-1160832187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27010170-5c3c-4109-99ae-92b9c1e3d57e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5bf078f-8244-483c-8f34-1b8630791869', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:14:19 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-85ee62c6-1a77-48bf-906d-8b044e92cc67 tempest-VolumesListAdminTestJSON-1160832187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55daf5d9-27b4-4bd0-aa50-e1c34fe8446e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:14:19 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-85ee62c6-1a77-48bf-906d-8b044e92cc67 tempest-VolumesListAdminTestJSON-1160832187 None] Volume volume-e5bf078f-8244-483c-8f34-1b8630791869 (e5bf078f-8244-483c-8f34-1b8630791869): created successfully
Jul 03 01:14:19 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-85ee62c6-1a77-48bf-906d-8b044e92cc67 tempest-VolumesListAdminTestJSON-1160832187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55daf5d9-27b4-4bd0-aa50-e1c34fe8446e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:14:19 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-85ee62c6-1a77-48bf-906d-8b044e92cc67 tempest-VolumesListAdminTestJSON-1160832187 None] Flow 'volume_create_manager' (e04f5391-53e9-4f68-805d-a02ea7f4e47b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:14:19 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-85ee62c6-1a77-48bf-906d-8b044e92cc67 tempest-VolumesListAdminTestJSON-1160832187 None] Created volume successfully.
Jul 03 01:14:19 devstack sudo[98248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-173aa775-ab12-4768-ab72-566666d3f666
Jul 03 01:14:19 devstack sudo[98248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:19 devstack sudo[98244]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:19 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-89231556-618d-4a6f-8080-b546eacc986b tempest-SnapshotsActionsTest-1724460990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4" returned: 0 in 0.888s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:19 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-89231556-618d-4a6f-8080-b546eacc986b tempest-SnapshotsActionsTest-1724460990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb61df4c-825f-42e7-9372-b6ece8df5cee {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:19 devstack sudo[98255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb61df4c-825f-42e7-9372-b6ece8df5cee
Jul 03 01:14:19 devstack sudo[98255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:20 devstack sudo[98248]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-678c43c5-2de9-4395-ac64-b3e728409394 tempest-VolumesMetadataTest-1311551532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-173aa775-ab12-4768-ab72-566666d3f666" returned: 0 in 0.825s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-678c43c5-2de9-4395-ac64-b3e728409394 tempest-VolumesMetadataTest-1311551532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-173aa775-ab12-4768-ab72-566666d3f666 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:20 devstack sudo[98264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-173aa775-ab12-4768-ab72-566666d3f666
Jul 03 01:14:20 devstack sudo[98264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:20 devstack sudo[98247]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d30332eb-2c17-47c1-b486-5fba6037df72 tempest-ProjectReaderTests-1513662778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c58ddb02-f3e8-4d23-b6af-849e30c4f249 1073741824" returned: 0 in 0.939s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d30332eb-2c17-47c1-b486-5fba6037df72 tempest-ProjectReaderTests-1513662778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c58ddb02-f3e8-4d23-b6af-849e30c4f249 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:20 devstack sudo[98266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c58ddb02-f3e8-4d23-b6af-849e30c4f249
Jul 03 01:14:20 devstack sudo[98266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:20 devstack sudo[98255]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-89231556-618d-4a6f-8080-b546eacc986b tempest-SnapshotsActionsTest-1724460990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb61df4c-825f-42e7-9372-b6ece8df5cee" returned: 0 in 0.816s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-89231556-618d-4a6f-8080-b546eacc986b tempest-SnapshotsActionsTest-1724460990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb61df4c-825f-42e7-9372-b6ece8df5cee {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:20 devstack sudo[98274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb61df4c-825f-42e7-9372-b6ece8df5cee
Jul 03 01:14:20 devstack sudo[98274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:20 devstack sudo[98264]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-678c43c5-2de9-4395-ac64-b3e728409394 tempest-VolumesMetadataTest-1311551532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-173aa775-ab12-4768-ab72-566666d3f666" returned: 0 in 0.716s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:20 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-678c43c5-2de9-4395-ac64-b3e728409394 tempest-VolumesMetadataTest-1311551532 None] Lock "cinder-quobyte-173aa775-ab12-4768-ab72-566666d3f666" released by "delete_volume" :: held 1.609s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:14:20 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-678c43c5-2de9-4395-ac64-b3e728409394 tempest-VolumesMetadataTest-1311551532 None] Created reservations ['c15c2430-58fd-410c-b082-cebc50d6f88c', 'b9aab6da-b10a-4b0a-8ea6-bc53a96f37ba', 'c6bc1274-2761-4fd5-a549-8e99112349a3', '99037a39-4e07-49b5-b312-77dbdfc87ba5'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:14:20 devstack sudo[98266]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d30332eb-2c17-47c1-b486-5fba6037df72 tempest-ProjectReaderTests-1513662778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c58ddb02-f3e8-4d23-b6af-849e30c4f249" returned: 0 in 0.766s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:20 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-d30332eb-2c17-47c1-b486-5fba6037df72 tempest-ProjectReaderTests-1513662778 None] <== create_volume: return (1747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:14:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-d30332eb-2c17-47c1-b486-5fba6037df72 tempest-ProjectReaderTests-1513662778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.750s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:14:20 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-d30332eb-2c17-47c1-b486-5fba6037df72 tempest-ProjectReaderTests-1513662778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b84196bf-1c58-42cc-b6bd-d370df17009a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c58ddb02-f3e8-4d23-b6af-849e30c4f249', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:14:20 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-d30332eb-2c17-47c1-b486-5fba6037df72 tempest-ProjectReaderTests-1513662778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80610ca3-c5db-4be1-a0ac-5d1be0e06c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:14:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-678c43c5-2de9-4395-ac64-b3e728409394 tempest-VolumesMetadataTest-1311551532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:14:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-678c43c5-2de9-4395-ac64-b3e728409394 tempest-VolumesMetadataTest-1311551532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:14:20 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-678c43c5-2de9-4395-ac64-b3e728409394 tempest-VolumesMetadataTest-1311551532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:14:20 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-678c43c5-2de9-4395-ac64-b3e728409394 tempest-VolumesMetadataTest-1311551532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:14:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-678c43c5-2de9-4395-ac64-b3e728409394 tempest-VolumesMetadataTest-1311551532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:14:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-678c43c5-2de9-4395-ac64-b3e728409394 tempest-VolumesMetadataTest-1311551532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:21 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-d30332eb-2c17-47c1-b486-5fba6037df72 tempest-ProjectReaderTests-1513662778 None] Volume volume-c58ddb02-f3e8-4d23-b6af-849e30c4f249 (c58ddb02-f3e8-4d23-b6af-849e30c4f249): created successfully
Jul 03 01:14:21 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-d30332eb-2c17-47c1-b486-5fba6037df72 tempest-ProjectReaderTests-1513662778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80610ca3-c5db-4be1-a0ac-5d1be0e06c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:14:21 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-d30332eb-2c17-47c1-b486-5fba6037df72 tempest-ProjectReaderTests-1513662778 None] Flow 'volume_create_manager' (4c714d5d-b2e9-4d68-8df0-1e405f0511de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:14:21 devstack sudo[98278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:14:21 devstack sudo[98278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:21 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-d30332eb-2c17-47c1-b486-5fba6037df72 tempest-ProjectReaderTests-1513662778 None] Created volume successfully.
Jul 03 01:14:21 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb711252-25d6-44a0-8950-25c1b6a5f3cc tempest-VolumesListAdminTestJSON-1160832187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:14:21 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-eb711252-25d6-44a0-8950-25c1b6a5f3cc tempest-VolumesListAdminTestJSON-1160832187 None] Flow 'volume_create_manager' (7319211c-51a8-4cc1-9988-34f665701e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:14:21 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-eb711252-25d6-44a0-8950-25c1b6a5f3cc tempest-VolumesListAdminTestJSON-1160832187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (889e4141-812c-49c6-8898-39c53f78487a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:14:21 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-eb711252-25d6-44a0-8950-25c1b6a5f3cc tempest-VolumesListAdminTestJSON-1160832187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (889e4141-812c-49c6-8898-39c53f78487a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2144901569',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8193b378-dcc6-40e5-a083-6d9963246d1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a682961596245e492a9fdf558ea284b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:14:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:14:21Z,use_quota=True,user_id='bac2678d14e14af294992d1aff0997ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:14:21 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-eb711252-25d6-44a0-8950-25c1b6a5f3cc tempest-VolumesListAdminTestJSON-1160832187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b5669ca-4a2c-477d-a25a-e4637a623719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:14:21 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-eb711252-25d6-44a0-8950-25c1b6a5f3cc tempest-VolumesListAdminTestJSON-1160832187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b5669ca-4a2c-477d-a25a-e4637a623719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:14:21 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-eb711252-25d6-44a0-8950-25c1b6a5f3cc tempest-VolumesListAdminTestJSON-1160832187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cc57de4-8995-44d1-8999-d00b4bc2bf95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:14:21 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-eb711252-25d6-44a0-8950-25c1b6a5f3cc tempest-VolumesListAdminTestJSON-1160832187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cc57de4-8995-44d1-8999-d00b4bc2bf95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8193b378-dcc6-40e5-a083-6d9963246d1c', 'volume_name': 'volume-8193b378-dcc6-40e5-a083-6d9963246d1c', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:14:21 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-eb711252-25d6-44a0-8950-25c1b6a5f3cc tempest-VolumesListAdminTestJSON-1160832187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3a71cfb-e31e-43a2-9031-44c81d6d02ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:14:21 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-eb711252-25d6-44a0-8950-25c1b6a5f3cc tempest-VolumesListAdminTestJSON-1160832187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3a71cfb-e31e-43a2-9031-44c81d6d02ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:14:21 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-eb711252-25d6-44a0-8950-25c1b6a5f3cc tempest-VolumesListAdminTestJSON-1160832187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32763853-f73f-4447-99c1-a33c1116588e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:14:21 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-eb711252-25d6-44a0-8950-25c1b6a5f3cc tempest-VolumesListAdminTestJSON-1160832187 None] Volume 8193b378-dcc6-40e5-a083-6d9963246d1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8193b378-dcc6-40e5-a083-6d9963246d1c', 'volume_size': 1}
Jul 03 01:14:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-eb711252-25d6-44a0-8950-25c1b6a5f3cc tempest-VolumesListAdminTestJSON-1160832187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:14:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-eb711252-25d6-44a0-8950-25c1b6a5f3cc tempest-VolumesListAdminTestJSON-1160832187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:14:21 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-eb711252-25d6-44a0-8950-25c1b6a5f3cc tempest-VolumesListAdminTestJSON-1160832187 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2144901569',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8193b378-dcc6-40e5-a083-6d9963246d1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a682961596245e492a9fdf558ea284b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:14:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:14:21Z,use_quota=True,user_id='bac2678d14e14af294992d1aff0997ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:14:21 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-eb711252-25d6-44a0-8950-25c1b6a5f3cc tempest-VolumesListAdminTestJSON-1160832187 None] Creating volume 8193b378-dcc6-40e5-a083-6d9963246d1c {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:14:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-eb711252-25d6-44a0-8950-25c1b6a5f3cc tempest-VolumesListAdminTestJSON-1160832187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:14:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-eb711252-25d6-44a0-8950-25c1b6a5f3cc tempest-VolumesListAdminTestJSON-1160832187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:14:21 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-eb711252-25d6-44a0-8950-25c1b6a5f3cc tempest-VolumesListAdminTestJSON-1160832187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:14:21 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-eb711252-25d6-44a0-8950-25c1b6a5f3cc tempest-VolumesListAdminTestJSON-1160832187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:14:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-eb711252-25d6-44a0-8950-25c1b6a5f3cc tempest-VolumesListAdminTestJSON-1160832187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:14:21 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-eb711252-25d6-44a0-8950-25c1b6a5f3cc tempest-VolumesListAdminTestJSON-1160832187 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:14:21 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-eb711252-25d6-44a0-8950-25c1b6a5f3cc tempest-VolumesListAdminTestJSON-1160832187 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:14:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-eb711252-25d6-44a0-8950-25c1b6a5f3cc tempest-VolumesListAdminTestJSON-1160832187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8193b378-dcc6-40e5-a083-6d9963246d1c 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:21 devstack sudo[98280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8193b378-dcc6-40e5-a083-6d9963246d1c 1073741824
Jul 03 01:14:21 devstack sudo[98280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:21 devstack sudo[98274]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-89231556-618d-4a6f-8080-b546eacc986b tempest-SnapshotsActionsTest-1724460990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4.cb61df4c-825f-42e7-9372-b6ece8df5cee" returned: 0 in 0.820s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:21 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-89231556-618d-4a6f-8080-b546eacc986b tempest-SnapshotsActionsTest-1724460990 None] Lock "cinder-quobyte-cb61df4c-825f-42e7-9372-b6ece8df5cee" released by "_delete_snapshot" :: held 3.551s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:14:21 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-89231556-618d-4a6f-8080-b546eacc986b tempest-SnapshotsActionsTest-1724460990 None] Lock "cinder-quobyte-7d1b77c3-b58d-4c30-8075-2e237b09fdf4" released by "delete_snapshot" :: held 3.579s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:14:21 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-89231556-618d-4a6f-8080-b546eacc986b tempest-SnapshotsActionsTest-1724460990 None] Created reservations ['e6c85afd-e1a6-4f6a-a0bf-060fa09b2e8e', 'bed22b4f-ef3a-4d06-9ea7-693e1cf126e3', '46315dcc-8ee1-43d5-abad-5e38667cdc03', 'e56d6cff-58c4-4865-8429-63af8519c5fe'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:14:21 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-89231556-618d-4a6f-8080-b546eacc986b tempest-SnapshotsActionsTest-1724460990 None] Delete snapshot completed successfully.
Jul 03 01:14:21 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-89231556-618d-4a6f-8080-b546eacc986b tempest-SnapshotsActionsTest-1724460990 None] Lock "cinder-cb61df4c-825f-42e7-9372-b6ece8df5cee-delete_snapshot" released by "delete_snapshot" :: held 3.780s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:14:21 devstack sudo[98278]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-678c43c5-2de9-4395-ac64-b3e728409394 tempest-VolumesMetadataTest-1311551532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.738s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:21 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-678c43c5-2de9-4395-ac64-b3e728409394 tempest-VolumesMetadataTest-1311551532 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:14:21 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-678c43c5-2de9-4395-ac64-b3e728409394 tempest-VolumesMetadataTest-1311551532 None] Deleted volume successfully.
Jul 03 01:14:21 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-678c43c5-2de9-4395-ac64-b3e728409394 tempest-VolumesMetadataTest-1311551532 None] Lock "cinder-173aa775-ab12-4768-ab72-566666d3f666-delete_volume" released by "delete_volume" :: held 2.668s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:14:22 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-c73c7266-e56e-41b0-8cca-b5d8c24cf8f0 tempest-ProjectReaderTests-1513662778 None] Acquiring lock "cinder-c58ddb02-f3e8-4d23-b6af-849e30c4f249-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:14:22 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-c73c7266-e56e-41b0-8cca-b5d8c24cf8f0 tempest-ProjectReaderTests-1513662778 None] Lock "cinder-c58ddb02-f3e8-4d23-b6af-849e30c4f249-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:14:22 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-c73c7266-e56e-41b0-8cca-b5d8c24cf8f0 tempest-ProjectReaderTests-1513662778 None] Acquiring lock "cinder-quobyte-c58ddb02-f3e8-4d23-b6af-849e30c4f249" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:14:22 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-c73c7266-e56e-41b0-8cca-b5d8c24cf8f0 tempest-ProjectReaderTests-1513662778 None] Lock "cinder-quobyte-c58ddb02-f3e8-4d23-b6af-849e30c4f249" acquired by "delete_volume" :: waited 0.026s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:14:22 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-a92c7ac2-0802-4327-97e3-0ef8839144ce tempest-SnapshotsActionsTest-1724460990 None] Acquiring lock "cinder-7d1b77c3-b58d-4c30-8075-2e237b09fdf4-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:14:22 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-a92c7ac2-0802-4327-97e3-0ef8839144ce tempest-SnapshotsActionsTest-1724460990 None] Lock "cinder-7d1b77c3-b58d-4c30-8075-2e237b09fdf4-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:14:22 devstack sudo[98280]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:22 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c0ae4c-ac40-4a16-9c30-95b442385347]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:14:22 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c73c7266-e56e-41b0-8cca-b5d8c24cf8f0 tempest-ProjectReaderTests-1513662778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c58ddb02-f3e8-4d23-b6af-849e30c4f249 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:22 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-eb711252-25d6-44a0-8950-25c1b6a5f3cc tempest-VolumesListAdminTestJSON-1160832187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8193b378-dcc6-40e5-a083-6d9963246d1c 1073741824" returned: 0 in 1.158s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:22 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-a92c7ac2-0802-4327-97e3-0ef8839144ce tempest-SnapshotsActionsTest-1724460990 None] Acquiring lock "cinder-quobyte-7d1b77c3-b58d-4c30-8075-2e237b09fdf4" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:14:22 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-eb711252-25d6-44a0-8950-25c1b6a5f3cc tempest-VolumesListAdminTestJSON-1160832187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8193b378-dcc6-40e5-a083-6d9963246d1c {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:22 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-a92c7ac2-0802-4327-97e3-0ef8839144ce tempest-SnapshotsActionsTest-1724460990 None] Lock "cinder-quobyte-7d1b77c3-b58d-4c30-8075-2e237b09fdf4" acquired by "delete_volume" :: waited 0.026s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:14:22 devstack sudo[98289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8193b378-dcc6-40e5-a083-6d9963246d1c
Jul 03 01:14:22 devstack sudo[98289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:22 devstack sudo[98288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c58ddb02-f3e8-4d23-b6af-849e30c4f249
Jul 03 01:14:22 devstack sudo[98288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:22 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[680aa365-fc09-4382-a336-1feba1d69e6f]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:14:22 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a92c7ac2-0802-4327-97e3-0ef8839144ce tempest-SnapshotsActionsTest-1724460990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:22 devstack sudo[98292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4
Jul 03 01:14:22 devstack sudo[98292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:23 devstack sudo[98289]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-eb711252-25d6-44a0-8950-25c1b6a5f3cc tempest-VolumesListAdminTestJSON-1160832187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8193b378-dcc6-40e5-a083-6d9963246d1c" returned: 0 in 0.746s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:23 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-eb711252-25d6-44a0-8950-25c1b6a5f3cc tempest-VolumesListAdminTestJSON-1160832187 None] <== create_volume: return (1972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:14:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-eb711252-25d6-44a0-8950-25c1b6a5f3cc tempest-VolumesListAdminTestJSON-1160832187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.974s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:14:23 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-eb711252-25d6-44a0-8950-25c1b6a5f3cc tempest-VolumesListAdminTestJSON-1160832187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32763853-f73f-4447-99c1-a33c1116588e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8193b378-dcc6-40e5-a083-6d9963246d1c', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:14:23 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-eb711252-25d6-44a0-8950-25c1b6a5f3cc tempest-VolumesListAdminTestJSON-1160832187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (961a587c-a824-410a-a8d0-d0515835085d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:14:23 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-eb711252-25d6-44a0-8950-25c1b6a5f3cc tempest-VolumesListAdminTestJSON-1160832187 None] Volume volume-8193b378-dcc6-40e5-a083-6d9963246d1c (8193b378-dcc6-40e5-a083-6d9963246d1c): created successfully
Jul 03 01:14:23 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-eb711252-25d6-44a0-8950-25c1b6a5f3cc tempest-VolumesListAdminTestJSON-1160832187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (961a587c-a824-410a-a8d0-d0515835085d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:14:23 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-eb711252-25d6-44a0-8950-25c1b6a5f3cc tempest-VolumesListAdminTestJSON-1160832187 None] Flow 'volume_create_manager' (7319211c-51a8-4cc1-9988-34f665701e45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:14:23 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-eb711252-25d6-44a0-8950-25c1b6a5f3cc tempest-VolumesListAdminTestJSON-1160832187 None] Created volume successfully.
Jul 03 01:14:23 devstack sudo[98288]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c73c7266-e56e-41b0-8cca-b5d8c24cf8f0 tempest-ProjectReaderTests-1513662778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c58ddb02-f3e8-4d23-b6af-849e30c4f249" returned: 0 in 1.025s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c73c7266-e56e-41b0-8cca-b5d8c24cf8f0 tempest-ProjectReaderTests-1513662778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c58ddb02-f3e8-4d23-b6af-849e30c4f249 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:23 devstack sudo[98302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c58ddb02-f3e8-4d23-b6af-849e30c4f249
Jul 03 01:14:23 devstack sudo[98302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:23 devstack sudo[98292]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a92c7ac2-0802-4327-97e3-0ef8839144ce tempest-SnapshotsActionsTest-1724460990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4" returned: 0 in 0.958s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a92c7ac2-0802-4327-97e3-0ef8839144ce tempest-SnapshotsActionsTest-1724460990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:23 devstack sudo[98304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4
Jul 03 01:14:23 devstack sudo[98304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:24 devstack sudo[98302]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c73c7266-e56e-41b0-8cca-b5d8c24cf8f0 tempest-ProjectReaderTests-1513662778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c58ddb02-f3e8-4d23-b6af-849e30c4f249" returned: 0 in 0.695s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:24 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-c73c7266-e56e-41b0-8cca-b5d8c24cf8f0 tempest-ProjectReaderTests-1513662778 None] Lock "cinder-quobyte-c58ddb02-f3e8-4d23-b6af-849e30c4f249" released by "delete_volume" :: held 1.804s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:14:24 devstack sudo[98304]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a92c7ac2-0802-4327-97e3-0ef8839144ce tempest-SnapshotsActionsTest-1724460990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7d1b77c3-b58d-4c30-8075-2e237b09fdf4" returned: 0 in 0.683s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:24 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-c73c7266-e56e-41b0-8cca-b5d8c24cf8f0 tempest-ProjectReaderTests-1513662778 None] Created reservations ['5732e3ff-b321-4384-b881-89322151e304', 'b87504ab-c125-4569-9b94-9bdd15353b56', '9b59f49e-9efc-48e3-bde0-6f592798b4b8', 'd4490ebe-a4d9-4a23-9f84-d7b7e3298190'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:14:24 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-a92c7ac2-0802-4327-97e3-0ef8839144ce tempest-SnapshotsActionsTest-1724460990 None] Lock "cinder-quobyte-7d1b77c3-b58d-4c30-8075-2e237b09fdf4" released by "delete_volume" :: held 1.724s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:14:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-c73c7266-e56e-41b0-8cca-b5d8c24cf8f0 tempest-ProjectReaderTests-1513662778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:14:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-c73c7266-e56e-41b0-8cca-b5d8c24cf8f0 tempest-ProjectReaderTests-1513662778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:14:24 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-c73c7266-e56e-41b0-8cca-b5d8c24cf8f0 tempest-ProjectReaderTests-1513662778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:14:24 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-c73c7266-e56e-41b0-8cca-b5d8c24cf8f0 tempest-ProjectReaderTests-1513662778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:14:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-c73c7266-e56e-41b0-8cca-b5d8c24cf8f0 tempest-ProjectReaderTests-1513662778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:14:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c73c7266-e56e-41b0-8cca-b5d8c24cf8f0 tempest-ProjectReaderTests-1513662778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:24 devstack sudo[98308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:14:24 devstack sudo[98308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:24 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-a92c7ac2-0802-4327-97e3-0ef8839144ce tempest-SnapshotsActionsTest-1724460990 None] Created reservations ['d1b59065-eb12-461a-b621-e80f946eb0ef', 'bf2e736e-396e-4357-8969-01b6cf2577fd', 'aa4ec95b-625c-4fef-9da8-79417b941f63', '1dd36f0e-8094-43a6-8dac-120e260ad711'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:14:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a92c7ac2-0802-4327-97e3-0ef8839144ce tempest-SnapshotsActionsTest-1724460990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:14:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a92c7ac2-0802-4327-97e3-0ef8839144ce tempest-SnapshotsActionsTest-1724460990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:14:24 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-a92c7ac2-0802-4327-97e3-0ef8839144ce tempest-SnapshotsActionsTest-1724460990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:14:24 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-a92c7ac2-0802-4327-97e3-0ef8839144ce tempest-SnapshotsActionsTest-1724460990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:14:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a92c7ac2-0802-4327-97e3-0ef8839144ce tempest-SnapshotsActionsTest-1724460990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:14:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a92c7ac2-0802-4327-97e3-0ef8839144ce tempest-SnapshotsActionsTest-1724460990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:24 devstack sudo[98310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:14:24 devstack sudo[98310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:25 devstack sudo[98308]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c73c7266-e56e-41b0-8cca-b5d8c24cf8f0 tempest-ProjectReaderTests-1513662778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 1.151s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:25 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-c73c7266-e56e-41b0-8cca-b5d8c24cf8f0 tempest-ProjectReaderTests-1513662778 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:14:25 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-c73c7266-e56e-41b0-8cca-b5d8c24cf8f0 tempest-ProjectReaderTests-1513662778 None] Deleted volume successfully.
Jul 03 01:14:25 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-c73c7266-e56e-41b0-8cca-b5d8c24cf8f0 tempest-ProjectReaderTests-1513662778 None] Lock "cinder-c58ddb02-f3e8-4d23-b6af-849e30c4f249-delete_volume" released by "delete_volume" :: held 3.288s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:14:25 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-37624579-b464-4966-931a-e7a75a10b1cf tempest-VolumesListAdminTestJSON-1160832187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:14:25 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-37624579-b464-4966-931a-e7a75a10b1cf tempest-VolumesListAdminTestJSON-1160832187 None] Flow 'volume_create_manager' (d7b562b2-80c6-4757-95a2-85b3dcd5e68e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:14:25 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-37624579-b464-4966-931a-e7a75a10b1cf tempest-VolumesListAdminTestJSON-1160832187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a930ab7-dee6-4257-ac14-2a89c25f1277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:14:25 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-37624579-b464-4966-931a-e7a75a10b1cf tempest-VolumesListAdminTestJSON-1160832187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a930ab7-dee6-4257-ac14-2a89c25f1277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:14:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1826421697',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7d683fb-326b-4541-abd9-cfa7b0e0868a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a682961596245e492a9fdf558ea284b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:14:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:14:25Z,use_quota=True,user_id='bac2678d14e14af294992d1aff0997ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:14:25 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-37624579-b464-4966-931a-e7a75a10b1cf tempest-VolumesListAdminTestJSON-1160832187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (579d2887-5965-4a56-bfe2-08b88c73bb13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:14:25 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-37624579-b464-4966-931a-e7a75a10b1cf tempest-VolumesListAdminTestJSON-1160832187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (579d2887-5965-4a56-bfe2-08b88c73bb13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:14:25 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-37624579-b464-4966-931a-e7a75a10b1cf tempest-VolumesListAdminTestJSON-1160832187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9ac2d6d-801b-4b2e-bada-ebc2f49ecfd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:14:25 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-37624579-b464-4966-931a-e7a75a10b1cf tempest-VolumesListAdminTestJSON-1160832187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9ac2d6d-801b-4b2e-bada-ebc2f49ecfd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7d683fb-326b-4541-abd9-cfa7b0e0868a', 'volume_name': 'volume-f7d683fb-326b-4541-abd9-cfa7b0e0868a', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:14:25 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-37624579-b464-4966-931a-e7a75a10b1cf tempest-VolumesListAdminTestJSON-1160832187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15b10f4b-54e4-4916-8d28-aa9c69711c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:14:25 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-37624579-b464-4966-931a-e7a75a10b1cf tempest-VolumesListAdminTestJSON-1160832187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15b10f4b-54e4-4916-8d28-aa9c69711c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:14:25 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-37624579-b464-4966-931a-e7a75a10b1cf tempest-VolumesListAdminTestJSON-1160832187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45866c6b-a4c5-440a-959e-c910e93c21f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:14:25 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-37624579-b464-4966-931a-e7a75a10b1cf tempest-VolumesListAdminTestJSON-1160832187 None] Volume f7d683fb-326b-4541-abd9-cfa7b0e0868a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7d683fb-326b-4541-abd9-cfa7b0e0868a', 'volume_size': 1}
Jul 03 01:14:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-37624579-b464-4966-931a-e7a75a10b1cf tempest-VolumesListAdminTestJSON-1160832187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:14:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-37624579-b464-4966-931a-e7a75a10b1cf tempest-VolumesListAdminTestJSON-1160832187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:14:25 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-37624579-b464-4966-931a-e7a75a10b1cf tempest-VolumesListAdminTestJSON-1160832187 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:14:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1826421697',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7d683fb-326b-4541-abd9-cfa7b0e0868a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a682961596245e492a9fdf558ea284b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:14:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:14:25Z,use_quota=True,user_id='bac2678d14e14af294992d1aff0997ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:14:25 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-37624579-b464-4966-931a-e7a75a10b1cf tempest-VolumesListAdminTestJSON-1160832187 None] Creating volume f7d683fb-326b-4541-abd9-cfa7b0e0868a {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:14:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-37624579-b464-4966-931a-e7a75a10b1cf tempest-VolumesListAdminTestJSON-1160832187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:14:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-37624579-b464-4966-931a-e7a75a10b1cf tempest-VolumesListAdminTestJSON-1160832187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:14:25 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-37624579-b464-4966-931a-e7a75a10b1cf tempest-VolumesListAdminTestJSON-1160832187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:14:25 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-37624579-b464-4966-931a-e7a75a10b1cf tempest-VolumesListAdminTestJSON-1160832187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:14:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-37624579-b464-4966-931a-e7a75a10b1cf tempest-VolumesListAdminTestJSON-1160832187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:14:25 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-37624579-b464-4966-931a-e7a75a10b1cf tempest-VolumesListAdminTestJSON-1160832187 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:14:25 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-37624579-b464-4966-931a-e7a75a10b1cf tempest-VolumesListAdminTestJSON-1160832187 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:14:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-37624579-b464-4966-931a-e7a75a10b1cf tempest-VolumesListAdminTestJSON-1160832187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-f7d683fb-326b-4541-abd9-cfa7b0e0868a 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:25 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-089c12d9-6e40-45eb-aa3e-0b5d83e88a2a tempest-ProjectReaderTests-1513662778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:14:25 devstack sudo[98348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-f7d683fb-326b-4541-abd9-cfa7b0e0868a 1073741824
Jul 03 01:14:25 devstack sudo[98348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:25 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-089c12d9-6e40-45eb-aa3e-0b5d83e88a2a tempest-ProjectReaderTests-1513662778 None] Flow 'volume_create_manager' (cca76f80-5ce4-4492-812d-d9fbaf93cd13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:14:25 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-089c12d9-6e40-45eb-aa3e-0b5d83e88a2a tempest-ProjectReaderTests-1513662778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (046045a0-fe27-4dbc-8c77-707efa1a5747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:14:25 devstack sudo[98310]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:25 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-089c12d9-6e40-45eb-aa3e-0b5d83e88a2a tempest-ProjectReaderTests-1513662778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (046045a0-fe27-4dbc-8c77-707efa1a5747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:14:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1842422176',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37694c99-97f1-42ef-8ee5-a4faf0438c07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eef18ae0ec594fe18b502dbc7627409c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:14:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:14:25Z,use_quota=True,user_id='dadc77d6a8f14a59b7acc8ff1c063fd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:14:25 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-089c12d9-6e40-45eb-aa3e-0b5d83e88a2a tempest-ProjectReaderTests-1513662778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5a50e6c-e7af-4cb5-be3e-75845e98ee35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:14:25 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-089c12d9-6e40-45eb-aa3e-0b5d83e88a2a tempest-ProjectReaderTests-1513662778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5a50e6c-e7af-4cb5-be3e-75845e98ee35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:14:25 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-089c12d9-6e40-45eb-aa3e-0b5d83e88a2a tempest-ProjectReaderTests-1513662778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71dfc584-cfbb-482e-bce6-2ce2d384bd40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:14:25 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-089c12d9-6e40-45eb-aa3e-0b5d83e88a2a tempest-ProjectReaderTests-1513662778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71dfc584-cfbb-482e-bce6-2ce2d384bd40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37694c99-97f1-42ef-8ee5-a4faf0438c07', 'volume_name': 'volume-37694c99-97f1-42ef-8ee5-a4faf0438c07', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:14:25 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-089c12d9-6e40-45eb-aa3e-0b5d83e88a2a tempest-ProjectReaderTests-1513662778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ce98497-fde3-478b-82b3-2d9101b4f759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:14:25 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-089c12d9-6e40-45eb-aa3e-0b5d83e88a2a tempest-ProjectReaderTests-1513662778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ce98497-fde3-478b-82b3-2d9101b4f759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:14:25 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-089c12d9-6e40-45eb-aa3e-0b5d83e88a2a tempest-ProjectReaderTests-1513662778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27c74dfb-1b66-4407-89fc-df24d4542078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:14:25 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-089c12d9-6e40-45eb-aa3e-0b5d83e88a2a tempest-ProjectReaderTests-1513662778 None] Volume 37694c99-97f1-42ef-8ee5-a4faf0438c07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37694c99-97f1-42ef-8ee5-a4faf0438c07', 'volume_size': 1}
Jul 03 01:14:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-089c12d9-6e40-45eb-aa3e-0b5d83e88a2a tempest-ProjectReaderTests-1513662778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:14:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a92c7ac2-0802-4327-97e3-0ef8839144ce tempest-SnapshotsActionsTest-1724460990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 1.450s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:25 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-a92c7ac2-0802-4327-97e3-0ef8839144ce tempest-SnapshotsActionsTest-1724460990 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:14:25 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-a92c7ac2-0802-4327-97e3-0ef8839144ce tempest-SnapshotsActionsTest-1724460990 None] Deleted volume successfully.
Jul 03 01:14:25 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-a92c7ac2-0802-4327-97e3-0ef8839144ce tempest-SnapshotsActionsTest-1724460990 None] Lock "cinder-7d1b77c3-b58d-4c30-8075-2e237b09fdf4-delete_volume" released by "delete_volume" :: held 3.551s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:14:26 devstack sudo[98348]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:26 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-37624579-b464-4966-931a-e7a75a10b1cf tempest-VolumesListAdminTestJSON-1160832187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-f7d683fb-326b-4541-abd9-cfa7b0e0868a 1073741824" returned: 0 in 1.132s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:26 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-37624579-b464-4966-931a-e7a75a10b1cf tempest-VolumesListAdminTestJSON-1160832187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-f7d683fb-326b-4541-abd9-cfa7b0e0868a {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:26 devstack sudo[98356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-f7d683fb-326b-4541-abd9-cfa7b0e0868a
Jul 03 01:14:26 devstack sudo[98356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:27 devstack sudo[98356]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-37624579-b464-4966-931a-e7a75a10b1cf tempest-VolumesListAdminTestJSON-1160832187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-f7d683fb-326b-4541-abd9-cfa7b0e0868a" returned: 0 in 0.753s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:27 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-37624579-b464-4966-931a-e7a75a10b1cf tempest-VolumesListAdminTestJSON-1160832187 None] <== create_volume: return (1932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:14:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-37624579-b464-4966-931a-e7a75a10b1cf tempest-VolumesListAdminTestJSON-1160832187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.934s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:14:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-089c12d9-6e40-45eb-aa3e-0b5d83e88a2a tempest-ProjectReaderTests-1513662778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.692s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:14:27 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-089c12d9-6e40-45eb-aa3e-0b5d83e88a2a tempest-ProjectReaderTests-1513662778 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:14:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1842422176',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37694c99-97f1-42ef-8ee5-a4faf0438c07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eef18ae0ec594fe18b502dbc7627409c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:14:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:14:25Z,use_quota=True,user_id='dadc77d6a8f14a59b7acc8ff1c063fd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:14:27 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-089c12d9-6e40-45eb-aa3e-0b5d83e88a2a tempest-ProjectReaderTests-1513662778 None] Creating volume 37694c99-97f1-42ef-8ee5-a4faf0438c07 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:14:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-089c12d9-6e40-45eb-aa3e-0b5d83e88a2a tempest-ProjectReaderTests-1513662778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:14:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-089c12d9-6e40-45eb-aa3e-0b5d83e88a2a tempest-ProjectReaderTests-1513662778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:14:27 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-089c12d9-6e40-45eb-aa3e-0b5d83e88a2a tempest-ProjectReaderTests-1513662778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:14:27 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-089c12d9-6e40-45eb-aa3e-0b5d83e88a2a tempest-ProjectReaderTests-1513662778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:14:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-089c12d9-6e40-45eb-aa3e-0b5d83e88a2a tempest-ProjectReaderTests-1513662778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:14:27 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-089c12d9-6e40-45eb-aa3e-0b5d83e88a2a tempest-ProjectReaderTests-1513662778 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:14:27 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-089c12d9-6e40-45eb-aa3e-0b5d83e88a2a tempest-ProjectReaderTests-1513662778 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:14:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-089c12d9-6e40-45eb-aa3e-0b5d83e88a2a tempest-ProjectReaderTests-1513662778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-37694c99-97f1-42ef-8ee5-a4faf0438c07 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:27 devstack sudo[98359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-37694c99-97f1-42ef-8ee5-a4faf0438c07 1073741824
Jul 03 01:14:27 devstack sudo[98359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:27 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-37624579-b464-4966-931a-e7a75a10b1cf tempest-VolumesListAdminTestJSON-1160832187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45866c6b-a4c5-440a-959e-c910e93c21f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7d683fb-326b-4541-abd9-cfa7b0e0868a', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:14:27 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-37624579-b464-4966-931a-e7a75a10b1cf tempest-VolumesListAdminTestJSON-1160832187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c6e497a-f876-49e9-ad53-315d6d655505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:14:27 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-37624579-b464-4966-931a-e7a75a10b1cf tempest-VolumesListAdminTestJSON-1160832187 None] Volume volume-f7d683fb-326b-4541-abd9-cfa7b0e0868a (f7d683fb-326b-4541-abd9-cfa7b0e0868a): created successfully
Jul 03 01:14:27 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-37624579-b464-4966-931a-e7a75a10b1cf tempest-VolumesListAdminTestJSON-1160832187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c6e497a-f876-49e9-ad53-315d6d655505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:14:27 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-37624579-b464-4966-931a-e7a75a10b1cf tempest-VolumesListAdminTestJSON-1160832187 None] Flow 'volume_create_manager' (d7b562b2-80c6-4757-95a2-85b3dcd5e68e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:14:27 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-37624579-b464-4966-931a-e7a75a10b1cf tempest-VolumesListAdminTestJSON-1160832187 None] Created volume successfully.
Jul 03 01:14:28 devstack sudo[98359]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:28 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-089c12d9-6e40-45eb-aa3e-0b5d83e88a2a tempest-ProjectReaderTests-1513662778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-37694c99-97f1-42ef-8ee5-a4faf0438c07 1073741824" returned: 0 in 1.215s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:28 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-089c12d9-6e40-45eb-aa3e-0b5d83e88a2a tempest-ProjectReaderTests-1513662778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-37694c99-97f1-42ef-8ee5-a4faf0438c07 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:28 devstack sudo[98366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-37694c99-97f1-42ef-8ee5-a4faf0438c07
Jul 03 01:14:28 devstack sudo[98366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:29 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6b987bd-f0df-42cb-9e01-5d11f25bd4ba tempest-VolumesListAdminTestJSON-1667824070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:14:29 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f6b987bd-f0df-42cb-9e01-5d11f25bd4ba tempest-VolumesListAdminTestJSON-1667824070 None] Flow 'volume_create_manager' (57aff123-532a-41a8-a0db-0e49ac50f75c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:14:29 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f6b987bd-f0df-42cb-9e01-5d11f25bd4ba tempest-VolumesListAdminTestJSON-1667824070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e739533-0ef3-4dcd-8872-9b9dcb2a9d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:14:29 devstack sudo[98366]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:29 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f6b987bd-f0df-42cb-9e01-5d11f25bd4ba tempest-VolumesListAdminTestJSON-1667824070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e739533-0ef3-4dcd-8872-9b9dcb2a9d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:14:29Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03c8019e-f3e1-48da-9729-c3840f1184f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95beaed97a0a48568412cad2b190e32f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:14:30Z,use_quota=True,user_id='240c92a937c14800baad09374bbd19ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:14:29 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f6b987bd-f0df-42cb-9e01-5d11f25bd4ba tempest-VolumesListAdminTestJSON-1667824070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7914378-fc67-4122-ac24-19e8c99ed76d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:14:29 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f6b987bd-f0df-42cb-9e01-5d11f25bd4ba tempest-VolumesListAdminTestJSON-1667824070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7914378-fc67-4122-ac24-19e8c99ed76d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:14:29 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f6b987bd-f0df-42cb-9e01-5d11f25bd4ba tempest-VolumesListAdminTestJSON-1667824070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a35c52f-efde-4c98-8c6a-e7ed7f667341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:14:29 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f6b987bd-f0df-42cb-9e01-5d11f25bd4ba tempest-VolumesListAdminTestJSON-1667824070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a35c52f-efde-4c98-8c6a-e7ed7f667341) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03c8019e-f3e1-48da-9729-c3840f1184f9', 'volume_name': 'volume-03c8019e-f3e1-48da-9729-c3840f1184f9', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:14:29 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f6b987bd-f0df-42cb-9e01-5d11f25bd4ba tempest-VolumesListAdminTestJSON-1667824070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11bde1be-185c-4efd-b1d7-0d23d2c05600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:14:29 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f6b987bd-f0df-42cb-9e01-5d11f25bd4ba tempest-VolumesListAdminTestJSON-1667824070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11bde1be-185c-4efd-b1d7-0d23d2c05600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:14:29 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f6b987bd-f0df-42cb-9e01-5d11f25bd4ba tempest-VolumesListAdminTestJSON-1667824070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75b69d40-00fa-4848-b346-10905db531e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:14:29 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-f6b987bd-f0df-42cb-9e01-5d11f25bd4ba tempest-VolumesListAdminTestJSON-1667824070 None] Volume 03c8019e-f3e1-48da-9729-c3840f1184f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03c8019e-f3e1-48da-9729-c3840f1184f9', 'volume_size': 1}
Jul 03 01:14:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f6b987bd-f0df-42cb-9e01-5d11f25bd4ba tempest-VolumesListAdminTestJSON-1667824070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:14:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-089c12d9-6e40-45eb-aa3e-0b5d83e88a2a tempest-ProjectReaderTests-1513662778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-37694c99-97f1-42ef-8ee5-a4faf0438c07" returned: 0 in 0.938s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:29 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-089c12d9-6e40-45eb-aa3e-0b5d83e88a2a tempest-ProjectReaderTests-1513662778 None] <== create_volume: return (2225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:14:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-089c12d9-6e40-45eb-aa3e-0b5d83e88a2a tempest-ProjectReaderTests-1513662778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.230s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:14:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f6b987bd-f0df-42cb-9e01-5d11f25bd4ba tempest-VolumesListAdminTestJSON-1667824070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:14:29 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-f6b987bd-f0df-42cb-9e01-5d11f25bd4ba tempest-VolumesListAdminTestJSON-1667824070 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:14:29Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03c8019e-f3e1-48da-9729-c3840f1184f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95beaed97a0a48568412cad2b190e32f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:14:30Z,use_quota=True,user_id='240c92a937c14800baad09374bbd19ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:14:29 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-f6b987bd-f0df-42cb-9e01-5d11f25bd4ba tempest-VolumesListAdminTestJSON-1667824070 None] Creating volume 03c8019e-f3e1-48da-9729-c3840f1184f9 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:14:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f6b987bd-f0df-42cb-9e01-5d11f25bd4ba tempest-VolumesListAdminTestJSON-1667824070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:14:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f6b987bd-f0df-42cb-9e01-5d11f25bd4ba tempest-VolumesListAdminTestJSON-1667824070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:14:29 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-f6b987bd-f0df-42cb-9e01-5d11f25bd4ba tempest-VolumesListAdminTestJSON-1667824070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:14:29 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-f6b987bd-f0df-42cb-9e01-5d11f25bd4ba tempest-VolumesListAdminTestJSON-1667824070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:14:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f6b987bd-f0df-42cb-9e01-5d11f25bd4ba tempest-VolumesListAdminTestJSON-1667824070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:14:29 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-f6b987bd-f0df-42cb-9e01-5d11f25bd4ba tempest-VolumesListAdminTestJSON-1667824070 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:14:29 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-f6b987bd-f0df-42cb-9e01-5d11f25bd4ba tempest-VolumesListAdminTestJSON-1667824070 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:14:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f6b987bd-f0df-42cb-9e01-5d11f25bd4ba tempest-VolumesListAdminTestJSON-1667824070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-03c8019e-f3e1-48da-9729-c3840f1184f9 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:29 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-089c12d9-6e40-45eb-aa3e-0b5d83e88a2a tempest-ProjectReaderTests-1513662778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27c74dfb-1b66-4407-89fc-df24d4542078) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37694c99-97f1-42ef-8ee5-a4faf0438c07', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:14:29 devstack sudo[98369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-03c8019e-f3e1-48da-9729-c3840f1184f9 1073741824
Jul 03 01:14:29 devstack sudo[98369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:29 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-089c12d9-6e40-45eb-aa3e-0b5d83e88a2a tempest-ProjectReaderTests-1513662778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f79c6e30-5fce-4368-9469-74e9fd290ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:14:29 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-089c12d9-6e40-45eb-aa3e-0b5d83e88a2a tempest-ProjectReaderTests-1513662778 None] Volume volume-37694c99-97f1-42ef-8ee5-a4faf0438c07 (37694c99-97f1-42ef-8ee5-a4faf0438c07): created successfully
Jul 03 01:14:29 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-089c12d9-6e40-45eb-aa3e-0b5d83e88a2a tempest-ProjectReaderTests-1513662778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f79c6e30-5fce-4368-9469-74e9fd290ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:14:29 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-089c12d9-6e40-45eb-aa3e-0b5d83e88a2a tempest-ProjectReaderTests-1513662778 None] Flow 'volume_create_manager' (cca76f80-5ce4-4492-812d-d9fbaf93cd13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:14:29 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-089c12d9-6e40-45eb-aa3e-0b5d83e88a2a tempest-ProjectReaderTests-1513662778 None] Created volume successfully.
Jul 03 01:14:30 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-b962c314-8a81-4513-a44a-91a820db49ff tempest-ProjectReaderTests-1513662778 None] Acquiring lock "cinder-37694c99-97f1-42ef-8ee5-a4faf0438c07-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:14:30 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-b962c314-8a81-4513-a44a-91a820db49ff tempest-ProjectReaderTests-1513662778 None] Lock "cinder-37694c99-97f1-42ef-8ee5-a4faf0438c07-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:14:30 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-b962c314-8a81-4513-a44a-91a820db49ff tempest-ProjectReaderTests-1513662778 None] Acquiring lock "cinder-quobyte-37694c99-97f1-42ef-8ee5-a4faf0438c07" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:14:30 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-b962c314-8a81-4513-a44a-91a820db49ff tempest-ProjectReaderTests-1513662778 None] Lock "cinder-quobyte-37694c99-97f1-42ef-8ee5-a4faf0438c07" acquired by "delete_volume" :: waited 0.019s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:14:30 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[7071ce9b-5721-4d72-80ca-ba7a06b72a15]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:14:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b962c314-8a81-4513-a44a-91a820db49ff tempest-ProjectReaderTests-1513662778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-37694c99-97f1-42ef-8ee5-a4faf0438c07 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:30 devstack sudo[98375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-37694c99-97f1-42ef-8ee5-a4faf0438c07
Jul 03 01:14:30 devstack sudo[98375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:30 devstack sudo[98369]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f6b987bd-f0df-42cb-9e01-5d11f25bd4ba tempest-VolumesListAdminTestJSON-1667824070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-03c8019e-f3e1-48da-9729-c3840f1184f9 1073741824" returned: 0 in 1.217s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f6b987bd-f0df-42cb-9e01-5d11f25bd4ba tempest-VolumesListAdminTestJSON-1667824070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-03c8019e-f3e1-48da-9729-c3840f1184f9 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:31 devstack sudo[98377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-03c8019e-f3e1-48da-9729-c3840f1184f9
Jul 03 01:14:31 devstack sudo[98377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:31 devstack sudo[98375]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:31 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b962c314-8a81-4513-a44a-91a820db49ff tempest-ProjectReaderTests-1513662778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-37694c99-97f1-42ef-8ee5-a4faf0438c07" returned: 0 in 1.090s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:31 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b962c314-8a81-4513-a44a-91a820db49ff tempest-ProjectReaderTests-1513662778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-37694c99-97f1-42ef-8ee5-a4faf0438c07 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:31 devstack sudo[98383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-37694c99-97f1-42ef-8ee5-a4faf0438c07
Jul 03 01:14:31 devstack sudo[98383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:32 devstack sudo[98377]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f6b987bd-f0df-42cb-9e01-5d11f25bd4ba tempest-VolumesListAdminTestJSON-1667824070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-03c8019e-f3e1-48da-9729-c3840f1184f9" returned: 0 in 1.150s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:32 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-f6b987bd-f0df-42cb-9e01-5d11f25bd4ba tempest-VolumesListAdminTestJSON-1667824070 None] <== create_volume: return (2428ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:14:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f6b987bd-f0df-42cb-9e01-5d11f25bd4ba tempest-VolumesListAdminTestJSON-1667824070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.433s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:14:32 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f6b987bd-f0df-42cb-9e01-5d11f25bd4ba tempest-VolumesListAdminTestJSON-1667824070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75b69d40-00fa-4848-b346-10905db531e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03c8019e-f3e1-48da-9729-c3840f1184f9', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:14:32 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f6b987bd-f0df-42cb-9e01-5d11f25bd4ba tempest-VolumesListAdminTestJSON-1667824070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98516266-ffb3-4f04-ba63-d0f98212de4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:14:32 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-f6b987bd-f0df-42cb-9e01-5d11f25bd4ba tempest-VolumesListAdminTestJSON-1667824070 None] Volume volume-03c8019e-f3e1-48da-9729-c3840f1184f9 (03c8019e-f3e1-48da-9729-c3840f1184f9): created successfully
Jul 03 01:14:32 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f6b987bd-f0df-42cb-9e01-5d11f25bd4ba tempest-VolumesListAdminTestJSON-1667824070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98516266-ffb3-4f04-ba63-d0f98212de4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:14:32 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f6b987bd-f0df-42cb-9e01-5d11f25bd4ba tempest-VolumesListAdminTestJSON-1667824070 None] Flow 'volume_create_manager' (57aff123-532a-41a8-a0db-0e49ac50f75c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:14:32 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-f6b987bd-f0df-42cb-9e01-5d11f25bd4ba tempest-VolumesListAdminTestJSON-1667824070 None] Created volume successfully.
Jul 03 01:14:32 devstack sudo[98383]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b962c314-8a81-4513-a44a-91a820db49ff tempest-ProjectReaderTests-1513662778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-37694c99-97f1-42ef-8ee5-a4faf0438c07" returned: 0 in 0.830s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:32 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-b962c314-8a81-4513-a44a-91a820db49ff tempest-ProjectReaderTests-1513662778 None] Lock "cinder-quobyte-37694c99-97f1-42ef-8ee5-a4faf0438c07" released by "delete_volume" :: held 1.991s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:14:32 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-b962c314-8a81-4513-a44a-91a820db49ff tempest-ProjectReaderTests-1513662778 None] Created reservations ['a8e76a39-a479-4958-b427-6f77629a7c3e', '42b8a752-808e-4516-b165-4fd1a8186dff', '5f6b05e5-c90b-4dca-9a15-9909e7cd9281', 'f1fe9320-3070-43e7-868a-2908356a1a58'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:14:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b962c314-8a81-4513-a44a-91a820db49ff tempest-ProjectReaderTests-1513662778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:14:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b962c314-8a81-4513-a44a-91a820db49ff tempest-ProjectReaderTests-1513662778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:14:32 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-b962c314-8a81-4513-a44a-91a820db49ff tempest-ProjectReaderTests-1513662778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:14:32 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-b962c314-8a81-4513-a44a-91a820db49ff tempest-ProjectReaderTests-1513662778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:14:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b962c314-8a81-4513-a44a-91a820db49ff tempest-ProjectReaderTests-1513662778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:14:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b962c314-8a81-4513-a44a-91a820db49ff tempest-ProjectReaderTests-1513662778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:32 devstack sudo[98386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:14:32 devstack sudo[98386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:33 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-a611fc0f-31e9-4bdd-9fe4-57d85f52d3d9 tempest-VolumesListAdminTestJSON-1667824070 None] Acquiring lock "cinder-03c8019e-f3e1-48da-9729-c3840f1184f9-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:14:33 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-a611fc0f-31e9-4bdd-9fe4-57d85f52d3d9 tempest-VolumesListAdminTestJSON-1667824070 None] Lock "cinder-03c8019e-f3e1-48da-9729-c3840f1184f9-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:14:33 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-a611fc0f-31e9-4bdd-9fe4-57d85f52d3d9 tempest-VolumesListAdminTestJSON-1667824070 None] Acquiring lock "cinder-quobyte-03c8019e-f3e1-48da-9729-c3840f1184f9" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:14:33 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-a611fc0f-31e9-4bdd-9fe4-57d85f52d3d9 tempest-VolumesListAdminTestJSON-1667824070 None] Lock "cinder-quobyte-03c8019e-f3e1-48da-9729-c3840f1184f9" acquired by "delete_volume" :: waited 0.036s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:14:33 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-745a4f7e-b15b-4354-9f0c-8922254b41e4 tempest-VolumesListAdminTestJSON-1160832187 None] Acquiring lock "cinder-f7d683fb-326b-4541-abd9-cfa7b0e0868a-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:14:33 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[236ba11d-d067-425e-8bb8-3ac0a5bb6152]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:14:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a611fc0f-31e9-4bdd-9fe4-57d85f52d3d9 tempest-VolumesListAdminTestJSON-1667824070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-03c8019e-f3e1-48da-9729-c3840f1184f9 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:33 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-745a4f7e-b15b-4354-9f0c-8922254b41e4 tempest-VolumesListAdminTestJSON-1160832187 None] Lock "cinder-f7d683fb-326b-4541-abd9-cfa7b0e0868a-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:14:33 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-745a4f7e-b15b-4354-9f0c-8922254b41e4 tempest-VolumesListAdminTestJSON-1160832187 None] Acquiring lock "cinder-quobyte-f7d683fb-326b-4541-abd9-cfa7b0e0868a" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:14:33 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-745a4f7e-b15b-4354-9f0c-8922254b41e4 tempest-VolumesListAdminTestJSON-1160832187 None] Lock "cinder-quobyte-f7d683fb-326b-4541-abd9-cfa7b0e0868a" acquired by "delete_volume" :: waited 0.027s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:14:33 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[7605e3fa-2d02-430d-b67e-9647c4684068]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:14:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-745a4f7e-b15b-4354-9f0c-8922254b41e4 tempest-VolumesListAdminTestJSON-1160832187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-f7d683fb-326b-4541-abd9-cfa7b0e0868a {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:33 devstack sudo[98388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-03c8019e-f3e1-48da-9729-c3840f1184f9
Jul 03 01:14:33 devstack sudo[98388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:33 devstack sudo[98390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-f7d683fb-326b-4541-abd9-cfa7b0e0868a
Jul 03 01:14:33 devstack sudo[98390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:34 devstack sudo[98386]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b962c314-8a81-4513-a44a-91a820db49ff tempest-ProjectReaderTests-1513662778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 1.564s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:34 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-b962c314-8a81-4513-a44a-91a820db49ff tempest-ProjectReaderTests-1513662778 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:14:34 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-b962c314-8a81-4513-a44a-91a820db49ff tempest-ProjectReaderTests-1513662778 None] Deleted volume successfully.
Jul 03 01:14:34 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-b962c314-8a81-4513-a44a-91a820db49ff tempest-ProjectReaderTests-1513662778 None] Lock "cinder-37694c99-97f1-42ef-8ee5-a4faf0438c07-delete_volume" released by "delete_volume" :: held 3.887s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:14:34 devstack sudo[98388]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a611fc0f-31e9-4bdd-9fe4-57d85f52d3d9 tempest-VolumesListAdminTestJSON-1667824070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-03c8019e-f3e1-48da-9729-c3840f1184f9" returned: 0 in 1.220s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a611fc0f-31e9-4bdd-9fe4-57d85f52d3d9 tempest-VolumesListAdminTestJSON-1667824070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-03c8019e-f3e1-48da-9729-c3840f1184f9 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:34 devstack sudo[98399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-03c8019e-f3e1-48da-9729-c3840f1184f9
Jul 03 01:14:34 devstack sudo[98399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:34 devstack sudo[98390]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-745a4f7e-b15b-4354-9f0c-8922254b41e4 tempest-VolumesListAdminTestJSON-1160832187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-f7d683fb-326b-4541-abd9-cfa7b0e0868a" returned: 0 in 1.285s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-745a4f7e-b15b-4354-9f0c-8922254b41e4 tempest-VolumesListAdminTestJSON-1160832187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-f7d683fb-326b-4541-abd9-cfa7b0e0868a {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:34 devstack sudo[98401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-f7d683fb-326b-4541-abd9-cfa7b0e0868a
Jul 03 01:14:34 devstack sudo[98401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:35 devstack sudo[98399]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a611fc0f-31e9-4bdd-9fe4-57d85f52d3d9 tempest-VolumesListAdminTestJSON-1667824070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-03c8019e-f3e1-48da-9729-c3840f1184f9" returned: 0 in 1.001s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:35 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-a611fc0f-31e9-4bdd-9fe4-57d85f52d3d9 tempest-VolumesListAdminTestJSON-1667824070 None] Lock "cinder-quobyte-03c8019e-f3e1-48da-9729-c3840f1184f9" released by "delete_volume" :: held 2.326s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:14:35 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-a611fc0f-31e9-4bdd-9fe4-57d85f52d3d9 tempest-VolumesListAdminTestJSON-1667824070 None] Created reservations ['d877e1c0-be6d-41ef-b26f-01b86b903d61', '27235ea8-50f6-4cf6-97ff-ba2560df7add', '503df991-b81a-47b2-b7af-13f1f0871694', '39fcad48-9b67-422b-bbcb-fd79e264977b'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:14:35 devstack sudo[98401]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-745a4f7e-b15b-4354-9f0c-8922254b41e4 tempest-VolumesListAdminTestJSON-1160832187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-f7d683fb-326b-4541-abd9-cfa7b0e0868a" returned: 0 in 1.040s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:35 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-745a4f7e-b15b-4354-9f0c-8922254b41e4 tempest-VolumesListAdminTestJSON-1160832187 None] Lock "cinder-quobyte-f7d683fb-326b-4541-abd9-cfa7b0e0868a" released by "delete_volume" :: held 2.388s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:14:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a611fc0f-31e9-4bdd-9fe4-57d85f52d3d9 tempest-VolumesListAdminTestJSON-1667824070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:14:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a611fc0f-31e9-4bdd-9fe4-57d85f52d3d9 tempest-VolumesListAdminTestJSON-1667824070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:14:35 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-a611fc0f-31e9-4bdd-9fe4-57d85f52d3d9 tempest-VolumesListAdminTestJSON-1667824070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:14:35 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-a611fc0f-31e9-4bdd-9fe4-57d85f52d3d9 tempest-VolumesListAdminTestJSON-1667824070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:14:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a611fc0f-31e9-4bdd-9fe4-57d85f52d3d9 tempest-VolumesListAdminTestJSON-1667824070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:14:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a611fc0f-31e9-4bdd-9fe4-57d85f52d3d9 tempest-VolumesListAdminTestJSON-1667824070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:35 devstack sudo[98405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:14:35 devstack sudo[98405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:35 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-745a4f7e-b15b-4354-9f0c-8922254b41e4 tempest-VolumesListAdminTestJSON-1160832187 None] Created reservations ['44ac96c5-a5cc-425f-83dd-aad4e8d42fbe', 'dc9c785c-bc07-47eb-8bc0-932c0441fb3a', '16b6f974-4086-4a7a-ba9a-96f9017f57fd', '80af370d-0bb8-4ad9-ae21-5966ae057e59'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:14:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-745a4f7e-b15b-4354-9f0c-8922254b41e4 tempest-VolumesListAdminTestJSON-1160832187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:14:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-745a4f7e-b15b-4354-9f0c-8922254b41e4 tempest-VolumesListAdminTestJSON-1160832187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:14:36 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-745a4f7e-b15b-4354-9f0c-8922254b41e4 tempest-VolumesListAdminTestJSON-1160832187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:14:36 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-745a4f7e-b15b-4354-9f0c-8922254b41e4 tempest-VolumesListAdminTestJSON-1160832187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:14:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-745a4f7e-b15b-4354-9f0c-8922254b41e4 tempest-VolumesListAdminTestJSON-1160832187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:14:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-745a4f7e-b15b-4354-9f0c-8922254b41e4 tempest-VolumesListAdminTestJSON-1160832187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:36 devstack sudo[98407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:14:36 devstack sudo[98407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:36 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-1df8878e-3a85-4b68-99ef-301d2390e466 tempest-VolumesListAdminTestJSON-1160832187 None] Acquiring lock "cinder-8193b378-dcc6-40e5-a083-6d9963246d1c-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:14:36 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-1df8878e-3a85-4b68-99ef-301d2390e466 tempest-VolumesListAdminTestJSON-1160832187 None] Lock "cinder-8193b378-dcc6-40e5-a083-6d9963246d1c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:14:37 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-1df8878e-3a85-4b68-99ef-301d2390e466 tempest-VolumesListAdminTestJSON-1160832187 None] Acquiring lock "cinder-quobyte-8193b378-dcc6-40e5-a083-6d9963246d1c" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:14:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a611fc0f-31e9-4bdd-9fe4-57d85f52d3d9 tempest-VolumesListAdminTestJSON-1667824070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 1.165s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:37 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-a611fc0f-31e9-4bdd-9fe4-57d85f52d3d9 tempest-VolumesListAdminTestJSON-1667824070 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:14:37 devstack sudo[98405]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:37 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-a611fc0f-31e9-4bdd-9fe4-57d85f52d3d9 tempest-VolumesListAdminTestJSON-1667824070 None] Deleted volume successfully.
Jul 03 01:14:37 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-1df8878e-3a85-4b68-99ef-301d2390e466 tempest-VolumesListAdminTestJSON-1160832187 None] Lock "cinder-quobyte-8193b378-dcc6-40e5-a083-6d9963246d1c" acquired by "delete_volume" :: waited 0.031s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:14:37 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c154399-e50e-416b-a1ca-b38dc1c766e4]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:14:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1df8878e-3a85-4b68-99ef-301d2390e466 tempest-VolumesListAdminTestJSON-1160832187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8193b378-dcc6-40e5-a083-6d9963246d1c {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:37 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-a611fc0f-31e9-4bdd-9fe4-57d85f52d3d9 tempest-VolumesListAdminTestJSON-1667824070 None] Lock "cinder-03c8019e-f3e1-48da-9729-c3840f1184f9-delete_volume" released by "delete_volume" :: held 3.999s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:14:37 devstack sudo[98407]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-745a4f7e-b15b-4354-9f0c-8922254b41e4 tempest-VolumesListAdminTestJSON-1160832187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 1.207s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:37 devstack sudo[98411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8193b378-dcc6-40e5-a083-6d9963246d1c
Jul 03 01:14:37 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-745a4f7e-b15b-4354-9f0c-8922254b41e4 tempest-VolumesListAdminTestJSON-1160832187 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:14:37 devstack sudo[98411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:37 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-745a4f7e-b15b-4354-9f0c-8922254b41e4 tempest-VolumesListAdminTestJSON-1160832187 None] Deleted volume successfully.
Jul 03 01:14:37 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-745a4f7e-b15b-4354-9f0c-8922254b41e4 tempest-VolumesListAdminTestJSON-1160832187 None] Lock "cinder-f7d683fb-326b-4541-abd9-cfa7b0e0868a-delete_volume" released by "delete_volume" :: held 3.969s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:14:38 devstack sudo[98411]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1df8878e-3a85-4b68-99ef-301d2390e466 tempest-VolumesListAdminTestJSON-1160832187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8193b378-dcc6-40e5-a083-6d9963246d1c" returned: 0 in 1.194s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1df8878e-3a85-4b68-99ef-301d2390e466 tempest-VolumesListAdminTestJSON-1160832187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8193b378-dcc6-40e5-a083-6d9963246d1c {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:38 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-14a45261-e512-4f01-9e7b-552298b8a9e8 tempest-VolumesActionsTest-1288723690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:14:38 devstack sudo[98417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8193b378-dcc6-40e5-a083-6d9963246d1c
Jul 03 01:14:38 devstack sudo[98417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:38 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-14a45261-e512-4f01-9e7b-552298b8a9e8 tempest-VolumesActionsTest-1288723690 None] Flow 'volume_create_manager' (254c7727-5996-495b-9d65-ee95cb38ea55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:14:38 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-14a45261-e512-4f01-9e7b-552298b8a9e8 tempest-VolumesActionsTest-1288723690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd750594-4efe-492e-bc29-025f2d06fc6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:14:38 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-14a45261-e512-4f01-9e7b-552298b8a9e8 tempest-VolumesActionsTest-1288723690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd750594-4efe-492e-bc29-025f2d06fc6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:14:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1148986669',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48a2c0f1-8c98-4310-87d1-ed911e42f70c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f93d61db18754f04811f95dca8e4e88d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:14:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:14:38Z,use_quota=True,user_id='866409cf415e4093acff9479a14e9509',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:14:38 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-14a45261-e512-4f01-9e7b-552298b8a9e8 tempest-VolumesActionsTest-1288723690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d39a704b-c34d-4682-9b22-35b07c9ae477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:14:38 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-14a45261-e512-4f01-9e7b-552298b8a9e8 tempest-VolumesActionsTest-1288723690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d39a704b-c34d-4682-9b22-35b07c9ae477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:14:38 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-14a45261-e512-4f01-9e7b-552298b8a9e8 tempest-VolumesActionsTest-1288723690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23914df3-1a9d-43c6-ba11-b8b39500baea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:14:38 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-14a45261-e512-4f01-9e7b-552298b8a9e8 tempest-VolumesActionsTest-1288723690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23914df3-1a9d-43c6-ba11-b8b39500baea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48a2c0f1-8c98-4310-87d1-ed911e42f70c', 'volume_name': 'volume-48a2c0f1-8c98-4310-87d1-ed911e42f70c', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:14:38 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-14a45261-e512-4f01-9e7b-552298b8a9e8 tempest-VolumesActionsTest-1288723690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a771e46-f05c-4339-a896-a840baee0d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:14:38 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-14a45261-e512-4f01-9e7b-552298b8a9e8 tempest-VolumesActionsTest-1288723690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a771e46-f05c-4339-a896-a840baee0d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:14:38 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-14a45261-e512-4f01-9e7b-552298b8a9e8 tempest-VolumesActionsTest-1288723690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (138680bc-ced3-4e52-97e8-3a4dfd3d8623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:14:38 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-14a45261-e512-4f01-9e7b-552298b8a9e8 tempest-VolumesActionsTest-1288723690 None] Volume 48a2c0f1-8c98-4310-87d1-ed911e42f70c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48a2c0f1-8c98-4310-87d1-ed911e42f70c', 'volume_size': 1}
Jul 03 01:14:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-14a45261-e512-4f01-9e7b-552298b8a9e8 tempest-VolumesActionsTest-1288723690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:14:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-14a45261-e512-4f01-9e7b-552298b8a9e8 tempest-VolumesActionsTest-1288723690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:14:38 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-14a45261-e512-4f01-9e7b-552298b8a9e8 tempest-VolumesActionsTest-1288723690 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:14:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1148986669',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48a2c0f1-8c98-4310-87d1-ed911e42f70c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f93d61db18754f04811f95dca8e4e88d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:14:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:14:38Z,use_quota=True,user_id='866409cf415e4093acff9479a14e9509',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:14:38 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-14a45261-e512-4f01-9e7b-552298b8a9e8 tempest-VolumesActionsTest-1288723690 None] Creating volume 48a2c0f1-8c98-4310-87d1-ed911e42f70c {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:14:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-14a45261-e512-4f01-9e7b-552298b8a9e8 tempest-VolumesActionsTest-1288723690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:14:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-14a45261-e512-4f01-9e7b-552298b8a9e8 tempest-VolumesActionsTest-1288723690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:14:38 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-14a45261-e512-4f01-9e7b-552298b8a9e8 tempest-VolumesActionsTest-1288723690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:14:38 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-14a45261-e512-4f01-9e7b-552298b8a9e8 tempest-VolumesActionsTest-1288723690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:14:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-14a45261-e512-4f01-9e7b-552298b8a9e8 tempest-VolumesActionsTest-1288723690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:14:38 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-14a45261-e512-4f01-9e7b-552298b8a9e8 tempest-VolumesActionsTest-1288723690 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:14:38 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-14a45261-e512-4f01-9e7b-552298b8a9e8 tempest-VolumesActionsTest-1288723690 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:14:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-14a45261-e512-4f01-9e7b-552298b8a9e8 tempest-VolumesActionsTest-1288723690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-48a2c0f1-8c98-4310-87d1-ed911e42f70c 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:38 devstack sudo[98419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-48a2c0f1-8c98-4310-87d1-ed911e42f70c 1073741824
Jul 03 01:14:38 devstack sudo[98419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:38 devstack sudo[98417]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1df8878e-3a85-4b68-99ef-301d2390e466 tempest-VolumesListAdminTestJSON-1160832187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8193b378-dcc6-40e5-a083-6d9963246d1c" returned: 0 in 0.690s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:39 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-1df8878e-3a85-4b68-99ef-301d2390e466 tempest-VolumesListAdminTestJSON-1160832187 None] Lock "cinder-quobyte-8193b378-dcc6-40e5-a083-6d9963246d1c" released by "delete_volume" :: held 1.951s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:14:39 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-1df8878e-3a85-4b68-99ef-301d2390e466 tempest-VolumesListAdminTestJSON-1160832187 None] Created reservations ['58c302f7-578f-4fb1-a63e-cbd0715b621e', 'ca3f1929-676d-4bb0-924d-21cd42239a80', '02c8746e-9557-415a-b1cd-ae6736a1f71a', '9a51c800-06c6-45f3-93ae-b357b71935a2'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:14:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1df8878e-3a85-4b68-99ef-301d2390e466 tempest-VolumesListAdminTestJSON-1160832187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:14:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1df8878e-3a85-4b68-99ef-301d2390e466 tempest-VolumesListAdminTestJSON-1160832187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:14:39 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-1df8878e-3a85-4b68-99ef-301d2390e466 tempest-VolumesListAdminTestJSON-1160832187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:14:39 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-1df8878e-3a85-4b68-99ef-301d2390e466 tempest-VolumesListAdminTestJSON-1160832187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:14:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1df8878e-3a85-4b68-99ef-301d2390e466 tempest-VolumesListAdminTestJSON-1160832187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:14:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1df8878e-3a85-4b68-99ef-301d2390e466 tempest-VolumesListAdminTestJSON-1160832187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:39 devstack sudo[98426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:14:39 devstack sudo[98426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:39 devstack sudo[98419]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-14a45261-e512-4f01-9e7b-552298b8a9e8 tempest-VolumesActionsTest-1288723690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-48a2c0f1-8c98-4310-87d1-ed911e42f70c 1073741824" returned: 0 in 0.934s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:39 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-64baed33-def5-43aa-b43c-38a4ff913e9a tempest-VolumesListAdminTestJSON-1160832187 None] Acquiring lock "cinder-e5bf078f-8244-483c-8f34-1b8630791869-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:14:39 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-64baed33-def5-43aa-b43c-38a4ff913e9a tempest-VolumesListAdminTestJSON-1160832187 None] Lock "cinder-e5bf078f-8244-483c-8f34-1b8630791869-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:14:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-14a45261-e512-4f01-9e7b-552298b8a9e8 tempest-VolumesActionsTest-1288723690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-48a2c0f1-8c98-4310-87d1-ed911e42f70c {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:39 devstack sudo[98428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-48a2c0f1-8c98-4310-87d1-ed911e42f70c
Jul 03 01:14:39 devstack sudo[98428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:39 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-64baed33-def5-43aa-b43c-38a4ff913e9a tempest-VolumesListAdminTestJSON-1160832187 None] Acquiring lock "cinder-quobyte-e5bf078f-8244-483c-8f34-1b8630791869" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:14:39 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-64baed33-def5-43aa-b43c-38a4ff913e9a tempest-VolumesListAdminTestJSON-1160832187 None] Lock "cinder-quobyte-e5bf078f-8244-483c-8f34-1b8630791869" acquired by "delete_volume" :: waited 0.018s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:14:39 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f5811e-bcb2-43e4-847d-9b3e59e65f3a]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:14:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-64baed33-def5-43aa-b43c-38a4ff913e9a tempest-VolumesListAdminTestJSON-1160832187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e5bf078f-8244-483c-8f34-1b8630791869 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:39 devstack sudo[98433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e5bf078f-8244-483c-8f34-1b8630791869
Jul 03 01:14:39 devstack sudo[98433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:39 devstack sudo[98426]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1df8878e-3a85-4b68-99ef-301d2390e466 tempest-VolumesListAdminTestJSON-1160832187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.789s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:39 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-1df8878e-3a85-4b68-99ef-301d2390e466 tempest-VolumesListAdminTestJSON-1160832187 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:14:39 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-1df8878e-3a85-4b68-99ef-301d2390e466 tempest-VolumesListAdminTestJSON-1160832187 None] Deleted volume successfully.
Jul 03 01:14:39 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-1df8878e-3a85-4b68-99ef-301d2390e466 tempest-VolumesListAdminTestJSON-1160832187 None] Lock "cinder-8193b378-dcc6-40e5-a083-6d9963246d1c-delete_volume" released by "delete_volume" :: held 3.009s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:14:40 devstack sudo[98428]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-14a45261-e512-4f01-9e7b-552298b8a9e8 tempest-VolumesActionsTest-1288723690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-48a2c0f1-8c98-4310-87d1-ed911e42f70c" returned: 0 in 0.791s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:40 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-14a45261-e512-4f01-9e7b-552298b8a9e8 tempest-VolumesActionsTest-1288723690 None] <== create_volume: return (1803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:14:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-14a45261-e512-4f01-9e7b-552298b8a9e8 tempest-VolumesActionsTest-1288723690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.806s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:14:40 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-14a45261-e512-4f01-9e7b-552298b8a9e8 tempest-VolumesActionsTest-1288723690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (138680bc-ced3-4e52-97e8-3a4dfd3d8623) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48a2c0f1-8c98-4310-87d1-ed911e42f70c', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:14:40 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-14a45261-e512-4f01-9e7b-552298b8a9e8 tempest-VolumesActionsTest-1288723690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a774774b-fae6-4718-9afe-57cc439d39fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:14:40 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-14a45261-e512-4f01-9e7b-552298b8a9e8 tempest-VolumesActionsTest-1288723690 None] Volume volume-48a2c0f1-8c98-4310-87d1-ed911e42f70c (48a2c0f1-8c98-4310-87d1-ed911e42f70c): created successfully
Jul 03 01:14:40 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-14a45261-e512-4f01-9e7b-552298b8a9e8 tempest-VolumesActionsTest-1288723690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a774774b-fae6-4718-9afe-57cc439d39fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:14:40 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-14a45261-e512-4f01-9e7b-552298b8a9e8 tempest-VolumesActionsTest-1288723690 None] Flow 'volume_create_manager' (254c7727-5996-495b-9d65-ee95cb38ea55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:14:40 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-14a45261-e512-4f01-9e7b-552298b8a9e8 tempest-VolumesActionsTest-1288723690 None] Created volume successfully.
Jul 03 01:14:40 devstack sudo[98433]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-64baed33-def5-43aa-b43c-38a4ff913e9a tempest-VolumesListAdminTestJSON-1160832187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e5bf078f-8244-483c-8f34-1b8630791869" returned: 0 in 0.847s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-64baed33-def5-43aa-b43c-38a4ff913e9a tempest-VolumesListAdminTestJSON-1160832187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e5bf078f-8244-483c-8f34-1b8630791869 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:40 devstack sudo[98443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e5bf078f-8244-483c-8f34-1b8630791869
Jul 03 01:14:40 devstack sudo[98443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:41 devstack sudo[98443]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-64baed33-def5-43aa-b43c-38a4ff913e9a tempest-VolumesListAdminTestJSON-1160832187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e5bf078f-8244-483c-8f34-1b8630791869" returned: 0 in 0.681s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:41 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-64baed33-def5-43aa-b43c-38a4ff913e9a tempest-VolumesListAdminTestJSON-1160832187 None] Lock "cinder-quobyte-e5bf078f-8244-483c-8f34-1b8630791869" released by "delete_volume" :: held 1.569s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:14:41 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-64baed33-def5-43aa-b43c-38a4ff913e9a tempest-VolumesListAdminTestJSON-1160832187 None] Created reservations ['5d18a645-6afb-43b0-99c5-4958e2174e65', 'ce617527-847b-4778-9b6b-a11ffdac468a', 'd4e456ab-5b68-4ee7-8f95-458a8fae1120', '9548123a-fdf4-4681-839a-8100992267a6'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:14:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-64baed33-def5-43aa-b43c-38a4ff913e9a tempest-VolumesListAdminTestJSON-1160832187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:14:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-64baed33-def5-43aa-b43c-38a4ff913e9a tempest-VolumesListAdminTestJSON-1160832187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:14:41 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-64baed33-def5-43aa-b43c-38a4ff913e9a tempest-VolumesListAdminTestJSON-1160832187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:14:41 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-64baed33-def5-43aa-b43c-38a4ff913e9a tempest-VolumesListAdminTestJSON-1160832187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:14:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-64baed33-def5-43aa-b43c-38a4ff913e9a tempest-VolumesListAdminTestJSON-1160832187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:14:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-64baed33-def5-43aa-b43c-38a4ff913e9a tempest-VolumesListAdminTestJSON-1160832187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:41 devstack sudo[98446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:14:41 devstack sudo[98446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:41 devstack sudo[98446]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-64baed33-def5-43aa-b43c-38a4ff913e9a tempest-VolumesListAdminTestJSON-1160832187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.702s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:41 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-64baed33-def5-43aa-b43c-38a4ff913e9a tempest-VolumesListAdminTestJSON-1160832187 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:14:41 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-64baed33-def5-43aa-b43c-38a4ff913e9a tempest-VolumesListAdminTestJSON-1160832187 None] Deleted volume successfully.
Jul 03 01:14:41 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-64baed33-def5-43aa-b43c-38a4ff913e9a tempest-VolumesListAdminTestJSON-1160832187 None] Lock "cinder-e5bf078f-8244-483c-8f34-1b8630791869-delete_volume" released by "delete_volume" :: held 2.545s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:14:47 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a5b05bf-d2ec-499f-a460-224c09d3cda1 tempest-SnapshotMetadataTestJSON-45469037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:14:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-4a5b05bf-d2ec-499f-a460-224c09d3cda1 tempest-SnapshotMetadataTestJSON-45469037 None] Flow 'volume_create_manager' (c52d95e4-5b66-4d67-9b59-5f5337e68e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:14:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-4a5b05bf-d2ec-499f-a460-224c09d3cda1 tempest-SnapshotMetadataTestJSON-45469037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86dc9bc0-2da7-431f-8283-a600c5f0d184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:14:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-4a5b05bf-d2ec-499f-a460-224c09d3cda1 tempest-SnapshotMetadataTestJSON-45469037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86dc9bc0-2da7-431f-8283-a600c5f0d184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:14:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1304336766',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a62dc90-cff7-45ed-9474-93e95f104d63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='686080b0e3a945288a0e5490f269ac87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:14:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:14:47Z,use_quota=True,user_id='f7494673e4834ed8b87d6320d63a9312',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:14:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-4a5b05bf-d2ec-499f-a460-224c09d3cda1 tempest-SnapshotMetadataTestJSON-45469037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c9e927f-46d4-41f5-b28e-53955c02bd17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:14:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-4a5b05bf-d2ec-499f-a460-224c09d3cda1 tempest-SnapshotMetadataTestJSON-45469037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c9e927f-46d4-41f5-b28e-53955c02bd17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:14:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-4a5b05bf-d2ec-499f-a460-224c09d3cda1 tempest-SnapshotMetadataTestJSON-45469037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9670bed-19f1-4592-a2a2-ba9681ec70cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:14:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-4a5b05bf-d2ec-499f-a460-224c09d3cda1 tempest-SnapshotMetadataTestJSON-45469037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9670bed-19f1-4592-a2a2-ba9681ec70cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a62dc90-cff7-45ed-9474-93e95f104d63', 'volume_name': 'volume-9a62dc90-cff7-45ed-9474-93e95f104d63', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:14:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-4a5b05bf-d2ec-499f-a460-224c09d3cda1 tempest-SnapshotMetadataTestJSON-45469037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65f45858-5b99-4727-854a-e180078b3b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:14:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-4a5b05bf-d2ec-499f-a460-224c09d3cda1 tempest-SnapshotMetadataTestJSON-45469037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65f45858-5b99-4727-854a-e180078b3b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:14:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-4a5b05bf-d2ec-499f-a460-224c09d3cda1 tempest-SnapshotMetadataTestJSON-45469037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aec8dd67-6a18-4324-8c3c-cb6544b68294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:14:47 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-4a5b05bf-d2ec-499f-a460-224c09d3cda1 tempest-SnapshotMetadataTestJSON-45469037 None] Volume 9a62dc90-cff7-45ed-9474-93e95f104d63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a62dc90-cff7-45ed-9474-93e95f104d63', 'volume_size': 1}
Jul 03 01:14:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-4a5b05bf-d2ec-499f-a460-224c09d3cda1 tempest-SnapshotMetadataTestJSON-45469037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:14:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-4a5b05bf-d2ec-499f-a460-224c09d3cda1 tempest-SnapshotMetadataTestJSON-45469037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:14:47 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-4a5b05bf-d2ec-499f-a460-224c09d3cda1 tempest-SnapshotMetadataTestJSON-45469037 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:14:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1304336766',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a62dc90-cff7-45ed-9474-93e95f104d63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='686080b0e3a945288a0e5490f269ac87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:14:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:14:47Z,use_quota=True,user_id='f7494673e4834ed8b87d6320d63a9312',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:14:47 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-4a5b05bf-d2ec-499f-a460-224c09d3cda1 tempest-SnapshotMetadataTestJSON-45469037 None] Creating volume 9a62dc90-cff7-45ed-9474-93e95f104d63 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:14:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-4a5b05bf-d2ec-499f-a460-224c09d3cda1 tempest-SnapshotMetadataTestJSON-45469037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:14:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-4a5b05bf-d2ec-499f-a460-224c09d3cda1 tempest-SnapshotMetadataTestJSON-45469037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:14:47 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-4a5b05bf-d2ec-499f-a460-224c09d3cda1 tempest-SnapshotMetadataTestJSON-45469037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:14:47 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-4a5b05bf-d2ec-499f-a460-224c09d3cda1 tempest-SnapshotMetadataTestJSON-45469037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:14:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-4a5b05bf-d2ec-499f-a460-224c09d3cda1 tempest-SnapshotMetadataTestJSON-45469037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:14:47 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-4a5b05bf-d2ec-499f-a460-224c09d3cda1 tempest-SnapshotMetadataTestJSON-45469037 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:14:47 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-4a5b05bf-d2ec-499f-a460-224c09d3cda1 tempest-SnapshotMetadataTestJSON-45469037 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:14:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-4a5b05bf-d2ec-499f-a460-224c09d3cda1 tempest-SnapshotMetadataTestJSON-45469037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9a62dc90-cff7-45ed-9474-93e95f104d63 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:47 devstack sudo[98453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9a62dc90-cff7-45ed-9474-93e95f104d63 1073741824
Jul 03 01:14:47 devstack sudo[98453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:48 devstack sudo[98453]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-4a5b05bf-d2ec-499f-a460-224c09d3cda1 tempest-SnapshotMetadataTestJSON-45469037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9a62dc90-cff7-45ed-9474-93e95f104d63 1073741824" returned: 0 in 1.079s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-4a5b05bf-d2ec-499f-a460-224c09d3cda1 tempest-SnapshotMetadataTestJSON-45469037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9a62dc90-cff7-45ed-9474-93e95f104d63 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:48 devstack sudo[98459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9a62dc90-cff7-45ed-9474-93e95f104d63
Jul 03 01:14:48 devstack sudo[98459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:48 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c4c456f-62b6-43bb-b8bf-7e8dedeaa2a0 tempest-VolumeTypesAccessTest-398649924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:14:48 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-0c4c456f-62b6-43bb-b8bf-7e8dedeaa2a0 tempest-VolumeTypesAccessTest-398649924 None] Flow 'volume_create_manager' (6628a712-9f65-44c9-9f74-ea8a05c5757a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:14:48 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-0c4c456f-62b6-43bb-b8bf-7e8dedeaa2a0 tempest-VolumeTypesAccessTest-398649924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da947566-b304-4079-9383-d8aee50b4d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:14:48 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-0c4c456f-62b6-43bb-b8bf-7e8dedeaa2a0 tempest-VolumeTypesAccessTest-398649924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da947566-b304-4079-9383-d8aee50b4d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:14:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1638833669',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42b65466-8034-4288-b285-a4ed3648bdf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a34e2879af464558951d4c9225c13cca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:14:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:14:49Z,use_quota=True,user_id='933ae66505774433ac28bc72cb8815b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b922a84-5180-44e7-8c79-6ea025f87a33),volume_type_id=2b922a84-5180-44e7-8c79-6ea025f87a33)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:14:48 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-0c4c456f-62b6-43bb-b8bf-7e8dedeaa2a0 tempest-VolumeTypesAccessTest-398649924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1e07bb5-90c2-41e4-967f-d7b7cec414f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:14:48 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-0c4c456f-62b6-43bb-b8bf-7e8dedeaa2a0 tempest-VolumeTypesAccessTest-398649924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1e07bb5-90c2-41e4-967f-d7b7cec414f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:14:48 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-0c4c456f-62b6-43bb-b8bf-7e8dedeaa2a0 tempest-VolumeTypesAccessTest-398649924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43fc0db2-2e3a-449f-b34c-2db658f1ff4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:14:48 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-0c4c456f-62b6-43bb-b8bf-7e8dedeaa2a0 tempest-VolumeTypesAccessTest-398649924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43fc0db2-2e3a-449f-b34c-2db658f1ff4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42b65466-8034-4288-b285-a4ed3648bdf5', 'volume_name': 'volume-42b65466-8034-4288-b285-a4ed3648bdf5', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:14:48 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-0c4c456f-62b6-43bb-b8bf-7e8dedeaa2a0 tempest-VolumeTypesAccessTest-398649924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d70d3494-c6db-472d-9bfa-c7220fd53b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:14:48 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-0c4c456f-62b6-43bb-b8bf-7e8dedeaa2a0 tempest-VolumeTypesAccessTest-398649924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d70d3494-c6db-472d-9bfa-c7220fd53b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:14:48 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-0c4c456f-62b6-43bb-b8bf-7e8dedeaa2a0 tempest-VolumeTypesAccessTest-398649924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c292c0e-9573-4ac0-8490-057941566909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:14:48 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-0c4c456f-62b6-43bb-b8bf-7e8dedeaa2a0 tempest-VolumeTypesAccessTest-398649924 None] Volume 42b65466-8034-4288-b285-a4ed3648bdf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42b65466-8034-4288-b285-a4ed3648bdf5', 'volume_size': 1}
Jul 03 01:14:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-0c4c456f-62b6-43bb-b8bf-7e8dedeaa2a0 tempest-VolumeTypesAccessTest-398649924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:14:49 devstack sudo[98459]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-4a5b05bf-d2ec-499f-a460-224c09d3cda1 tempest-SnapshotMetadataTestJSON-45469037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9a62dc90-cff7-45ed-9474-93e95f104d63" returned: 0 in 0.898s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:49 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-4a5b05bf-d2ec-499f-a460-224c09d3cda1 tempest-SnapshotMetadataTestJSON-45469037 None] <== create_volume: return (2040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:14:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-4a5b05bf-d2ec-499f-a460-224c09d3cda1 tempest-SnapshotMetadataTestJSON-45469037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.043s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:14:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-0c4c456f-62b6-43bb-b8bf-7e8dedeaa2a0 tempest-VolumeTypesAccessTest-398649924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.392s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:14:49 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-0c4c456f-62b6-43bb-b8bf-7e8dedeaa2a0 tempest-VolumeTypesAccessTest-398649924 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:14:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1638833669',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42b65466-8034-4288-b285-a4ed3648bdf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a34e2879af464558951d4c9225c13cca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:14:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:14:49Z,use_quota=True,user_id='933ae66505774433ac28bc72cb8815b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b922a84-5180-44e7-8c79-6ea025f87a33),volume_type_id=2b922a84-5180-44e7-8c79-6ea025f87a33)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:14:49 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-0c4c456f-62b6-43bb-b8bf-7e8dedeaa2a0 tempest-VolumeTypesAccessTest-398649924 None] Creating volume 42b65466-8034-4288-b285-a4ed3648bdf5 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:14:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-0c4c456f-62b6-43bb-b8bf-7e8dedeaa2a0 tempest-VolumeTypesAccessTest-398649924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:14:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-0c4c456f-62b6-43bb-b8bf-7e8dedeaa2a0 tempest-VolumeTypesAccessTest-398649924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:14:49 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-0c4c456f-62b6-43bb-b8bf-7e8dedeaa2a0 tempest-VolumeTypesAccessTest-398649924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:14:49 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-0c4c456f-62b6-43bb-b8bf-7e8dedeaa2a0 tempest-VolumeTypesAccessTest-398649924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:14:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-0c4c456f-62b6-43bb-b8bf-7e8dedeaa2a0 tempest-VolumeTypesAccessTest-398649924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:14:49 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-0c4c456f-62b6-43bb-b8bf-7e8dedeaa2a0 tempest-VolumeTypesAccessTest-398649924 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:14:49 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-0c4c456f-62b6-43bb-b8bf-7e8dedeaa2a0 tempest-VolumeTypesAccessTest-398649924 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:14:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0c4c456f-62b6-43bb-b8bf-7e8dedeaa2a0 tempest-VolumeTypesAccessTest-398649924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-42b65466-8034-4288-b285-a4ed3648bdf5 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:49 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-4a5b05bf-d2ec-499f-a460-224c09d3cda1 tempest-SnapshotMetadataTestJSON-45469037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aec8dd67-6a18-4324-8c3c-cb6544b68294) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a62dc90-cff7-45ed-9474-93e95f104d63', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:14:49 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-4a5b05bf-d2ec-499f-a460-224c09d3cda1 tempest-SnapshotMetadataTestJSON-45469037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (200d8518-5fcd-457b-8bd4-56b21dc2d6a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:14:49 devstack sudo[98475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-42b65466-8034-4288-b285-a4ed3648bdf5 1073741824
Jul 03 01:14:49 devstack sudo[98475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:49 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-4a5b05bf-d2ec-499f-a460-224c09d3cda1 tempest-SnapshotMetadataTestJSON-45469037 None] Volume volume-9a62dc90-cff7-45ed-9474-93e95f104d63 (9a62dc90-cff7-45ed-9474-93e95f104d63): created successfully
Jul 03 01:14:49 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-4a5b05bf-d2ec-499f-a460-224c09d3cda1 tempest-SnapshotMetadataTestJSON-45469037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (200d8518-5fcd-457b-8bd4-56b21dc2d6a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:14:49 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-4a5b05bf-d2ec-499f-a460-224c09d3cda1 tempest-SnapshotMetadataTestJSON-45469037 None] Flow 'volume_create_manager' (c52d95e4-5b66-4d67-9b59-5f5337e68e85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:14:49 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-4a5b05bf-d2ec-499f-a460-224c09d3cda1 tempest-SnapshotMetadataTestJSON-45469037 None] Created volume successfully.
Jul 03 01:14:50 devstack sudo[98475]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0c4c456f-62b6-43bb-b8bf-7e8dedeaa2a0 tempest-VolumeTypesAccessTest-398649924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-42b65466-8034-4288-b285-a4ed3648bdf5 1073741824" returned: 0 in 0.897s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0c4c456f-62b6-43bb-b8bf-7e8dedeaa2a0 tempest-VolumeTypesAccessTest-398649924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-42b65466-8034-4288-b285-a4ed3648bdf5 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:50 devstack sudo[98485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-42b65466-8034-4288-b285-a4ed3648bdf5
Jul 03 01:14:50 devstack sudo[98485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f04c8927-cde5-41a7-a566-b3b1f87cc4e8 tempest-SnapshotMetadataTestJSON-45469037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:14:50 devstack sudo[98485]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0c4c456f-62b6-43bb-b8bf-7e8dedeaa2a0 tempest-VolumeTypesAccessTest-398649924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-42b65466-8034-4288-b285-a4ed3648bdf5" returned: 0 in 0.695s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:50 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-0c4c456f-62b6-43bb-b8bf-7e8dedeaa2a0 tempest-VolumeTypesAccessTest-398649924 None] <== create_volume: return (1637ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:14:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-0c4c456f-62b6-43bb-b8bf-7e8dedeaa2a0 tempest-VolumeTypesAccessTest-398649924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.640s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:14:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f04c8927-cde5-41a7-a566-b3b1f87cc4e8 tempest-SnapshotMetadataTestJSON-45469037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.407s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:14:50 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-f04c8927-cde5-41a7-a566-b3b1f87cc4e8 tempest-SnapshotMetadataTestJSON-45469037 None] Creating offline snapshot 5f9da992-4c8c-4462-847f-62644a5c2be5 of volume 9a62dc90-cff7-45ed-9474-93e95f104d63 {{(pid=86891) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 01:14:50 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-0c4c456f-62b6-43bb-b8bf-7e8dedeaa2a0 tempest-VolumeTypesAccessTest-398649924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c292c0e-9573-4ac0-8490-057941566909) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42b65466-8034-4288-b285-a4ed3648bdf5', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:14:50 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-0c4c456f-62b6-43bb-b8bf-7e8dedeaa2a0 tempest-VolumeTypesAccessTest-398649924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47e4a2a4-8550-4461-9e8d-13e9d9db752e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:14:50 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5be4c2-8a9e-451d-af38-e957bc8ce058]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:14:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f04c8927-cde5-41a7-a566-b3b1f87cc4e8 tempest-SnapshotMetadataTestJSON-45469037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9a62dc90-cff7-45ed-9474-93e95f104d63 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:50 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-0c4c456f-62b6-43bb-b8bf-7e8dedeaa2a0 tempest-VolumeTypesAccessTest-398649924 None] Volume volume-42b65466-8034-4288-b285-a4ed3648bdf5 (42b65466-8034-4288-b285-a4ed3648bdf5): created successfully
Jul 03 01:14:50 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-0c4c456f-62b6-43bb-b8bf-7e8dedeaa2a0 tempest-VolumeTypesAccessTest-398649924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47e4a2a4-8550-4461-9e8d-13e9d9db752e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:14:50 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-0c4c456f-62b6-43bb-b8bf-7e8dedeaa2a0 tempest-VolumeTypesAccessTest-398649924 None] Flow 'volume_create_manager' (6628a712-9f65-44c9-9f74-ea8a05c5757a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:14:51 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-0c4c456f-62b6-43bb-b8bf-7e8dedeaa2a0 tempest-VolumeTypesAccessTest-398649924 None] Created volume successfully.
Jul 03 01:14:51 devstack sudo[98488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9a62dc90-cff7-45ed-9474-93e95f104d63
Jul 03 01:14:51 devstack sudo[98488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:51 devstack sudo[98488]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:51 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f04c8927-cde5-41a7-a566-b3b1f87cc4e8 tempest-SnapshotMetadataTestJSON-45469037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9a62dc90-cff7-45ed-9474-93e95f104d63" returned: 0 in 0.769s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:51 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f04c8927-cde5-41a7-a566-b3b1f87cc4e8 tempest-SnapshotMetadataTestJSON-45469037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9a62dc90-cff7-45ed-9474-93e95f104d63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9a62dc90-cff7-45ed-9474-93e95f104d63.5f9da992-4c8c-4462-847f-62644a5c2be5 1G {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:51 devstack sudo[98493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9a62dc90-cff7-45ed-9474-93e95f104d63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9a62dc90-cff7-45ed-9474-93e95f104d63.5f9da992-4c8c-4462-847f-62644a5c2be5 1G
Jul 03 01:14:51 devstack sudo[98493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:52 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5db2a756-1c67-4c36-97f7-35526cd7c144 tempest-VolumeTypesAccessTest-398649924 None] Acquiring lock "cinder-42b65466-8034-4288-b285-a4ed3648bdf5-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:14:52 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5db2a756-1c67-4c36-97f7-35526cd7c144 tempest-VolumeTypesAccessTest-398649924 None] Lock "cinder-42b65466-8034-4288-b285-a4ed3648bdf5-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:14:52 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5db2a756-1c67-4c36-97f7-35526cd7c144 tempest-VolumeTypesAccessTest-398649924 None] Acquiring lock "cinder-quobyte-42b65466-8034-4288-b285-a4ed3648bdf5" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:14:52 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5db2a756-1c67-4c36-97f7-35526cd7c144 tempest-VolumeTypesAccessTest-398649924 None] Lock "cinder-quobyte-42b65466-8034-4288-b285-a4ed3648bdf5" acquired by "delete_volume" :: waited 0.014s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:14:52 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d92c08a-a1ee-4f9b-ade2-a583ede10a38]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:14:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5db2a756-1c67-4c36-97f7-35526cd7c144 tempest-VolumeTypesAccessTest-398649924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-42b65466-8034-4288-b285-a4ed3648bdf5 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:52 devstack sudo[98495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-42b65466-8034-4288-b285-a4ed3648bdf5
Jul 03 01:14:52 devstack sudo[98495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:52 devstack sudo[98493]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f04c8927-cde5-41a7-a566-b3b1f87cc4e8 tempest-SnapshotMetadataTestJSON-45469037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9a62dc90-cff7-45ed-9474-93e95f104d63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9a62dc90-cff7-45ed-9474-93e95f104d63.5f9da992-4c8c-4462-847f-62644a5c2be5 1G" returned: 0 in 0.868s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f04c8927-cde5-41a7-a566-b3b1f87cc4e8 tempest-SnapshotMetadataTestJSON-45469037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a62dc90-cff7-45ed-9474-93e95f104d63 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9a62dc90-cff7-45ed-9474-93e95f104d63.5f9da992-4c8c-4462-847f-62644a5c2be5 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:52 devstack sudo[98500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a62dc90-cff7-45ed-9474-93e95f104d63 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9a62dc90-cff7-45ed-9474-93e95f104d63.5f9da992-4c8c-4462-847f-62644a5c2be5
Jul 03 01:14:52 devstack sudo[98500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:52 devstack sudo[98495]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5db2a756-1c67-4c36-97f7-35526cd7c144 tempest-VolumeTypesAccessTest-398649924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-42b65466-8034-4288-b285-a4ed3648bdf5" returned: 0 in 0.743s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5db2a756-1c67-4c36-97f7-35526cd7c144 tempest-VolumeTypesAccessTest-398649924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-42b65466-8034-4288-b285-a4ed3648bdf5 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:52 devstack sudo[98505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-42b65466-8034-4288-b285-a4ed3648bdf5
Jul 03 01:14:52 devstack sudo[98505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:53 devstack sudo[98500]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f04c8927-cde5-41a7-a566-b3b1f87cc4e8 tempest-SnapshotMetadataTestJSON-45469037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a62dc90-cff7-45ed-9474-93e95f104d63 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9a62dc90-cff7-45ed-9474-93e95f104d63.5f9da992-4c8c-4462-847f-62644a5c2be5" returned: 0 in 0.714s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:53 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-f04c8927-cde5-41a7-a566-b3b1f87cc4e8 tempest-SnapshotMetadataTestJSON-45469037 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9a62dc90-cff7-45ed-9474-93e95f104d63.5f9da992-4c8c-4462-847f-62644a5c2be5 is being set with open permissions: ugo+rw
Jul 03 01:14:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f04c8927-cde5-41a7-a566-b3b1f87cc4e8 tempest-SnapshotMetadataTestJSON-45469037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9a62dc90-cff7-45ed-9474-93e95f104d63.5f9da992-4c8c-4462-847f-62644a5c2be5 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:53 devstack sudo[98513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9a62dc90-cff7-45ed-9474-93e95f104d63.5f9da992-4c8c-4462-847f-62644a5c2be5
Jul 03 01:14:53 devstack sudo[98513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:53 devstack sudo[98505]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5db2a756-1c67-4c36-97f7-35526cd7c144 tempest-VolumeTypesAccessTest-398649924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-42b65466-8034-4288-b285-a4ed3648bdf5" returned: 0 in 0.678s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:53 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5db2a756-1c67-4c36-97f7-35526cd7c144 tempest-VolumeTypesAccessTest-398649924 None] Lock "cinder-quobyte-42b65466-8034-4288-b285-a4ed3648bdf5" released by "delete_volume" :: held 1.511s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:14:53 devstack cinder-volume[86891]: WARNING cinder.quota [None req-5db2a756-1c67-4c36-97f7-35526cd7c144 tempest-VolumeTypesAccessTest-398649924 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1633405901 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1633405901, it is now deprecated. Please use the default quota class for default quota.
Jul 03 01:14:53 devstack cinder-volume[86891]: WARNING cinder.quota [None req-5db2a756-1c67-4c36-97f7-35526cd7c144 tempest-VolumeTypesAccessTest-398649924 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1633405901 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1633405901, it is now deprecated. Please use the default quota class for default quota.
Jul 03 01:14:53 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-5db2a756-1c67-4c36-97f7-35526cd7c144 tempest-VolumeTypesAccessTest-398649924 None] Created reservations ['7880a76c-e10c-44a8-8d51-93190b508556', '86407a3a-d99c-4db4-8cd1-472303c20eef', '32f7649f-6d95-422f-8f7c-383975a2bed3', '6bc6d4df-870d-4eb9-9215-6a8c1a21c406'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:14:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-5db2a756-1c67-4c36-97f7-35526cd7c144 tempest-VolumeTypesAccessTest-398649924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:14:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-5db2a756-1c67-4c36-97f7-35526cd7c144 tempest-VolumeTypesAccessTest-398649924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:14:53 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-5db2a756-1c67-4c36-97f7-35526cd7c144 tempest-VolumeTypesAccessTest-398649924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:14:53 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-5db2a756-1c67-4c36-97f7-35526cd7c144 tempest-VolumeTypesAccessTest-398649924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:14:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-5db2a756-1c67-4c36-97f7-35526cd7c144 tempest-VolumeTypesAccessTest-398649924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:14:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5db2a756-1c67-4c36-97f7-35526cd7c144 tempest-VolumeTypesAccessTest-398649924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:53 devstack sudo[98516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:14:53 devstack sudo[98516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:53 devstack sudo[98513]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f04c8927-cde5-41a7-a566-b3b1f87cc4e8 tempest-SnapshotMetadataTestJSON-45469037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9a62dc90-cff7-45ed-9474-93e95f104d63.5f9da992-4c8c-4462-847f-62644a5c2be5" returned: 0 in 0.659s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:54 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f04c8927-cde5-41a7-a566-b3b1f87cc4e8 tempest-SnapshotMetadataTestJSON-45469037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9a62dc90-cff7-45ed-9474-93e95f104d63.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:54 devstack sudo[98519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9a62dc90-cff7-45ed-9474-93e95f104d63.info
Jul 03 01:14:54 devstack sudo[98519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:54 devstack sudo[98516]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:54 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5db2a756-1c67-4c36-97f7-35526cd7c144 tempest-VolumeTypesAccessTest-398649924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.722s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:54 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-5db2a756-1c67-4c36-97f7-35526cd7c144 tempest-VolumeTypesAccessTest-398649924 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:14:54 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-5db2a756-1c67-4c36-97f7-35526cd7c144 tempest-VolumeTypesAccessTest-398649924 None] Deleted volume successfully.
Jul 03 01:14:54 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:SELECT=136,cinder:UPDATE=177,cinder:DELETE=14,cinder:INSERT=42 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:14:54 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5db2a756-1c67-4c36-97f7-35526cd7c144 tempest-VolumeTypesAccessTest-398649924 None] Lock "cinder-42b65466-8034-4288-b285-a4ed3648bdf5-delete_volume" released by "delete_volume" :: held 2.468s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:14:54 devstack sudo[98519]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:54 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f04c8927-cde5-41a7-a566-b3b1f87cc4e8 tempest-SnapshotMetadataTestJSON-45469037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9a62dc90-cff7-45ed-9474-93e95f104d63.info" returned: 0 in 0.860s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:54 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-f04c8927-cde5-41a7-a566-b3b1f87cc4e8 tempest-SnapshotMetadataTestJSON-45469037 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9a62dc90-cff7-45ed-9474-93e95f104d63.info is being set with open permissions: ugo+rw
Jul 03 01:14:54 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f04c8927-cde5-41a7-a566-b3b1f87cc4e8 tempest-SnapshotMetadataTestJSON-45469037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9a62dc90-cff7-45ed-9474-93e95f104d63.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:54 devstack sudo[98551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9a62dc90-cff7-45ed-9474-93e95f104d63.info
Jul 03 01:14:54 devstack sudo[98551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:55 devstack sudo[98551]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f04c8927-cde5-41a7-a566-b3b1f87cc4e8 tempest-SnapshotMetadataTestJSON-45469037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9a62dc90-cff7-45ed-9474-93e95f104d63.info" returned: 0 in 1.098s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f04c8927-cde5-41a7-a566-b3b1f87cc4e8 tempest-SnapshotMetadataTestJSON-45469037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.076s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:14:56 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:SELECT=120,cinder:UPDATE=192,cinder:INSERT=50,cinder:DELETE=15 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:14:56 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-f04c8927-cde5-41a7-a566-b3b1f87cc4e8 tempest-SnapshotMetadataTestJSON-45469037 None] Create snapshot completed successfully
Jul 03 01:14:57 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-1b510f5a-3f97-45c4-b590-cecc2e5d0c4b tempest-SnapshotMetadataTestJSON-45469037 None] Acquiring lock "cinder-5f9da992-4c8c-4462-847f-62644a5c2be5-delete_snapshot" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:14:57 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-1b510f5a-3f97-45c4-b590-cecc2e5d0c4b tempest-SnapshotMetadataTestJSON-45469037 None] Lock "cinder-5f9da992-4c8c-4462-847f-62644a5c2be5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:14:57 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-1b510f5a-3f97-45c4-b590-cecc2e5d0c4b tempest-SnapshotMetadataTestJSON-45469037 None] Acquiring lock "cinder-quobyte-9a62dc90-cff7-45ed-9474-93e95f104d63" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:14:57 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-1b510f5a-3f97-45c4-b590-cecc2e5d0c4b tempest-SnapshotMetadataTestJSON-45469037 None] Lock "cinder-quobyte-9a62dc90-cff7-45ed-9474-93e95f104d63" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:14:57 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-1b510f5a-3f97-45c4-b590-cecc2e5d0c4b tempest-SnapshotMetadataTestJSON-45469037 None] Acquiring lock "cinder-quobyte-5f9da992-4c8c-4462-847f-62644a5c2be5" by "_delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:14:57 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-1b510f5a-3f97-45c4-b590-cecc2e5d0c4b tempest-SnapshotMetadataTestJSON-45469037 None] Lock "cinder-quobyte-5f9da992-4c8c-4462-847f-62644a5c2be5" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:14:57 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-1b510f5a-3f97-45c4-b590-cecc2e5d0c4b tempest-SnapshotMetadataTestJSON-45469037 None] Deleting offline snapshot 5f9da992-4c8c-4462-847f-62644a5c2be5 of volume 9a62dc90-cff7-45ed-9474-93e95f104d63 {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 01:14:57 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-1b510f5a-3f97-45c4-b590-cecc2e5d0c4b tempest-SnapshotMetadataTestJSON-45469037 None] snapshot_file for this snap is: volume-9a62dc90-cff7-45ed-9474-93e95f104d63.5f9da992-4c8c-4462-847f-62644a5c2be5 {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 01:14:57 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac35b21e-8bd7-40ef-aa80-655b884ad73b]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:14:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1b510f5a-3f97-45c4-b590-cecc2e5d0c4b tempest-SnapshotMetadataTestJSON-45469037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9a62dc90-cff7-45ed-9474-93e95f104d63.5f9da992-4c8c-4462-847f-62644a5c2be5 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:58 devstack sudo[98592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9a62dc90-cff7-45ed-9474-93e95f104d63.5f9da992-4c8c-4462-847f-62644a5c2be5
Jul 03 01:14:58 devstack sudo[98592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:58 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-a1507f47-93a9-440e-8ce6-1f1a7d3f1b4c tempest-VolumesActionsTest-1288723690 None] Acquiring lock "cinder-48a2c0f1-8c98-4310-87d1-ed911e42f70c" by "attach_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:14:58 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-a1507f47-93a9-440e-8ce6-1f1a7d3f1b4c tempest-VolumesActionsTest-1288723690 None] Lock "cinder-48a2c0f1-8c98-4310-87d1-ed911e42f70c" acquired by "attach_volume" :: waited 0.055s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:14:58 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-a1507f47-93a9-440e-8ce6-1f1a7d3f1b4c tempest-VolumesActionsTest-1288723690 None] Attaching volume 48a2c0f1-8c98-4310-87d1-ed911e42f70c to instance b24833b8-cb66-4a3f-bb78-aa493d2fa43a at mountpoint /dev/vdb on host None.
Jul 03 01:14:58 devstack sudo[98592]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1b510f5a-3f97-45c4-b590-cecc2e5d0c4b tempest-SnapshotMetadataTestJSON-45469037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9a62dc90-cff7-45ed-9474-93e95f104d63.5f9da992-4c8c-4462-847f-62644a5c2be5" returned: 0 in 1.024s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:59 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-1b510f5a-3f97-45c4-b590-cecc2e5d0c4b tempest-SnapshotMetadataTestJSON-45469037 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a62dc90-cff7-45ed-9474-93e95f104d63(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:14:59 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[024f9682-aa93-49b9-afda-d30e2d8c10ce]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:14:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1b510f5a-3f97-45c4-b590-cecc2e5d0c4b tempest-SnapshotMetadataTestJSON-45469037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9a62dc90-cff7-45ed-9474-93e95f104d63 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:59 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-a1507f47-93a9-440e-8ce6-1f1a7d3f1b4c tempest-VolumesActionsTest-1288723690 None] Attach volume completed successfully.
Jul 03 01:14:59 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-a1507f47-93a9-440e-8ce6-1f1a7d3f1b4c tempest-VolumesActionsTest-1288723690 None] Lock "cinder-48a2c0f1-8c98-4310-87d1-ed911e42f70c" released by "attach_volume" :: held 0.150s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:14:59 devstack sudo[98598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9a62dc90-cff7-45ed-9474-93e95f104d63
Jul 03 01:14:59 devstack sudo[98598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:14:59 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-1bc9e888-5f98-492e-9888-aad92aad53eb tempest-VolumesActionsTest-1288723690 None] Acquiring lock "cinder-48a2c0f1-8c98-4310-87d1-ed911e42f70c-detach_volume" by "detach_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:14:59 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-1bc9e888-5f98-492e-9888-aad92aad53eb tempest-VolumesActionsTest-1288723690 None] Lock "cinder-48a2c0f1-8c98-4310-87d1-ed911e42f70c-detach_volume" acquired by "detach_volume" :: waited 0.038s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:14:59 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-1bc9e888-5f98-492e-9888-aad92aad53eb tempest-VolumesActionsTest-1288723690 None] Detaching volume 48a2c0f1-8c98-4310-87d1-ed911e42f70c from instance b24833b8-cb66-4a3f-bb78-aa493d2fa43a.
Jul 03 01:14:59 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-1bc9e888-5f98-492e-9888-aad92aad53eb tempest-VolumesActionsTest-1288723690 None] Detach volume completed successfully.
Jul 03 01:14:59 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-1bc9e888-5f98-492e-9888-aad92aad53eb tempest-VolumesActionsTest-1288723690 None] Lock "cinder-48a2c0f1-8c98-4310-87d1-ed911e42f70c-detach_volume" released by "detach_volume" :: held 0.075s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:14:59 devstack sudo[98598]: pam_unix(sudo:session): session closed for user root
Jul 03 01:14:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1b510f5a-3f97-45c4-b590-cecc2e5d0c4b tempest-SnapshotMetadataTestJSON-45469037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9a62dc90-cff7-45ed-9474-93e95f104d63" returned: 0 in 0.840s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:14:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1b510f5a-3f97-45c4-b590-cecc2e5d0c4b tempest-SnapshotMetadataTestJSON-45469037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9a62dc90-cff7-45ed-9474-93e95f104d63.5f9da992-4c8c-4462-847f-62644a5c2be5 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:14:59 devstack sudo[98603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9a62dc90-cff7-45ed-9474-93e95f104d63.5f9da992-4c8c-4462-847f-62644a5c2be5
Jul 03 01:14:59 devstack sudo[98603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:15:00 devstack sudo[98603]: pam_unix(sudo:session): session closed for user root
Jul 03 01:15:00 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1b510f5a-3f97-45c4-b590-cecc2e5d0c4b tempest-SnapshotMetadataTestJSON-45469037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9a62dc90-cff7-45ed-9474-93e95f104d63.5f9da992-4c8c-4462-847f-62644a5c2be5" returned: 0 in 0.964s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:15:00 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1b510f5a-3f97-45c4-b590-cecc2e5d0c4b tempest-SnapshotMetadataTestJSON-45469037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9a62dc90-cff7-45ed-9474-93e95f104d63.5f9da992-4c8c-4462-847f-62644a5c2be5 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:15:00 devstack sudo[98608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9a62dc90-cff7-45ed-9474-93e95f104d63.5f9da992-4c8c-4462-847f-62644a5c2be5
Jul 03 01:15:00 devstack sudo[98608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:15:01 devstack sudo[98608]: pam_unix(sudo:session): session closed for user root
Jul 03 01:15:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1b510f5a-3f97-45c4-b590-cecc2e5d0c4b tempest-SnapshotMetadataTestJSON-45469037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9a62dc90-cff7-45ed-9474-93e95f104d63.5f9da992-4c8c-4462-847f-62644a5c2be5" returned: 0 in 0.895s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:15:01 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-1b510f5a-3f97-45c4-b590-cecc2e5d0c4b tempest-SnapshotMetadataTestJSON-45469037 None] Lock "cinder-quobyte-5f9da992-4c8c-4462-847f-62644a5c2be5" released by "_delete_snapshot" :: held 3.869s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:15:01 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-1b510f5a-3f97-45c4-b590-cecc2e5d0c4b tempest-SnapshotMetadataTestJSON-45469037 None] Lock "cinder-quobyte-9a62dc90-cff7-45ed-9474-93e95f104d63" released by "delete_snapshot" :: held 3.900s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:15:01 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-1b510f5a-3f97-45c4-b590-cecc2e5d0c4b tempest-SnapshotMetadataTestJSON-45469037 None] Created reservations ['7276cc6f-12ab-4982-9b27-91241c7b6c40', '40f9ba87-1ce2-45cd-b562-d11df7ab31ae', '5103ee36-988c-4be0-8492-d520c69b107b', '509cbaa6-561c-415e-a281-9d472a9bf67c'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:15:01 devstack cinder-volume[86891]: DEBUG oslo_service.periodic_task [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86891) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 01:15:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:15:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:15:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:15:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:15:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:15:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:15:01 devstack sudo[98651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:15:01 devstack sudo[98651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:15:02 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-1b510f5a-3f97-45c4-b590-cecc2e5d0c4b tempest-SnapshotMetadataTestJSON-45469037 None] Delete snapshot completed successfully.
Jul 03 01:15:02 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-1b510f5a-3f97-45c4-b590-cecc2e5d0c4b tempest-SnapshotMetadataTestJSON-45469037 None] Lock "cinder-5f9da992-4c8c-4462-847f-62644a5c2be5-delete_snapshot" released by "delete_snapshot" :: held 4.160s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:15:02 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-051fa5c6-953a-4522-b0a8-c50ac45d7f6f tempest-SnapshotMetadataTestJSON-45469037 None] Acquiring lock "cinder-9a62dc90-cff7-45ed-9474-93e95f104d63-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:15:02 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-051fa5c6-953a-4522-b0a8-c50ac45d7f6f tempest-SnapshotMetadataTestJSON-45469037 None] Lock "cinder-9a62dc90-cff7-45ed-9474-93e95f104d63-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:15:02 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-051fa5c6-953a-4522-b0a8-c50ac45d7f6f tempest-SnapshotMetadataTestJSON-45469037 None] Acquiring lock "cinder-quobyte-9a62dc90-cff7-45ed-9474-93e95f104d63" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:15:02 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-051fa5c6-953a-4522-b0a8-c50ac45d7f6f tempest-SnapshotMetadataTestJSON-45469037 None] Lock "cinder-quobyte-9a62dc90-cff7-45ed-9474-93e95f104d63" acquired by "delete_volume" :: waited 0.016s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:15:02 devstack sudo[98651]: pam_unix(sudo:session): session closed for user root
Jul 03 01:15:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.795s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:15:02 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:15:02 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50b10bb-62eb-4803-8194-f5ade0a29c69]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:15:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-051fa5c6-953a-4522-b0a8-c50ac45d7f6f tempest-SnapshotMetadataTestJSON-45469037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9a62dc90-cff7-45ed-9474-93e95f104d63 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:15:02 devstack cinder-volume[86891]: DEBUG oslo_service.periodic_task [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running periodic task VolumeManager._thread_info {{(pid=86891) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 01:15:02 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] thread count: 28 {{(pid=86891) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 01:15:02 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] thread info: [<_MainThread(MainThread, started 136731296534656)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136731184953280)>, <Thread(Thread-3 (stat_writer), started daemon 136731184058816)>, <Thread(Rabbit-heartbeat, started daemon 136731184846080)>, <Thread(Thread-5 (_runner), started daemon 136731182936576)>, <Thread(Thread-7 (_runner), started daemon 136731182954944)>, <Thread(fd_logger, started daemon 136731181916416)>, <Thread(privsep_reader, started daemon 136731180942208)>, <Thread(tpool_thread_0, started daemon 136731172161216)>, <Thread(tpool_thread_1, started daemon 136731163768512)>, <Thread(tpool_thread_2, started daemon 136731155375808)>, <Thread(tpool_thread_3, started daemon 136731146983104)>, <Thread(tpool_thread_4, started daemon 136731138590400)>, <Thread(tpool_thread_5, started daemon 136731130197696)>, <Thread(tpool_thread_6, started daemon 136731121804992)>, <Thread(tpool_thread_7, started daemon 136731113412288)>, <Thread(tpool_thread_8, started daemon 136731105003200)>, <Thread(tpool_thread_9, started daemon 136731096594112)>, <Thread(tpool_thread_10, started daemon 136731088185024)>, <Thread(tpool_thread_11, started daemon 136731079775936)>, <Thread(tpool_thread_12, started daemon 136731071366848)>, <Thread(tpool_thread_13, started daemon 136731062957760)>, <Thread(tpool_thread_14, started daemon 136731054548672)>, <Thread(tpool_thread_15, started daemon 136731046139584)>, <Thread(tpool_thread_16, started daemon 136731037730496)>, <Thread(tpool_thread_17, started daemon 136731029321408)>, <Thread(tpool_thread_18, started daemon 136731020912320)>, <Thread(tpool_thread_19, started daemon 136731012503232)>] {{(pid=86891) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 01:15:02 devstack sudo[98657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9a62dc90-cff7-45ed-9474-93e95f104d63
Jul 03 01:15:02 devstack sudo[98657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:15:03 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-93db18d7-cf74-4024-8fb6-0204a3b21a70 tempest-VolumesImageMetadata-63910437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:15:03 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-93db18d7-cf74-4024-8fb6-0204a3b21a70 tempest-VolumesImageMetadata-63910437 None] Flow 'volume_create_manager' (352fa343-aea0-49cb-b820-c921a0f3c226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:15:03 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-93db18d7-cf74-4024-8fb6-0204a3b21a70 tempest-VolumesImageMetadata-63910437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c97679f1-8711-4f81-975b-d6f3f733c9cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:15:03 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-93db18d7-cf74-4024-8fb6-0204a3b21a70 tempest-VolumesImageMetadata-63910437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c97679f1-8711-4f81-975b-d6f3f733c9cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1489918387',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=999d47c3-717e-43e7-a376-10d16d3500a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d23a460d229490885623797853d6f26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:15:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:15:03Z,use_quota=True,user_id='333ab48b7b174b5bae2089326dc17a0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:15:03 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-93db18d7-cf74-4024-8fb6-0204a3b21a70 tempest-VolumesImageMetadata-63910437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a002bd0b-db7f-4e3a-bf33-2f0a205f7a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:15:03 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-93db18d7-cf74-4024-8fb6-0204a3b21a70 tempest-VolumesImageMetadata-63910437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a002bd0b-db7f-4e3a-bf33-2f0a205f7a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:15:03 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-93db18d7-cf74-4024-8fb6-0204a3b21a70 tempest-VolumesImageMetadata-63910437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bddb4278-6f3d-4bfe-88e9-21fb7ac0e594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:15:03 devstack cinder-volume[86891]: DEBUG cinder.image.glance [None req-93db18d7-cf74-4024-8fb6-0204a3b21a70 tempest-VolumesImageMetadata-63910437 None] Creating Keystone auth plugin from conf {{(pid=86891) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 03 01:15:03 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-93db18d7-cf74-4024-8fb6-0204a3b21a70 tempest-VolumesImageMetadata-63910437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bddb4278-6f3d-4bfe-88e9-21fb7ac0e594) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '999d47c3-717e-43e7-a376-10d16d3500a4', 'volume_name': 'volume-999d47c3-717e-43e7-a376-10d16d3500a4', 'volume_size': 1, 'image_id': '65cceacb-879b-4111-919c-966899666f55', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/65cceacb-879b-4111-919c-966899666f55', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0d33e5361cf145ffa2791b827e46aea8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '65cceacb-879b-4111-919c-966899666f55', 'created_at': datetime.datetime(2026, 7, 2, 22, 57, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 22, 57, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/65cceacb-879b-4111-919c-966899666f55/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7c5b35221550>}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:15:03 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-93db18d7-cf74-4024-8fb6-0204a3b21a70 tempest-VolumesImageMetadata-63910437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf6479fd-ebd8-4d98-b34c-c730198cff91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:15:03 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-93db18d7-cf74-4024-8fb6-0204a3b21a70 tempest-VolumesImageMetadata-63910437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf6479fd-ebd8-4d98-b34c-c730198cff91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:15:03 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-93db18d7-cf74-4024-8fb6-0204a3b21a70 tempest-VolumesImageMetadata-63910437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51d87ed2-8396-45f0-bc9b-4534d88ec197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:15:03 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-93db18d7-cf74-4024-8fb6-0204a3b21a70 tempest-VolumesImageMetadata-63910437 None] Volume 999d47c3-717e-43e7-a376-10d16d3500a4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-999d47c3-717e-43e7-a376-10d16d3500a4', 'volume_size': 1, 'image_id': '65cceacb-879b-4111-919c-966899666f55', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/65cceacb-879b-4111-919c-966899666f55', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0d33e5361cf145ffa2791b827e46aea8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '65cceacb-879b-4111-919c-966899666f55', 'created_at': datetime.datetime(2026, 7, 2, 22, 57, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 22, 57, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/65cceacb-879b-4111-919c-966899666f55/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7c5b35221550>}
Jul 03 01:15:03 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-93db18d7-cf74-4024-8fb6-0204a3b21a70 tempest-VolumesImageMetadata-63910437 None] Trying to clone 999d47c3-717e-43e7-a376-10d16d3500a4 from image 65cceacb-879b-4111-919c-966899666f55 at location (None, [{'url': 'file:///opt/stack/data/glance/images/65cceacb-879b-4111-919c-966899666f55', 'metadata': {}}]). {{(pid=86891) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 03 01:15:03 devstack sudo[98657]: pam_unix(sudo:session): session closed for user root
Jul 03 01:15:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-051fa5c6-953a-4522-b0a8-c50ac45d7f6f tempest-SnapshotMetadataTestJSON-45469037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9a62dc90-cff7-45ed-9474-93e95f104d63" returned: 0 in 1.019s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:15:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-051fa5c6-953a-4522-b0a8-c50ac45d7f6f tempest-SnapshotMetadataTestJSON-45469037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9a62dc90-cff7-45ed-9474-93e95f104d63 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:15:03 devstack sudo[98666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9a62dc90-cff7-45ed-9474-93e95f104d63
Jul 03 01:15:03 devstack sudo[98666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:15:04 devstack cinder-volume[86891]: DEBUG cinder.image.image_utils [None req-93db18d7-cf74-4024-8fb6-0204a3b21a70 tempest-VolumesImageMetadata-63910437 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_65cceacb-879b-4111-919c-966899666f55_51ij8qr2devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86891) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 03 01:15:04 devstack cinder-volume[86891]: INFO cinder.image.image_utils [None req-93db18d7-cf74-4024-8fb6-0204a3b21a70 tempest-VolumesImageMetadata-63910437 None] Image download 20.69 MB at 20.69 MB/s
Jul 03 01:15:04 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[1acf7d64-00de-43cd-b7b2-fcf90c4b5c53]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:15:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-93db18d7-cf74-4024-8fb6-0204a3b21a70 tempest-VolumesImageMetadata-63910437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_65cceacb-879b-4111-919c-966899666f55_51ij8qr2devstack@QuobyteHD {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:15:04 devstack sudo[98669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_65cceacb-879b-4111-919c-966899666f55_51ij8qr2devstack@QuobyteHD
Jul 03 01:15:04 devstack sudo[98669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:15:04 devstack sudo[98666]: pam_unix(sudo:session): session closed for user root
Jul 03 01:15:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-051fa5c6-953a-4522-b0a8-c50ac45d7f6f tempest-SnapshotMetadataTestJSON-45469037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9a62dc90-cff7-45ed-9474-93e95f104d63" returned: 0 in 0.772s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:15:04 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-051fa5c6-953a-4522-b0a8-c50ac45d7f6f tempest-SnapshotMetadataTestJSON-45469037 None] Lock "cinder-quobyte-9a62dc90-cff7-45ed-9474-93e95f104d63" released by "delete_volume" :: held 1.878s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:15:04 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-051fa5c6-953a-4522-b0a8-c50ac45d7f6f tempest-SnapshotMetadataTestJSON-45469037 None] Created reservations ['d5aa081b-d195-4844-8fce-ef426cc8be5e', 'aa2ea450-c6da-4580-8776-628619a3a115', '710e7979-da5f-4056-9daa-58edc7ca9919', 'aebdac65-4f06-48ea-ad1e-c15746617e58'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:15:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-051fa5c6-953a-4522-b0a8-c50ac45d7f6f tempest-SnapshotMetadataTestJSON-45469037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:15:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-051fa5c6-953a-4522-b0a8-c50ac45d7f6f tempest-SnapshotMetadataTestJSON-45469037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:15:04 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-051fa5c6-953a-4522-b0a8-c50ac45d7f6f tempest-SnapshotMetadataTestJSON-45469037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:15:04 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-051fa5c6-953a-4522-b0a8-c50ac45d7f6f tempest-SnapshotMetadataTestJSON-45469037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:15:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-051fa5c6-953a-4522-b0a8-c50ac45d7f6f tempest-SnapshotMetadataTestJSON-45469037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:15:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-051fa5c6-953a-4522-b0a8-c50ac45d7f6f tempest-SnapshotMetadataTestJSON-45469037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:15:04 devstack sudo[98672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:15:04 devstack sudo[98672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:15:04 devstack sudo[98669]: pam_unix(sudo:session): session closed for user root
Jul 03 01:15:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-93db18d7-cf74-4024-8fb6-0204a3b21a70 tempest-VolumesImageMetadata-63910437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_65cceacb-879b-4111-919c-966899666f55_51ij8qr2devstack@QuobyteHD" returned: 0 in 0.742s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:15:04 devstack cinder-volume[86891]: DEBUG cinder.image.image_utils [None req-93db18d7-cf74-4024-8fb6-0204a3b21a70 tempest-VolumesImageMetadata-63910437 None] Temporary image 65cceacb-879b-4111-919c-966899666f55 is fetched for user 333ab48b7b174b5bae2089326dc17a0b. {{(pid=86891) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 03 01:15:05 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c48083-7f5a-476d-aa4e-1f6652e47a6b]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:15:05 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-93db18d7-cf74-4024-8fb6-0204a3b21a70 tempest-VolumesImageMetadata-63910437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_65cceacb-879b-4111-919c-966899666f55_51ij8qr2devstack@QuobyteHD {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:15:05 devstack sudo[98677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_65cceacb-879b-4111-919c-966899666f55_51ij8qr2devstack@QuobyteHD
Jul 03 01:15:05 devstack sudo[98677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:15:05 devstack sudo[98672]: pam_unix(sudo:session): session closed for user root
Jul 03 01:15:05 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-051fa5c6-953a-4522-b0a8-c50ac45d7f6f tempest-SnapshotMetadataTestJSON-45469037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.708s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:15:05 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-051fa5c6-953a-4522-b0a8-c50ac45d7f6f tempest-SnapshotMetadataTestJSON-45469037 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:15:05 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-051fa5c6-953a-4522-b0a8-c50ac45d7f6f tempest-SnapshotMetadataTestJSON-45469037 None] Deleted volume successfully.
Jul 03 01:15:05 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-051fa5c6-953a-4522-b0a8-c50ac45d7f6f tempest-SnapshotMetadataTestJSON-45469037 None] Lock "cinder-9a62dc90-cff7-45ed-9474-93e95f104d63-delete_volume" released by "delete_volume" :: held 2.849s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:15:05 devstack sudo[98677]: pam_unix(sudo:session): session closed for user root
Jul 03 01:15:05 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-93db18d7-cf74-4024-8fb6-0204a3b21a70 tempest-VolumesImageMetadata-63910437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_65cceacb-879b-4111-919c-966899666f55_51ij8qr2devstack@QuobyteHD" returned: 0 in 0.789s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:15:05 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-93db18d7-cf74-4024-8fb6-0204a3b21a70 tempest-VolumesImageMetadata-63910437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:15:05 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-93db18d7-cf74-4024-8fb6-0204a3b21a70 tempest-VolumesImageMetadata-63910437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:15:05 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-93db18d7-cf74-4024-8fb6-0204a3b21a70 tempest-VolumesImageMetadata-63910437 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1489918387',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=999d47c3-717e-43e7-a376-10d16d3500a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d23a460d229490885623797853d6f26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:15:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:15:03Z,use_quota=True,user_id='333ab48b7b174b5bae2089326dc17a0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:15:05 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-93db18d7-cf74-4024-8fb6-0204a3b21a70 tempest-VolumesImageMetadata-63910437 None] Creating volume 999d47c3-717e-43e7-a376-10d16d3500a4 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:15:05 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-93db18d7-cf74-4024-8fb6-0204a3b21a70 tempest-VolumesImageMetadata-63910437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:15:05 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-93db18d7-cf74-4024-8fb6-0204a3b21a70 tempest-VolumesImageMetadata-63910437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:15:05 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-93db18d7-cf74-4024-8fb6-0204a3b21a70 tempest-VolumesImageMetadata-63910437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:15:05 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-93db18d7-cf74-4024-8fb6-0204a3b21a70 tempest-VolumesImageMetadata-63910437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:15:05 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-93db18d7-cf74-4024-8fb6-0204a3b21a70 tempest-VolumesImageMetadata-63910437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:15:05 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-93db18d7-cf74-4024-8fb6-0204a3b21a70 tempest-VolumesImageMetadata-63910437 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:15:05 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-93db18d7-cf74-4024-8fb6-0204a3b21a70 tempest-VolumesImageMetadata-63910437 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:15:05 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-93db18d7-cf74-4024-8fb6-0204a3b21a70 tempest-VolumesImageMetadata-63910437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-999d47c3-717e-43e7-a376-10d16d3500a4 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:15:05 devstack sudo[98684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-999d47c3-717e-43e7-a376-10d16d3500a4 1073741824
Jul 03 01:15:05 devstack sudo[98684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:15:06 devstack sudo[98684]: pam_unix(sudo:session): session closed for user root
Jul 03 01:15:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-93db18d7-cf74-4024-8fb6-0204a3b21a70 tempest-VolumesImageMetadata-63910437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-999d47c3-717e-43e7-a376-10d16d3500a4 1073741824" returned: 0 in 0.874s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:15:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-93db18d7-cf74-4024-8fb6-0204a3b21a70 tempest-VolumesImageMetadata-63910437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-999d47c3-717e-43e7-a376-10d16d3500a4 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:15:06 devstack sudo[98692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-999d47c3-717e-43e7-a376-10d16d3500a4
Jul 03 01:15:06 devstack sudo[98692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:15:07 devstack sudo[98692]: pam_unix(sudo:session): session closed for user root
Jul 03 01:15:07 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-93db18d7-cf74-4024-8fb6-0204a3b21a70 tempest-VolumesImageMetadata-63910437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-999d47c3-717e-43e7-a376-10d16d3500a4" returned: 0 in 0.767s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:15:07 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-93db18d7-cf74-4024-8fb6-0204a3b21a70 tempest-VolumesImageMetadata-63910437 None] <== create_volume: return (1700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:15:07 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-93db18d7-cf74-4024-8fb6-0204a3b21a70 tempest-VolumesImageMetadata-63910437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.703s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:15:07 devstack cinder-volume[86891]: DEBUG cinder.volume.volume_utils [None req-93db18d7-cf74-4024-8fb6-0204a3b21a70 tempest-VolumesImageMetadata-63910437 None] Attempting download of 65cceacb-879b-4111-919c-966899666f55 ((None, [{'url': 'file:///opt/stack/data/glance/images/65cceacb-879b-4111-919c-966899666f55', 'metadata': {}}])) to volume 999d47c3-717e-43e7-a376-10d16d3500a4. {{(pid=86891) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 03 01:15:07 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6a50e2-7db1-408b-8ff1-99f85d21999d]: (4, 'raw') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:15:07 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-93db18d7-cf74-4024-8fb6-0204a3b21a70 tempest-VolumesImageMetadata-63910437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_65cceacb-879b-4111-919c-966899666f55_hwy6sa66 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:15:07 devstack sudo[98695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_65cceacb-879b-4111-919c-966899666f55_hwy6sa66
Jul 03 01:15:07 devstack sudo[98695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:15:08 devstack sudo[98695]: pam_unix(sudo:session): session closed for user root
Jul 03 01:15:08 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-93db18d7-cf74-4024-8fb6-0204a3b21a70 tempest-VolumesImageMetadata-63910437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_65cceacb-879b-4111-919c-966899666f55_hwy6sa66" returned: 0 in 0.778s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:15:08 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-93db18d7-cf74-4024-8fb6-0204a3b21a70 tempest-VolumesImageMetadata-63910437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_65cceacb-879b-4111-919c-966899666f55_hwy6sa66 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:15:08 devstack sudo[98703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_65cceacb-879b-4111-919c-966899666f55_hwy6sa66
Jul 03 01:15:08 devstack sudo[98703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:15:09 devstack sudo[98703]: pam_unix(sudo:session): session closed for user root
Jul 03 01:15:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-93db18d7-cf74-4024-8fb6-0204a3b21a70 tempest-VolumesImageMetadata-63910437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_65cceacb-879b-4111-919c-966899666f55_hwy6sa66" returned: 1 in 0.771s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:15:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-93db18d7-cf74-4024-8fb6-0204a3b21a70 tempest-VolumesImageMetadata-63910437 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_65cceacb-879b-4111-919c-966899666f55_hwy6sa66' failed. Not Retrying. {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 01:15:09 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d29d6ab-a444-4fe7-867d-dd28ec24de66]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:15:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-93db18d7-cf74-4024-8fb6-0204a3b21a70 tempest-VolumesImageMetadata-63910437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_65cceacb-879b-4111-919c-966899666f55_51ij8qr2devstack@QuobyteHD {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:15:09 devstack sudo[98707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_65cceacb-879b-4111-919c-966899666f55_51ij8qr2devstack@QuobyteHD
Jul 03 01:15:09 devstack sudo[98707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:15:09 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbfe4c56-6486-4c03-ade4-9672926eb9a6 tempest-AbsoluteLimitsTests-624023302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:15:09 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fbfe4c56-6486-4c03-ade4-9672926eb9a6 tempest-AbsoluteLimitsTests-624023302 None] Flow 'volume_create_manager' (ec43a97d-08e5-454d-a4a0-bf6b400c2551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:15:09 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fbfe4c56-6486-4c03-ade4-9672926eb9a6 tempest-AbsoluteLimitsTests-624023302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83eb29f3-8b46-4df5-98e5-b79cff2b6f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:15:09 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fbfe4c56-6486-4c03-ade4-9672926eb9a6 tempest-AbsoluteLimitsTests-624023302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83eb29f3-8b46-4df5-98e5-b79cff2b6f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:15:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1047389779',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98708072-a87d-4edd-b590-7c78a0b8c2b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69a27fee22914bb09cb47b4b3b82c18f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:15:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:15:09Z,use_quota=True,user_id='a6c3ed53640346e5abd03972dd0753c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:15:09 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fbfe4c56-6486-4c03-ade4-9672926eb9a6 tempest-AbsoluteLimitsTests-624023302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cd4cac8-cbd6-4b64-9974-2037377fdec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:15:09 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fbfe4c56-6486-4c03-ade4-9672926eb9a6 tempest-AbsoluteLimitsTests-624023302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cd4cac8-cbd6-4b64-9974-2037377fdec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:15:09 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fbfe4c56-6486-4c03-ade4-9672926eb9a6 tempest-AbsoluteLimitsTests-624023302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a2397f3-d4fe-4db0-809a-08c5d14cd2da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:15:09 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fbfe4c56-6486-4c03-ade4-9672926eb9a6 tempest-AbsoluteLimitsTests-624023302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a2397f3-d4fe-4db0-809a-08c5d14cd2da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98708072-a87d-4edd-b590-7c78a0b8c2b7', 'volume_name': 'volume-98708072-a87d-4edd-b590-7c78a0b8c2b7', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:15:09 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fbfe4c56-6486-4c03-ade4-9672926eb9a6 tempest-AbsoluteLimitsTests-624023302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e9a8f53-dbaf-4569-ab63-4756865fff12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:15:09 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fbfe4c56-6486-4c03-ade4-9672926eb9a6 tempest-AbsoluteLimitsTests-624023302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e9a8f53-dbaf-4569-ab63-4756865fff12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:15:09 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fbfe4c56-6486-4c03-ade4-9672926eb9a6 tempest-AbsoluteLimitsTests-624023302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a24e57b-a0af-4ed3-a76b-96491b13365e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:15:09 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-fbfe4c56-6486-4c03-ade4-9672926eb9a6 tempest-AbsoluteLimitsTests-624023302 None] Volume 98708072-a87d-4edd-b590-7c78a0b8c2b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98708072-a87d-4edd-b590-7c78a0b8c2b7', 'volume_size': 1}
Jul 03 01:15:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-fbfe4c56-6486-4c03-ade4-9672926eb9a6 tempest-AbsoluteLimitsTests-624023302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:15:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-fbfe4c56-6486-4c03-ade4-9672926eb9a6 tempest-AbsoluteLimitsTests-624023302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:15:09 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-fbfe4c56-6486-4c03-ade4-9672926eb9a6 tempest-AbsoluteLimitsTests-624023302 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:15:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1047389779',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98708072-a87d-4edd-b590-7c78a0b8c2b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69a27fee22914bb09cb47b4b3b82c18f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:15:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:15:09Z,use_quota=True,user_id='a6c3ed53640346e5abd03972dd0753c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:15:09 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-fbfe4c56-6486-4c03-ade4-9672926eb9a6 tempest-AbsoluteLimitsTests-624023302 None] Creating volume 98708072-a87d-4edd-b590-7c78a0b8c2b7 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:15:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-fbfe4c56-6486-4c03-ade4-9672926eb9a6 tempest-AbsoluteLimitsTests-624023302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:15:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-fbfe4c56-6486-4c03-ade4-9672926eb9a6 tempest-AbsoluteLimitsTests-624023302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:15:09 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-fbfe4c56-6486-4c03-ade4-9672926eb9a6 tempest-AbsoluteLimitsTests-624023302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:15:09 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-fbfe4c56-6486-4c03-ade4-9672926eb9a6 tempest-AbsoluteLimitsTests-624023302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:15:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-fbfe4c56-6486-4c03-ade4-9672926eb9a6 tempest-AbsoluteLimitsTests-624023302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:15:09 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-fbfe4c56-6486-4c03-ade4-9672926eb9a6 tempest-AbsoluteLimitsTests-624023302 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:15:09 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-fbfe4c56-6486-4c03-ade4-9672926eb9a6 tempest-AbsoluteLimitsTests-624023302 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:15:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-fbfe4c56-6486-4c03-ade4-9672926eb9a6 tempest-AbsoluteLimitsTests-624023302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-98708072-a87d-4edd-b590-7c78a0b8c2b7 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:15:09 devstack sudo[98709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-98708072-a87d-4edd-b590-7c78a0b8c2b7 1073741824
Jul 03 01:15:09 devstack sudo[98709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:15:09 devstack sudo[98707]: pam_unix(sudo:session): session closed for user root
Jul 03 01:15:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-93db18d7-cf74-4024-8fb6-0204a3b21a70 tempest-VolumesImageMetadata-63910437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_65cceacb-879b-4111-919c-966899666f55_51ij8qr2devstack@QuobyteHD" returned: 0 in 0.759s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:15:09 devstack cinder-volume[86891]: DEBUG cinder.image.image_utils [None req-93db18d7-cf74-4024-8fb6-0204a3b21a70 tempest-VolumesImageMetadata-63910437 None] 65cceacb-879b-4111-919c-966899666f55 was qcow2, converting to raw {{(pid=86891) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 03 01:15:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-93db18d7-cf74-4024-8fb6-0204a3b21a70 tempest-VolumesImageMetadata-63910437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_65cceacb-879b-4111-919c-966899666f55_51ij8qr2devstack@QuobyteHD /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-999d47c3-717e-43e7-a376-10d16d3500a4 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:15:09 devstack sudo[98714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_65cceacb-879b-4111-919c-966899666f55_51ij8qr2devstack@QuobyteHD /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-999d47c3-717e-43e7-a376-10d16d3500a4
Jul 03 01:15:09 devstack sudo[98714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:15:10 devstack sudo[98709]: pam_unix(sudo:session): session closed for user root
Jul 03 01:15:10 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-fbfe4c56-6486-4c03-ade4-9672926eb9a6 tempest-AbsoluteLimitsTests-624023302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-98708072-a87d-4edd-b590-7c78a0b8c2b7 1073741824" returned: 0 in 0.851s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:15:10 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-fbfe4c56-6486-4c03-ade4-9672926eb9a6 tempest-AbsoluteLimitsTests-624023302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-98708072-a87d-4edd-b590-7c78a0b8c2b7 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:15:10 devstack sudo[98720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-98708072-a87d-4edd-b590-7c78a0b8c2b7
Jul 03 01:15:10 devstack sudo[98720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:15:11 devstack sudo[98720]: pam_unix(sudo:session): session closed for user root
Jul 03 01:15:11 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-fbfe4c56-6486-4c03-ade4-9672926eb9a6 tempest-AbsoluteLimitsTests-624023302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-98708072-a87d-4edd-b590-7c78a0b8c2b7" returned: 0 in 0.773s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:15:11 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-fbfe4c56-6486-4c03-ade4-9672926eb9a6 tempest-AbsoluteLimitsTests-624023302 None] <== create_volume: return (1672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:15:11 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-fbfe4c56-6486-4c03-ade4-9672926eb9a6 tempest-AbsoluteLimitsTests-624023302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.674s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:15:11 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fbfe4c56-6486-4c03-ade4-9672926eb9a6 tempest-AbsoluteLimitsTests-624023302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a24e57b-a0af-4ed3-a76b-96491b13365e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98708072-a87d-4edd-b590-7c78a0b8c2b7', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:15:11 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fbfe4c56-6486-4c03-ade4-9672926eb9a6 tempest-AbsoluteLimitsTests-624023302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22cdb96f-0fd1-4b00-9cc9-cbe6dede42a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:15:11 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-fbfe4c56-6486-4c03-ade4-9672926eb9a6 tempest-AbsoluteLimitsTests-624023302 None] Volume volume-98708072-a87d-4edd-b590-7c78a0b8c2b7 (98708072-a87d-4edd-b590-7c78a0b8c2b7): created successfully
Jul 03 01:15:11 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fbfe4c56-6486-4c03-ade4-9672926eb9a6 tempest-AbsoluteLimitsTests-624023302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22cdb96f-0fd1-4b00-9cc9-cbe6dede42a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:15:11 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fbfe4c56-6486-4c03-ade4-9672926eb9a6 tempest-AbsoluteLimitsTests-624023302 None] Flow 'volume_create_manager' (ec43a97d-08e5-454d-a4a0-bf6b400c2551) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:15:11 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-fbfe4c56-6486-4c03-ade4-9672926eb9a6 tempest-AbsoluteLimitsTests-624023302 None] Created volume successfully.
Jul 03 01:15:11 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8c75cd29-2a54-49c1-9af8-9e388c3eaff2 tempest-AbsoluteLimitsTests-624023302 None] Acquiring lock "cinder-98708072-a87d-4edd-b590-7c78a0b8c2b7-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:15:11 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8c75cd29-2a54-49c1-9af8-9e388c3eaff2 tempest-AbsoluteLimitsTests-624023302 None] Lock "cinder-98708072-a87d-4edd-b590-7c78a0b8c2b7-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:15:11 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8c75cd29-2a54-49c1-9af8-9e388c3eaff2 tempest-AbsoluteLimitsTests-624023302 None] Acquiring lock "cinder-quobyte-98708072-a87d-4edd-b590-7c78a0b8c2b7" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:15:11 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8c75cd29-2a54-49c1-9af8-9e388c3eaff2 tempest-AbsoluteLimitsTests-624023302 None] Lock "cinder-quobyte-98708072-a87d-4edd-b590-7c78a0b8c2b7" acquired by "delete_volume" :: waited 0.036s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:15:11 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[4870f2db-1881-443d-b747-80b7c310349d]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:15:11 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8c75cd29-2a54-49c1-9af8-9e388c3eaff2 tempest-AbsoluteLimitsTests-624023302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-98708072-a87d-4edd-b590-7c78a0b8c2b7 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:15:11 devstack sudo[98730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-98708072-a87d-4edd-b590-7c78a0b8c2b7
Jul 03 01:15:11 devstack sudo[98730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:15:11 devstack sudo[98714]: pam_unix(sudo:session): session closed for user root
Jul 03 01:15:11 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-93db18d7-cf74-4024-8fb6-0204a3b21a70 tempest-VolumesImageMetadata-63910437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_65cceacb-879b-4111-919c-966899666f55_51ij8qr2devstack@QuobyteHD /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-999d47c3-717e-43e7-a376-10d16d3500a4" returned: 0 in 1.986s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:15:11 devstack cinder-volume[86891]: DEBUG cinder.image.image_utils [None req-93db18d7-cf74-4024-8fb6-0204a3b21a70 tempest-VolumesImageMetadata-63910437 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_65cceacb-879b-4111-919c-966899666f55_51ij8qr2devstack@QuobyteHD, size 112.00 MB, duration 1.99 sec, destination /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-999d47c3-717e-43e7-a376-10d16d3500a4 {{(pid=86891) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 03 01:15:11 devstack cinder-volume[86891]: INFO cinder.image.image_utils [None req-93db18d7-cf74-4024-8fb6-0204a3b21a70 tempest-VolumesImageMetadata-63910437 None] Converted 112.00 MB image at 56.36 MB/s
Jul 03 01:15:11 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-93db18d7-cf74-4024-8fb6-0204a3b21a70 tempest-VolumesImageMetadata-63910437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-999d47c3-717e-43e7-a376-10d16d3500a4 1G {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:15:11 devstack sudo[98732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-999d47c3-717e-43e7-a376-10d16d3500a4 1G
Jul 03 01:15:11 devstack sudo[98732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:15:12 devstack sudo[98730]: pam_unix(sudo:session): session closed for user root
Jul 03 01:15:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8c75cd29-2a54-49c1-9af8-9e388c3eaff2 tempest-AbsoluteLimitsTests-624023302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-98708072-a87d-4edd-b590-7c78a0b8c2b7" returned: 0 in 0.769s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:15:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8c75cd29-2a54-49c1-9af8-9e388c3eaff2 tempest-AbsoluteLimitsTests-624023302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-98708072-a87d-4edd-b590-7c78a0b8c2b7 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:15:12 devstack sudo[98739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-98708072-a87d-4edd-b590-7c78a0b8c2b7
Jul 03 01:15:12 devstack sudo[98739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:15:12 devstack sudo[98732]: pam_unix(sudo:session): session closed for user root
Jul 03 01:15:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-93db18d7-cf74-4024-8fb6-0204a3b21a70 tempest-VolumesImageMetadata-63910437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-999d47c3-717e-43e7-a376-10d16d3500a4 1G" returned: 0 in 0.699s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:15:12 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc84b42-b9cf-45d3-ade9-3d0e0169291a]: (4, 'raw') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:15:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-93db18d7-cf74-4024-8fb6-0204a3b21a70 tempest-VolumesImageMetadata-63910437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-999d47c3-717e-43e7-a376-10d16d3500a4 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:15:12 devstack sudo[98742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-999d47c3-717e-43e7-a376-10d16d3500a4
Jul 03 01:15:12 devstack sudo[98742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:15:13 devstack sudo[98739]: pam_unix(sudo:session): session closed for user root
Jul 03 01:15:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8c75cd29-2a54-49c1-9af8-9e388c3eaff2 tempest-AbsoluteLimitsTests-624023302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-98708072-a87d-4edd-b590-7c78a0b8c2b7" returned: 0 in 0.708s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:15:13 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8c75cd29-2a54-49c1-9af8-9e388c3eaff2 tempest-AbsoluteLimitsTests-624023302 None] Lock "cinder-quobyte-98708072-a87d-4edd-b590-7c78a0b8c2b7" released by "delete_volume" :: held 1.539s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:15:13 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-8c75cd29-2a54-49c1-9af8-9e388c3eaff2 tempest-AbsoluteLimitsTests-624023302 None] Created reservations ['1c282280-3bae-44fa-a52e-8eb23a3f65e0', '39c0b926-ced4-477a-b754-36c6ffef0058', 'ca2ed09b-a51b-4f3e-a600-bbe5e88141b7', 'bc6c4467-38cb-45a1-b8c2-46d4c8b83d8b'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:15:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-8c75cd29-2a54-49c1-9af8-9e388c3eaff2 tempest-AbsoluteLimitsTests-624023302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:15:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-8c75cd29-2a54-49c1-9af8-9e388c3eaff2 tempest-AbsoluteLimitsTests-624023302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:15:13 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-8c75cd29-2a54-49c1-9af8-9e388c3eaff2 tempest-AbsoluteLimitsTests-624023302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:15:13 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-8c75cd29-2a54-49c1-9af8-9e388c3eaff2 tempest-AbsoluteLimitsTests-624023302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:15:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-8c75cd29-2a54-49c1-9af8-9e388c3eaff2 tempest-AbsoluteLimitsTests-624023302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:15:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8c75cd29-2a54-49c1-9af8-9e388c3eaff2 tempest-AbsoluteLimitsTests-624023302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:15:13 devstack sudo[98745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:15:13 devstack sudo[98745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:15:13 devstack sudo[98742]: pam_unix(sudo:session): session closed for user root
Jul 03 01:15:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-93db18d7-cf74-4024-8fb6-0204a3b21a70 tempest-VolumesImageMetadata-63910437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-999d47c3-717e-43e7-a376-10d16d3500a4" returned: 0 in 0.835s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:15:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-93db18d7-cf74-4024-8fb6-0204a3b21a70 tempest-VolumesImageMetadata-63910437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-999d47c3-717e-43e7-a376-10d16d3500a4 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:15:13 devstack sudo[98749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-999d47c3-717e-43e7-a376-10d16d3500a4
Jul 03 01:15:13 devstack sudo[98749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:15:14 devstack sudo[98745]: pam_unix(sudo:session): session closed for user root
Jul 03 01:15:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8c75cd29-2a54-49c1-9af8-9e388c3eaff2 tempest-AbsoluteLimitsTests-624023302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 1.012s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:15:14 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-8c75cd29-2a54-49c1-9af8-9e388c3eaff2 tempest-AbsoluteLimitsTests-624023302 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:15:14 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-8c75cd29-2a54-49c1-9af8-9e388c3eaff2 tempest-AbsoluteLimitsTests-624023302 None] Deleted volume successfully.
Jul 03 01:15:14 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8c75cd29-2a54-49c1-9af8-9e388c3eaff2 tempest-AbsoluteLimitsTests-624023302 None] Lock "cinder-98708072-a87d-4edd-b590-7c78a0b8c2b7-delete_volume" released by "delete_volume" :: held 2.810s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:15:14 devstack sudo[98749]: pam_unix(sudo:session): session closed for user root
Jul 03 01:15:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-93db18d7-cf74-4024-8fb6-0204a3b21a70 tempest-VolumesImageMetadata-63910437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-999d47c3-717e-43e7-a376-10d16d3500a4" returned: 1 in 1.059s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:15:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-93db18d7-cf74-4024-8fb6-0204a3b21a70 tempest-VolumesImageMetadata-63910437 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-999d47c3-717e-43e7-a376-10d16d3500a4' failed. Not Retrying. {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 01:15:14 devstack cinder-volume[86891]: DEBUG cinder.volume.volume_utils [None req-93db18d7-cf74-4024-8fb6-0204a3b21a70 tempest-VolumesImageMetadata-63910437 None] Downloaded image 65cceacb-879b-4111-919c-966899666f55 ((None, [{'url': 'file:///opt/stack/data/glance/images/65cceacb-879b-4111-919c-966899666f55', 'metadata': {}}])) to volume 999d47c3-717e-43e7-a376-10d16d3500a4 successfully. {{(pid=86891) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 03 01:15:14 devstack cinder-volume[86891]: DEBUG cinder.image.image_utils [None req-93db18d7-cf74-4024-8fb6-0204a3b21a70 tempest-VolumesImageMetadata-63910437 None] Temporary image 65cceacb-879b-4111-919c-966899666f55 for user 333ab48b7b174b5bae2089326dc17a0b is deleted. {{(pid=86891) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 03 01:15:14 devstack cinder-volume[86891]: DEBUG cinder.volume.volume_utils [None req-93db18d7-cf74-4024-8fb6-0204a3b21a70 tempest-VolumesImageMetadata-63910437 None] Marking volume 999d47c3-717e-43e7-a376-10d16d3500a4 as bootable. {{(pid=86891) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 03 01:15:14 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-93db18d7-cf74-4024-8fb6-0204a3b21a70 tempest-VolumesImageMetadata-63910437 None] Copying metadata from image 65cceacb-879b-4111-919c-966899666f55 to 999d47c3-717e-43e7-a376-10d16d3500a4. {{(pid=86891) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 03 01:15:14 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-93db18d7-cf74-4024-8fb6-0204a3b21a70 tempest-VolumesImageMetadata-63910437 None] Creating volume glance metadata for volume 999d47c3-717e-43e7-a376-10d16d3500a4 backed by image 65cceacb-879b-4111-919c-966899666f55 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '65cceacb-879b-4111-919c-966899666f55', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86891) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 03 01:15:14 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-93db18d7-cf74-4024-8fb6-0204a3b21a70 tempest-VolumesImageMetadata-63910437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51d87ed2-8396-45f0-bc9b-4534d88ec197) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-999d47c3-717e-43e7-a376-10d16d3500a4', 'volume_size': 1, 'image_id': '65cceacb-879b-4111-919c-966899666f55', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/65cceacb-879b-4111-919c-966899666f55', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0d33e5361cf145ffa2791b827e46aea8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '65cceacb-879b-4111-919c-966899666f55', 'created_at': datetime.datetime(2026, 7, 2, 22, 57, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 22, 57, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/65cceacb-879b-4111-919c-966899666f55/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7c5b35221550>}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:15:14 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-93db18d7-cf74-4024-8fb6-0204a3b21a70 tempest-VolumesImageMetadata-63910437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e246feaa-dae3-49ff-932c-d5caa203b734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:15:14 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-93db18d7-cf74-4024-8fb6-0204a3b21a70 tempest-VolumesImageMetadata-63910437 None] Volume volume-999d47c3-717e-43e7-a376-10d16d3500a4 (999d47c3-717e-43e7-a376-10d16d3500a4): created successfully
Jul 03 01:15:14 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-93db18d7-cf74-4024-8fb6-0204a3b21a70 tempest-VolumesImageMetadata-63910437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e246feaa-dae3-49ff-932c-d5caa203b734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:15:14 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-93db18d7-cf74-4024-8fb6-0204a3b21a70 tempest-VolumesImageMetadata-63910437 None] Flow 'volume_create_manager' (352fa343-aea0-49cb-b820-c921a0f3c226) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:15:14 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-93db18d7-cf74-4024-8fb6-0204a3b21a70 tempest-VolumesImageMetadata-63910437 None] Created volume successfully.
Jul 03 01:15:15 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-b7ff88b3-f337-44a0-ab30-731a82d2748a tempest-VolumesImageMetadata-63910437 None] Acquiring lock "cinder-999d47c3-717e-43e7-a376-10d16d3500a4-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:15:15 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-b7ff88b3-f337-44a0-ab30-731a82d2748a tempest-VolumesImageMetadata-63910437 None] Lock "cinder-999d47c3-717e-43e7-a376-10d16d3500a4-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:15:15 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-b7ff88b3-f337-44a0-ab30-731a82d2748a tempest-VolumesImageMetadata-63910437 None] Acquiring lock "cinder-quobyte-999d47c3-717e-43e7-a376-10d16d3500a4" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:15:15 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-b7ff88b3-f337-44a0-ab30-731a82d2748a tempest-VolumesImageMetadata-63910437 None] Lock "cinder-quobyte-999d47c3-717e-43e7-a376-10d16d3500a4" acquired by "delete_volume" :: waited 0.034s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:15:15 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fdd272b-2156-4782-892b-5930d8a982b1]: (4, 'raw') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:15:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b7ff88b3-f337-44a0-ab30-731a82d2748a tempest-VolumesImageMetadata-63910437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-999d47c3-717e-43e7-a376-10d16d3500a4 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:15:15 devstack sudo[98773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-999d47c3-717e-43e7-a376-10d16d3500a4
Jul 03 01:15:15 devstack sudo[98773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:15:16 devstack sudo[98773]: pam_unix(sudo:session): session closed for user root
Jul 03 01:15:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b7ff88b3-f337-44a0-ab30-731a82d2748a tempest-VolumesImageMetadata-63910437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-999d47c3-717e-43e7-a376-10d16d3500a4" returned: 0 in 0.842s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:15:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b7ff88b3-f337-44a0-ab30-731a82d2748a tempest-VolumesImageMetadata-63910437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-999d47c3-717e-43e7-a376-10d16d3500a4 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:15:16 devstack sudo[98777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-999d47c3-717e-43e7-a376-10d16d3500a4
Jul 03 01:15:16 devstack sudo[98777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:15:17 devstack sudo[98777]: pam_unix(sudo:session): session closed for user root
Jul 03 01:15:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b7ff88b3-f337-44a0-ab30-731a82d2748a tempest-VolumesImageMetadata-63910437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-999d47c3-717e-43e7-a376-10d16d3500a4" returned: 1 in 0.903s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:15:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b7ff88b3-f337-44a0-ab30-731a82d2748a tempest-VolumesImageMetadata-63910437 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-999d47c3-717e-43e7-a376-10d16d3500a4' failed. Not Retrying. {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 01:15:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b7ff88b3-f337-44a0-ab30-731a82d2748a tempest-VolumesImageMetadata-63910437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-999d47c3-717e-43e7-a376-10d16d3500a4 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:15:17 devstack sudo[98782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-999d47c3-717e-43e7-a376-10d16d3500a4
Jul 03 01:15:17 devstack sudo[98782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:15:18 devstack sudo[98782]: pam_unix(sudo:session): session closed for user root
Jul 03 01:15:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b7ff88b3-f337-44a0-ab30-731a82d2748a tempest-VolumesImageMetadata-63910437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-999d47c3-717e-43e7-a376-10d16d3500a4" returned: 0 in 0.707s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:15:18 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-b7ff88b3-f337-44a0-ab30-731a82d2748a tempest-VolumesImageMetadata-63910437 None] Lock "cinder-quobyte-999d47c3-717e-43e7-a376-10d16d3500a4" released by "delete_volume" :: held 2.554s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:15:18 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-b7ff88b3-f337-44a0-ab30-731a82d2748a tempest-VolumesImageMetadata-63910437 None] Created reservations ['66293de8-c344-496c-a2fc-8acbfa7a292f', '973a5dbb-f48a-4f46-b047-08e4b0a234e4', '5d13d80f-2cbb-40a2-b785-d255f5a1fbe7', 'fe433e05-6cb3-4034-a5d4-0b57e1f4c72d'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:15:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b7ff88b3-f337-44a0-ab30-731a82d2748a tempest-VolumesImageMetadata-63910437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:15:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b7ff88b3-f337-44a0-ab30-731a82d2748a tempest-VolumesImageMetadata-63910437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:15:18 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-b7ff88b3-f337-44a0-ab30-731a82d2748a tempest-VolumesImageMetadata-63910437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:15:18 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-b7ff88b3-f337-44a0-ab30-731a82d2748a tempest-VolumesImageMetadata-63910437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:15:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b7ff88b3-f337-44a0-ab30-731a82d2748a tempest-VolumesImageMetadata-63910437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:15:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b7ff88b3-f337-44a0-ab30-731a82d2748a tempest-VolumesImageMetadata-63910437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:15:18 devstack sudo[98787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:15:18 devstack sudo[98787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:15:18 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-317475f5-1559-47fe-9bd0-5841f2ec99b7 tempest-VolumesDeleteCascade-111846741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:15:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-317475f5-1559-47fe-9bd0-5841f2ec99b7 tempest-VolumesDeleteCascade-111846741 None] Flow 'volume_create_manager' (68fb1ccb-49e8-42f7-b98e-782453a464f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:15:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-317475f5-1559-47fe-9bd0-5841f2ec99b7 tempest-VolumesDeleteCascade-111846741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64c3a3dd-8b72-4b28-b4de-49a2fe82960b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:15:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-317475f5-1559-47fe-9bd0-5841f2ec99b7 tempest-VolumesDeleteCascade-111846741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64c3a3dd-8b72-4b28-b4de-49a2fe82960b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:15:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1512592088',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55cc30a9-c75e-4996-8c39-7c1eedda49fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c26c8b32ff104dc9b16a548011440c55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:15:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:15:18Z,use_quota=True,user_id='7a974c46b5264104ba1adca50c161965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:15:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-317475f5-1559-47fe-9bd0-5841f2ec99b7 tempest-VolumesDeleteCascade-111846741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4016f414-955f-440d-bc0b-c9cfce38d96c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:15:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-317475f5-1559-47fe-9bd0-5841f2ec99b7 tempest-VolumesDeleteCascade-111846741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4016f414-955f-440d-bc0b-c9cfce38d96c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:15:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-317475f5-1559-47fe-9bd0-5841f2ec99b7 tempest-VolumesDeleteCascade-111846741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6fc4ba4-5bd7-47ac-b6ba-8f47e4e785cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:15:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-317475f5-1559-47fe-9bd0-5841f2ec99b7 tempest-VolumesDeleteCascade-111846741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6fc4ba4-5bd7-47ac-b6ba-8f47e4e785cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55cc30a9-c75e-4996-8c39-7c1eedda49fe', 'volume_name': 'volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:15:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-317475f5-1559-47fe-9bd0-5841f2ec99b7 tempest-VolumesDeleteCascade-111846741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c7c0818-1af3-47e9-95db-627cccce2a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:15:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-317475f5-1559-47fe-9bd0-5841f2ec99b7 tempest-VolumesDeleteCascade-111846741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c7c0818-1af3-47e9-95db-627cccce2a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:15:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-317475f5-1559-47fe-9bd0-5841f2ec99b7 tempest-VolumesDeleteCascade-111846741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd36ca5f-987e-4a43-8ac1-d9d28e42bb14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:15:18 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-317475f5-1559-47fe-9bd0-5841f2ec99b7 tempest-VolumesDeleteCascade-111846741 None] Volume 55cc30a9-c75e-4996-8c39-7c1eedda49fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe', 'volume_size': 1}
Jul 03 01:15:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-317475f5-1559-47fe-9bd0-5841f2ec99b7 tempest-VolumesDeleteCascade-111846741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:15:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-317475f5-1559-47fe-9bd0-5841f2ec99b7 tempest-VolumesDeleteCascade-111846741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:15:18 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-317475f5-1559-47fe-9bd0-5841f2ec99b7 tempest-VolumesDeleteCascade-111846741 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:15:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1512592088',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55cc30a9-c75e-4996-8c39-7c1eedda49fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c26c8b32ff104dc9b16a548011440c55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:15:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:15:18Z,use_quota=True,user_id='7a974c46b5264104ba1adca50c161965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:15:18 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-317475f5-1559-47fe-9bd0-5841f2ec99b7 tempest-VolumesDeleteCascade-111846741 None] Creating volume 55cc30a9-c75e-4996-8c39-7c1eedda49fe {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:15:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-317475f5-1559-47fe-9bd0-5841f2ec99b7 tempest-VolumesDeleteCascade-111846741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:15:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-317475f5-1559-47fe-9bd0-5841f2ec99b7 tempest-VolumesDeleteCascade-111846741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:15:18 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-317475f5-1559-47fe-9bd0-5841f2ec99b7 tempest-VolumesDeleteCascade-111846741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:15:18 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-317475f5-1559-47fe-9bd0-5841f2ec99b7 tempest-VolumesDeleteCascade-111846741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:15:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-317475f5-1559-47fe-9bd0-5841f2ec99b7 tempest-VolumesDeleteCascade-111846741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:15:18 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-317475f5-1559-47fe-9bd0-5841f2ec99b7 tempest-VolumesDeleteCascade-111846741 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:15:18 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-317475f5-1559-47fe-9bd0-5841f2ec99b7 tempest-VolumesDeleteCascade-111846741 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:15:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-317475f5-1559-47fe-9bd0-5841f2ec99b7 tempest-VolumesDeleteCascade-111846741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:15:18 devstack sudo[98792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe 1073741824
Jul 03 01:15:18 devstack sudo[98792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:15:19 devstack sudo[98787]: pam_unix(sudo:session): session closed for user root
Jul 03 01:15:19 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b7ff88b3-f337-44a0-ab30-731a82d2748a tempest-VolumesImageMetadata-63910437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.728s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:15:19 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-b7ff88b3-f337-44a0-ab30-731a82d2748a tempest-VolumesImageMetadata-63910437 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:15:19 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-b7ff88b3-f337-44a0-ab30-731a82d2748a tempest-VolumesImageMetadata-63910437 None] Deleted volume successfully.
Jul 03 01:15:19 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-b7ff88b3-f337-44a0-ab30-731a82d2748a tempest-VolumesImageMetadata-63910437 None] Lock "cinder-999d47c3-717e-43e7-a376-10d16d3500a4-delete_volume" released by "delete_volume" :: held 3.574s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:15:19 devstack sudo[98792]: pam_unix(sudo:session): session closed for user root
Jul 03 01:15:19 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-317475f5-1559-47fe-9bd0-5841f2ec99b7 tempest-VolumesDeleteCascade-111846741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe 1073741824" returned: 0 in 0.958s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:15:19 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-317475f5-1559-47fe-9bd0-5841f2ec99b7 tempest-VolumesDeleteCascade-111846741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:15:19 devstack sudo[98799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe
Jul 03 01:15:19 devstack sudo[98799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:15:20 devstack sudo[98799]: pam_unix(sudo:session): session closed for user root
Jul 03 01:15:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-317475f5-1559-47fe-9bd0-5841f2ec99b7 tempest-VolumesDeleteCascade-111846741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe" returned: 0 in 1.003s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:15:20 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-317475f5-1559-47fe-9bd0-5841f2ec99b7 tempest-VolumesDeleteCascade-111846741 None] <== create_volume: return (2026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:15:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-317475f5-1559-47fe-9bd0-5841f2ec99b7 tempest-VolumesDeleteCascade-111846741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.029s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:15:20 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-317475f5-1559-47fe-9bd0-5841f2ec99b7 tempest-VolumesDeleteCascade-111846741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd36ca5f-987e-4a43-8ac1-d9d28e42bb14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:15:20 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-317475f5-1559-47fe-9bd0-5841f2ec99b7 tempest-VolumesDeleteCascade-111846741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64d0346c-9e74-402c-8f83-47239af1e500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:15:20 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-317475f5-1559-47fe-9bd0-5841f2ec99b7 tempest-VolumesDeleteCascade-111846741 None] Volume volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe (55cc30a9-c75e-4996-8c39-7c1eedda49fe): created successfully
Jul 03 01:15:20 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-317475f5-1559-47fe-9bd0-5841f2ec99b7 tempest-VolumesDeleteCascade-111846741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64d0346c-9e74-402c-8f83-47239af1e500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:15:20 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-317475f5-1559-47fe-9bd0-5841f2ec99b7 tempest-VolumesDeleteCascade-111846741 None] Flow 'volume_create_manager' (68fb1ccb-49e8-42f7-b98e-782453a464f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:15:20 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-317475f5-1559-47fe-9bd0-5841f2ec99b7 tempest-VolumesDeleteCascade-111846741 None] Created volume successfully.
Jul 03 01:15:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-45835f81-7740-455a-a603-0be604012e0a tempest-VolumesDeleteCascade-111846741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:15:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-45835f81-7740-455a-a603-0be604012e0a tempest-VolumesDeleteCascade-111846741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:15:21 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-45835f81-7740-455a-a603-0be604012e0a tempest-VolumesDeleteCascade-111846741 None] Creating offline snapshot 56d8d3ed-32ef-4af2-bb53-77a2ae2dbdd6 of volume 55cc30a9-c75e-4996-8c39-7c1eedda49fe {{(pid=86891) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 01:15:21 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da853aa-c791-4a39-b3d0-98a31cf166ee]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:15:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-45835f81-7740-455a-a603-0be604012e0a tempest-VolumesDeleteCascade-111846741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:15:22 devstack sudo[98869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe
Jul 03 01:15:22 devstack sudo[98869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:15:23 devstack sudo[98869]: pam_unix(sudo:session): session closed for user root
Jul 03 01:15:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-45835f81-7740-455a-a603-0be604012e0a tempest-VolumesDeleteCascade-111846741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe" returned: 0 in 1.100s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:15:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-45835f81-7740-455a-a603-0be604012e0a tempest-VolumesDeleteCascade-111846741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe.56d8d3ed-32ef-4af2-bb53-77a2ae2dbdd6 1G {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:15:23 devstack sudo[98874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe.56d8d3ed-32ef-4af2-bb53-77a2ae2dbdd6 1G
Jul 03 01:15:23 devstack sudo[98874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:15:23 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-924eaf4d-bbc6-4db5-8a3c-eb38419ec9ee tempest-VolumesActionsTest-1288723690 None] Acquiring lock "cinder-48a2c0f1-8c98-4310-87d1-ed911e42f70c" by "attach_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:15:23 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-924eaf4d-bbc6-4db5-8a3c-eb38419ec9ee tempest-VolumesActionsTest-1288723690 None] Lock "cinder-48a2c0f1-8c98-4310-87d1-ed911e42f70c" acquired by "attach_volume" :: waited 0.024s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:15:23 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-924eaf4d-bbc6-4db5-8a3c-eb38419ec9ee tempest-VolumesActionsTest-1288723690 None] Attaching volume 48a2c0f1-8c98-4310-87d1-ed911e42f70c to instance d00264ff-8a48-4960-a240-d4ae83a0d97a at mountpoint /dev/vdb on host None.
Jul 03 01:15:23 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-924eaf4d-bbc6-4db5-8a3c-eb38419ec9ee tempest-VolumesActionsTest-1288723690 None] Attach volume completed successfully.
Jul 03 01:15:23 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-924eaf4d-bbc6-4db5-8a3c-eb38419ec9ee tempest-VolumesActionsTest-1288723690 None] Lock "cinder-48a2c0f1-8c98-4310-87d1-ed911e42f70c" released by "attach_volume" :: held 0.112s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:15:24 devstack sudo[98874]: pam_unix(sudo:session): session closed for user root
Jul 03 01:15:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-45835f81-7740-455a-a603-0be604012e0a tempest-VolumesDeleteCascade-111846741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe.56d8d3ed-32ef-4af2-bb53-77a2ae2dbdd6 1G" returned: 0 in 0.964s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:15:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-45835f81-7740-455a-a603-0be604012e0a tempest-VolumesDeleteCascade-111846741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe.56d8d3ed-32ef-4af2-bb53-77a2ae2dbdd6 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:15:24 devstack sudo[98880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe.56d8d3ed-32ef-4af2-bb53-77a2ae2dbdd6
Jul 03 01:15:24 devstack sudo[98880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:15:24 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-1835f0aa-532d-4fb9-8175-641bfafa4817 tempest-VolumesTransfersTest-2032649736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:15:24 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1835f0aa-532d-4fb9-8175-641bfafa4817 tempest-VolumesTransfersTest-2032649736 None] Flow 'volume_create_manager' (812cd6e5-51b2-44cd-b685-3b8774886e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:15:24 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1835f0aa-532d-4fb9-8175-641bfafa4817 tempest-VolumesTransfersTest-2032649736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd8fa0a1-98e6-4981-8775-81e587b9b32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:15:24 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-c0e5d32a-8bd7-4622-a745-e3b0c9ad190c tempest-VolumesActionsTest-1288723690 None] Acquiring lock "cinder-48a2c0f1-8c98-4310-87d1-ed911e42f70c-detach_volume" by "detach_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:15:24 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1835f0aa-532d-4fb9-8175-641bfafa4817 tempest-VolumesTransfersTest-2032649736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd8fa0a1-98e6-4981-8775-81e587b9b32c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:15:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-419375163',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a197aec6-a6fb-4900-95d6-f47d53c3c0e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d13b088c2c246a2b48ff0ba0abea040',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:15:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:15:25Z,use_quota=True,user_id='65ced55028374aeebbe75386cffaa466',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:15:24 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1835f0aa-532d-4fb9-8175-641bfafa4817 tempest-VolumesTransfersTest-2032649736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a047503-c260-4328-8795-10d859353773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:15:24 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1835f0aa-532d-4fb9-8175-641bfafa4817 tempest-VolumesTransfersTest-2032649736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a047503-c260-4328-8795-10d859353773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:15:24 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1835f0aa-532d-4fb9-8175-641bfafa4817 tempest-VolumesTransfersTest-2032649736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2514155-f2cc-4008-974b-0125e765ba96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:15:24 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1835f0aa-532d-4fb9-8175-641bfafa4817 tempest-VolumesTransfersTest-2032649736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2514155-f2cc-4008-974b-0125e765ba96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a197aec6-a6fb-4900-95d6-f47d53c3c0e7', 'volume_name': 'volume-a197aec6-a6fb-4900-95d6-f47d53c3c0e7', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:15:24 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1835f0aa-532d-4fb9-8175-641bfafa4817 tempest-VolumesTransfersTest-2032649736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd794918-184d-4d68-afe8-8ca0c76d3138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:15:24 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1835f0aa-532d-4fb9-8175-641bfafa4817 tempest-VolumesTransfersTest-2032649736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd794918-184d-4d68-afe8-8ca0c76d3138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:15:24 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1835f0aa-532d-4fb9-8175-641bfafa4817 tempest-VolumesTransfersTest-2032649736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25fee680-a27d-461c-a22e-8567508f79d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:15:24 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-1835f0aa-532d-4fb9-8175-641bfafa4817 tempest-VolumesTransfersTest-2032649736 None] Volume a197aec6-a6fb-4900-95d6-f47d53c3c0e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a197aec6-a6fb-4900-95d6-f47d53c3c0e7', 'volume_size': 1}
Jul 03 01:15:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1835f0aa-532d-4fb9-8175-641bfafa4817 tempest-VolumesTransfersTest-2032649736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:15:24 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-c0e5d32a-8bd7-4622-a745-e3b0c9ad190c tempest-VolumesActionsTest-1288723690 None] Lock "cinder-48a2c0f1-8c98-4310-87d1-ed911e42f70c-detach_volume" acquired by "detach_volume" :: waited 0.078s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:15:24 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-c0e5d32a-8bd7-4622-a745-e3b0c9ad190c tempest-VolumesActionsTest-1288723690 None] Detaching volume 48a2c0f1-8c98-4310-87d1-ed911e42f70c from instance d00264ff-8a48-4960-a240-d4ae83a0d97a.
Jul 03 01:15:24 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-c0e5d32a-8bd7-4622-a745-e3b0c9ad190c tempest-VolumesActionsTest-1288723690 None] Detach volume completed successfully.
Jul 03 01:15:24 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-c0e5d32a-8bd7-4622-a745-e3b0c9ad190c tempest-VolumesActionsTest-1288723690 None] Lock "cinder-48a2c0f1-8c98-4310-87d1-ed911e42f70c-detach_volume" released by "detach_volume" :: held 0.062s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:15:24 devstack sudo[98880]: pam_unix(sudo:session): session closed for user root
Jul 03 01:15:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-45835f81-7740-455a-a603-0be604012e0a tempest-VolumesDeleteCascade-111846741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe.56d8d3ed-32ef-4af2-bb53-77a2ae2dbdd6" returned: 0 in 0.742s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:15:24 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-45835f81-7740-455a-a603-0be604012e0a tempest-VolumesDeleteCascade-111846741 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe.56d8d3ed-32ef-4af2-bb53-77a2ae2dbdd6 is being set with open permissions: ugo+rw
Jul 03 01:15:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-45835f81-7740-455a-a603-0be604012e0a tempest-VolumesDeleteCascade-111846741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe.56d8d3ed-32ef-4af2-bb53-77a2ae2dbdd6 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:15:24 devstack sudo[98886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe.56d8d3ed-32ef-4af2-bb53-77a2ae2dbdd6
Jul 03 01:15:24 devstack sudo[98886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:15:25 devstack sudo[98886]: pam_unix(sudo:session): session closed for user root
Jul 03 01:15:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-45835f81-7740-455a-a603-0be604012e0a tempest-VolumesDeleteCascade-111846741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe.56d8d3ed-32ef-4af2-bb53-77a2ae2dbdd6" returned: 0 in 0.686s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:15:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-45835f81-7740-455a-a603-0be604012e0a tempest-VolumesDeleteCascade-111846741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:15:25 devstack sudo[98889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe.info
Jul 03 01:15:25 devstack sudo[98889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:15:26 devstack sudo[98889]: pam_unix(sudo:session): session closed for user root
Jul 03 01:15:26 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-45835f81-7740-455a-a603-0be604012e0a tempest-VolumesDeleteCascade-111846741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe.info" returned: 0 in 0.647s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:15:26 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-45835f81-7740-455a-a603-0be604012e0a tempest-VolumesDeleteCascade-111846741 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe.info is being set with open permissions: ugo+rw
Jul 03 01:15:26 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-45835f81-7740-455a-a603-0be604012e0a tempest-VolumesDeleteCascade-111846741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:15:26 devstack sudo[98916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe.info
Jul 03 01:15:26 devstack sudo[98916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:15:27 devstack sudo[98916]: pam_unix(sudo:session): session closed for user root
Jul 03 01:15:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-45835f81-7740-455a-a603-0be604012e0a tempest-VolumesDeleteCascade-111846741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe.info" returned: 0 in 1.207s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:15:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-45835f81-7740-455a-a603-0be604012e0a tempest-VolumesDeleteCascade-111846741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.476s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:15:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1835f0aa-532d-4fb9-8175-641bfafa4817 tempest-VolumesTransfersTest-2032649736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.737s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:15:27 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-1835f0aa-532d-4fb9-8175-641bfafa4817 tempest-VolumesTransfersTest-2032649736 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:15:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-419375163',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a197aec6-a6fb-4900-95d6-f47d53c3c0e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d13b088c2c246a2b48ff0ba0abea040',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:15:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:15:25Z,use_quota=True,user_id='65ced55028374aeebbe75386cffaa466',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:15:27 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-1835f0aa-532d-4fb9-8175-641bfafa4817 tempest-VolumesTransfersTest-2032649736 None] Creating volume a197aec6-a6fb-4900-95d6-f47d53c3c0e7 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:15:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1835f0aa-532d-4fb9-8175-641bfafa4817 tempest-VolumesTransfersTest-2032649736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:15:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1835f0aa-532d-4fb9-8175-641bfafa4817 tempest-VolumesTransfersTest-2032649736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:15:27 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-1835f0aa-532d-4fb9-8175-641bfafa4817 tempest-VolumesTransfersTest-2032649736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:15:27 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-1835f0aa-532d-4fb9-8175-641bfafa4817 tempest-VolumesTransfersTest-2032649736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:15:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1835f0aa-532d-4fb9-8175-641bfafa4817 tempest-VolumesTransfersTest-2032649736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:15:27 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-1835f0aa-532d-4fb9-8175-641bfafa4817 tempest-VolumesTransfersTest-2032649736 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:15:27 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-1835f0aa-532d-4fb9-8175-641bfafa4817 tempest-VolumesTransfersTest-2032649736 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:15:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1835f0aa-532d-4fb9-8175-641bfafa4817 tempest-VolumesTransfersTest-2032649736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a197aec6-a6fb-4900-95d6-f47d53c3c0e7 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:15:27 devstack sudo[99013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a197aec6-a6fb-4900-95d6-f47d53c3c0e7 1073741824
Jul 03 01:15:27 devstack sudo[99013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:15:27 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-45835f81-7740-455a-a603-0be604012e0a tempest-VolumesDeleteCascade-111846741 None] Create snapshot completed successfully
Jul 03 01:15:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b3a57548-6bb3-4d00-a3cd-365e1a0369c2 tempest-VolumesDeleteCascade-111846741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:15:28 devstack sudo[99013]: pam_unix(sudo:session): session closed for user root
Jul 03 01:15:28 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1835f0aa-532d-4fb9-8175-641bfafa4817 tempest-VolumesTransfersTest-2032649736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a197aec6-a6fb-4900-95d6-f47d53c3c0e7 1073741824" returned: 0 in 0.979s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:15:28 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1835f0aa-532d-4fb9-8175-641bfafa4817 tempest-VolumesTransfersTest-2032649736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a197aec6-a6fb-4900-95d6-f47d53c3c0e7 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:15:28 devstack sudo[99032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a197aec6-a6fb-4900-95d6-f47d53c3c0e7
Jul 03 01:15:28 devstack sudo[99032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:15:29 devstack sudo[99032]: pam_unix(sudo:session): session closed for user root
Jul 03 01:15:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1835f0aa-532d-4fb9-8175-641bfafa4817 tempest-VolumesTransfersTest-2032649736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a197aec6-a6fb-4900-95d6-f47d53c3c0e7" returned: 0 in 0.775s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:15:29 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-1835f0aa-532d-4fb9-8175-641bfafa4817 tempest-VolumesTransfersTest-2032649736 None] <== create_volume: return (1808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:15:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1835f0aa-532d-4fb9-8175-641bfafa4817 tempest-VolumesTransfersTest-2032649736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.811s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:15:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b3a57548-6bb3-4d00-a3cd-365e1a0369c2 tempest-VolumesDeleteCascade-111846741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.352s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:15:29 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1835f0aa-532d-4fb9-8175-641bfafa4817 tempest-VolumesTransfersTest-2032649736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25fee680-a27d-461c-a22e-8567508f79d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a197aec6-a6fb-4900-95d6-f47d53c3c0e7', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:15:29 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1835f0aa-532d-4fb9-8175-641bfafa4817 tempest-VolumesTransfersTest-2032649736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6528c2af-f9e2-4084-b58e-8c9640c7f208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:15:29 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-b3a57548-6bb3-4d00-a3cd-365e1a0369c2 tempest-VolumesDeleteCascade-111846741 None] Creating offline snapshot 00c11e32-bbdf-4eff-a3c8-654a736a80ad of volume 55cc30a9-c75e-4996-8c39-7c1eedda49fe {{(pid=86891) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 01:15:29 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-1835f0aa-532d-4fb9-8175-641bfafa4817 tempest-VolumesTransfersTest-2032649736 None] Volume volume-a197aec6-a6fb-4900-95d6-f47d53c3c0e7 (a197aec6-a6fb-4900-95d6-f47d53c3c0e7): created successfully
Jul 03 01:15:29 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1835f0aa-532d-4fb9-8175-641bfafa4817 tempest-VolumesTransfersTest-2032649736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6528c2af-f9e2-4084-b58e-8c9640c7f208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:15:29 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1835f0aa-532d-4fb9-8175-641bfafa4817 tempest-VolumesTransfersTest-2032649736 None] Flow 'volume_create_manager' (812cd6e5-51b2-44cd-b685-3b8774886e2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:15:29 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[dace3288-f401-4c4f-9f05-0fdbcdbf52fd]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:15:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b3a57548-6bb3-4d00-a3cd-365e1a0369c2 tempest-VolumesDeleteCascade-111846741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe.56d8d3ed-32ef-4af2-bb53-77a2ae2dbdd6 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:15:29 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-1835f0aa-532d-4fb9-8175-641bfafa4817 tempest-VolumesTransfersTest-2032649736 None] Created volume successfully.
Jul 03 01:15:29 devstack sudo[99038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe.56d8d3ed-32ef-4af2-bb53-77a2ae2dbdd6
Jul 03 01:15:29 devstack sudo[99038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:15:30 devstack sudo[99038]: pam_unix(sudo:session): session closed for user root
Jul 03 01:15:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b3a57548-6bb3-4d00-a3cd-365e1a0369c2 tempest-VolumesDeleteCascade-111846741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe.56d8d3ed-32ef-4af2-bb53-77a2ae2dbdd6" returned: 0 in 0.761s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:15:30 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-b3a57548-6bb3-4d00-a3cd-365e1a0369c2 tempest-VolumesDeleteCascade-111846741 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:15:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b3a57548-6bb3-4d00-a3cd-365e1a0369c2 tempest-VolumesDeleteCascade-111846741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe.56d8d3ed-32ef-4af2-bb53-77a2ae2dbdd6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe.00c11e32-bbdf-4eff-a3c8-654a736a80ad 1G {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:15:30 devstack sudo[99043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe.56d8d3ed-32ef-4af2-bb53-77a2ae2dbdd6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe.00c11e32-bbdf-4eff-a3c8-654a736a80ad 1G
Jul 03 01:15:30 devstack sudo[99043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:15:30 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-2090e10e-085e-4534-a38e-584738a38e9c tempest-VolumesTransfersTest-247015675 None] Transfer volume completed successfully.
Jul 03 01:15:30 devstack sudo[99043]: pam_unix(sudo:session): session closed for user root
Jul 03 01:15:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b3a57548-6bb3-4d00-a3cd-365e1a0369c2 tempest-VolumesDeleteCascade-111846741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe.56d8d3ed-32ef-4af2-bb53-77a2ae2dbdd6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe.00c11e32-bbdf-4eff-a3c8-654a736a80ad 1G" returned: 0 in 0.812s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:15:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b3a57548-6bb3-4d00-a3cd-365e1a0369c2 tempest-VolumesDeleteCascade-111846741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe.56d8d3ed-32ef-4af2-bb53-77a2ae2dbdd6 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe.00c11e32-bbdf-4eff-a3c8-654a736a80ad {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:15:30 devstack sudo[99049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe.56d8d3ed-32ef-4af2-bb53-77a2ae2dbdd6 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe.00c11e32-bbdf-4eff-a3c8-654a736a80ad
Jul 03 01:15:30 devstack sudo[99049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:15:31 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-dd6e8857-c3d7-4770-8393-a2c049af3bea tempest-VolumesTransfersTest-550930157 None] Acquiring lock "cinder-a197aec6-a6fb-4900-95d6-f47d53c3c0e7-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:15:31 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-dd6e8857-c3d7-4770-8393-a2c049af3bea tempest-VolumesTransfersTest-550930157 None] Lock "cinder-a197aec6-a6fb-4900-95d6-f47d53c3c0e7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:15:31 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-dd6e8857-c3d7-4770-8393-a2c049af3bea tempest-VolumesTransfersTest-550930157 None] Acquiring lock "cinder-quobyte-a197aec6-a6fb-4900-95d6-f47d53c3c0e7" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:15:31 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-dd6e8857-c3d7-4770-8393-a2c049af3bea tempest-VolumesTransfersTest-550930157 None] Lock "cinder-quobyte-a197aec6-a6fb-4900-95d6-f47d53c3c0e7" acquired by "delete_volume" :: waited 0.018s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:15:31 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[3248aad7-17d6-4414-b97f-b31ab415ff2d]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:15:31 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-dd6e8857-c3d7-4770-8393-a2c049af3bea tempest-VolumesTransfersTest-550930157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a197aec6-a6fb-4900-95d6-f47d53c3c0e7 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:15:31 devstack sudo[99055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a197aec6-a6fb-4900-95d6-f47d53c3c0e7
Jul 03 01:15:31 devstack sudo[99055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:15:31 devstack sudo[99049]: pam_unix(sudo:session): session closed for user root
Jul 03 01:15:31 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b3a57548-6bb3-4d00-a3cd-365e1a0369c2 tempest-VolumesDeleteCascade-111846741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe.56d8d3ed-32ef-4af2-bb53-77a2ae2dbdd6 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe.00c11e32-bbdf-4eff-a3c8-654a736a80ad" returned: 0 in 0.735s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:15:31 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-b3a57548-6bb3-4d00-a3cd-365e1a0369c2 tempest-VolumesDeleteCascade-111846741 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe.00c11e32-bbdf-4eff-a3c8-654a736a80ad is being set with open permissions: ugo+rw
Jul 03 01:15:31 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b3a57548-6bb3-4d00-a3cd-365e1a0369c2 tempest-VolumesDeleteCascade-111846741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe.00c11e32-bbdf-4eff-a3c8-654a736a80ad {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:15:31 devstack sudo[99057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe.00c11e32-bbdf-4eff-a3c8-654a736a80ad
Jul 03 01:15:31 devstack sudo[99057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:15:32 devstack sudo[99055]: pam_unix(sudo:session): session closed for user root
Jul 03 01:15:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-dd6e8857-c3d7-4770-8393-a2c049af3bea tempest-VolumesTransfersTest-550930157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a197aec6-a6fb-4900-95d6-f47d53c3c0e7" returned: 0 in 0.736s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:15:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-dd6e8857-c3d7-4770-8393-a2c049af3bea tempest-VolumesTransfersTest-550930157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a197aec6-a6fb-4900-95d6-f47d53c3c0e7 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:15:32 devstack sudo[99063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a197aec6-a6fb-4900-95d6-f47d53c3c0e7
Jul 03 01:15:32 devstack sudo[99063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:15:32 devstack sudo[99057]: pam_unix(sudo:session): session closed for user root
Jul 03 01:15:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b3a57548-6bb3-4d00-a3cd-365e1a0369c2 tempest-VolumesDeleteCascade-111846741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe.00c11e32-bbdf-4eff-a3c8-654a736a80ad" returned: 0 in 0.650s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:15:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b3a57548-6bb3-4d00-a3cd-365e1a0369c2 tempest-VolumesDeleteCascade-111846741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.081s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:15:32 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-b3a57548-6bb3-4d00-a3cd-365e1a0369c2 tempest-VolumesDeleteCascade-111846741 None] Create snapshot completed successfully
Jul 03 01:15:32 devstack sudo[99063]: pam_unix(sudo:session): session closed for user root
Jul 03 01:15:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-dd6e8857-c3d7-4770-8393-a2c049af3bea tempest-VolumesTransfersTest-550930157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a197aec6-a6fb-4900-95d6-f47d53c3c0e7" returned: 0 in 0.646s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:15:32 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-dd6e8857-c3d7-4770-8393-a2c049af3bea tempest-VolumesTransfersTest-550930157 None] Lock "cinder-quobyte-a197aec6-a6fb-4900-95d6-f47d53c3c0e7" released by "delete_volume" :: held 1.419s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:15:32 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-dd6e8857-c3d7-4770-8393-a2c049af3bea tempest-VolumesTransfersTest-550930157 None] Created reservations ['c489bd72-7471-4bcb-bc3f-637147f36859', '11cab5e4-7661-4ee9-b293-f80ad04f71d6', '5de519af-1f30-42e0-b9b7-8d3674c1e9e9', '0b5e73b5-592d-46a4-b15b-1ec758a07cb0'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:15:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-dd6e8857-c3d7-4770-8393-a2c049af3bea tempest-VolumesTransfersTest-550930157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:15:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-dd6e8857-c3d7-4770-8393-a2c049af3bea tempest-VolumesTransfersTest-550930157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:15:33 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-dd6e8857-c3d7-4770-8393-a2c049af3bea tempest-VolumesTransfersTest-550930157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:15:33 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-dd6e8857-c3d7-4770-8393-a2c049af3bea tempest-VolumesTransfersTest-550930157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:15:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-dd6e8857-c3d7-4770-8393-a2c049af3bea tempest-VolumesTransfersTest-550930157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:15:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-dd6e8857-c3d7-4770-8393-a2c049af3bea tempest-VolumesTransfersTest-550930157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:15:33 devstack sudo[99066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:15:33 devstack sudo[99066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:15:33 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-b22b5ad1-e390-439a-8ea3-86cccc984f6a tempest-VolumesDeleteCascade-111846741 None] Acquiring lock "cinder-55cc30a9-c75e-4996-8c39-7c1eedda49fe-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:15:33 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-b22b5ad1-e390-439a-8ea3-86cccc984f6a tempest-VolumesDeleteCascade-111846741 None] Lock "cinder-55cc30a9-c75e-4996-8c39-7c1eedda49fe-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:15:33 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b22b5ad1-e390-439a-8ea3-86cccc984f6a tempest-VolumesDeleteCascade-111846741 None] Performing cascade delete. {{(pid=86891) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Jul 03 01:15:33 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-b22b5ad1-e390-439a-8ea3-86cccc984f6a tempest-VolumesDeleteCascade-111846741 None] Acquiring lock "cinder-00c11e32-bbdf-4eff-a3c8-654a736a80ad-delete_snapshot" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:15:33 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-b22b5ad1-e390-439a-8ea3-86cccc984f6a tempest-VolumesDeleteCascade-111846741 None] Lock "cinder-00c11e32-bbdf-4eff-a3c8-654a736a80ad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:15:33 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-b22b5ad1-e390-439a-8ea3-86cccc984f6a tempest-VolumesDeleteCascade-111846741 None] Acquiring lock "cinder-quobyte-55cc30a9-c75e-4996-8c39-7c1eedda49fe" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:15:33 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-b22b5ad1-e390-439a-8ea3-86cccc984f6a tempest-VolumesDeleteCascade-111846741 None] Lock "cinder-quobyte-55cc30a9-c75e-4996-8c39-7c1eedda49fe" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:15:33 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-b22b5ad1-e390-439a-8ea3-86cccc984f6a tempest-VolumesDeleteCascade-111846741 None] Acquiring lock "cinder-quobyte-00c11e32-bbdf-4eff-a3c8-654a736a80ad" by "_delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:15:33 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-b22b5ad1-e390-439a-8ea3-86cccc984f6a tempest-VolumesDeleteCascade-111846741 None] Lock "cinder-quobyte-00c11e32-bbdf-4eff-a3c8-654a736a80ad" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:15:33 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-b22b5ad1-e390-439a-8ea3-86cccc984f6a tempest-VolumesDeleteCascade-111846741 None] Deleting offline snapshot 00c11e32-bbdf-4eff-a3c8-654a736a80ad of volume 55cc30a9-c75e-4996-8c39-7c1eedda49fe {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 01:15:33 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-b22b5ad1-e390-439a-8ea3-86cccc984f6a tempest-VolumesDeleteCascade-111846741 None] snapshot_file for this snap is: volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe.00c11e32-bbdf-4eff-a3c8-654a736a80ad {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 01:15:33 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2731bf-24a3-480f-93ca-72f23e0ebbf1]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:15:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b22b5ad1-e390-439a-8ea3-86cccc984f6a tempest-VolumesDeleteCascade-111846741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe.00c11e32-bbdf-4eff-a3c8-654a736a80ad {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:15:33 devstack sudo[99068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe.00c11e32-bbdf-4eff-a3c8-654a736a80ad
Jul 03 01:15:33 devstack sudo[99068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:15:33 devstack sudo[99066]: pam_unix(sudo:session): session closed for user root
Jul 03 01:15:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-dd6e8857-c3d7-4770-8393-a2c049af3bea tempest-VolumesTransfersTest-550930157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.743s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:15:33 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-dd6e8857-c3d7-4770-8393-a2c049af3bea tempest-VolumesTransfersTest-550930157 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:15:33 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-dd6e8857-c3d7-4770-8393-a2c049af3bea tempest-VolumesTransfersTest-550930157 None] Deleted volume successfully.
Jul 03 01:15:33 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-dd6e8857-c3d7-4770-8393-a2c049af3bea tempest-VolumesTransfersTest-550930157 None] Lock "cinder-a197aec6-a6fb-4900-95d6-f47d53c3c0e7-delete_volume" released by "delete_volume" :: held 2.422s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:15:34 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-93a6dbec-dc87-41d9-8bcc-68e50508f96d tempest-VolumesTransfersTest-2032649736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:15:34 devstack sudo[99068]: pam_unix(sudo:session): session closed for user root
Jul 03 01:15:34 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-93a6dbec-dc87-41d9-8bcc-68e50508f96d tempest-VolumesTransfersTest-2032649736 None] Flow 'volume_create_manager' (9b434a8a-bf21-49d3-84d9-fea306f938c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:15:34 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-93a6dbec-dc87-41d9-8bcc-68e50508f96d tempest-VolumesTransfersTest-2032649736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e25dcfb6-12db-48b1-8e7d-c57c13d0d75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:15:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b22b5ad1-e390-439a-8ea3-86cccc984f6a tempest-VolumesDeleteCascade-111846741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe.00c11e32-bbdf-4eff-a3c8-654a736a80ad" returned: 0 in 0.934s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:15:34 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-93a6dbec-dc87-41d9-8bcc-68e50508f96d tempest-VolumesTransfersTest-2032649736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e25dcfb6-12db-48b1-8e7d-c57c13d0d75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:15:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1175254856',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca98e22c-639d-4d86-b5d9-ffbee3f98e26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d13b088c2c246a2b48ff0ba0abea040',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:15:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:15:34Z,use_quota=True,user_id='65ced55028374aeebbe75386cffaa466',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:15:34 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-93a6dbec-dc87-41d9-8bcc-68e50508f96d tempest-VolumesTransfersTest-2032649736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cdc4875-e3a4-4ed2-b06e-403f1a598b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:15:34 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-93a6dbec-dc87-41d9-8bcc-68e50508f96d tempest-VolumesTransfersTest-2032649736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cdc4875-e3a4-4ed2-b06e-403f1a598b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:15:34 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-93a6dbec-dc87-41d9-8bcc-68e50508f96d tempest-VolumesTransfersTest-2032649736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d13fbbc8-63be-4ce3-9524-e3ce06f0a4f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:15:34 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-93a6dbec-dc87-41d9-8bcc-68e50508f96d tempest-VolumesTransfersTest-2032649736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d13fbbc8-63be-4ce3-9524-e3ce06f0a4f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca98e22c-639d-4d86-b5d9-ffbee3f98e26', 'volume_name': 'volume-ca98e22c-639d-4d86-b5d9-ffbee3f98e26', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:15:34 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-93a6dbec-dc87-41d9-8bcc-68e50508f96d tempest-VolumesTransfersTest-2032649736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c917bd1-c145-40b4-a587-4e83ba8581f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:15:34 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-93a6dbec-dc87-41d9-8bcc-68e50508f96d tempest-VolumesTransfersTest-2032649736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c917bd1-c145-40b4-a587-4e83ba8581f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:15:34 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-93a6dbec-dc87-41d9-8bcc-68e50508f96d tempest-VolumesTransfersTest-2032649736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff9b1053-8677-45ce-a7cf-dad730c7f1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:15:34 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-93a6dbec-dc87-41d9-8bcc-68e50508f96d tempest-VolumesTransfersTest-2032649736 None] Volume ca98e22c-639d-4d86-b5d9-ffbee3f98e26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca98e22c-639d-4d86-b5d9-ffbee3f98e26', 'volume_size': 1}
Jul 03 01:15:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-93a6dbec-dc87-41d9-8bcc-68e50508f96d tempest-VolumesTransfersTest-2032649736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:15:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-93a6dbec-dc87-41d9-8bcc-68e50508f96d tempest-VolumesTransfersTest-2032649736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:15:34 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-93a6dbec-dc87-41d9-8bcc-68e50508f96d tempest-VolumesTransfersTest-2032649736 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:15:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1175254856',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca98e22c-639d-4d86-b5d9-ffbee3f98e26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d13b088c2c246a2b48ff0ba0abea040',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:15:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:15:34Z,use_quota=True,user_id='65ced55028374aeebbe75386cffaa466',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:15:34 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-93a6dbec-dc87-41d9-8bcc-68e50508f96d tempest-VolumesTransfersTest-2032649736 None] Creating volume ca98e22c-639d-4d86-b5d9-ffbee3f98e26 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:15:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-93a6dbec-dc87-41d9-8bcc-68e50508f96d tempest-VolumesTransfersTest-2032649736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:15:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-93a6dbec-dc87-41d9-8bcc-68e50508f96d tempest-VolumesTransfersTest-2032649736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:15:34 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-93a6dbec-dc87-41d9-8bcc-68e50508f96d tempest-VolumesTransfersTest-2032649736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:15:34 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-93a6dbec-dc87-41d9-8bcc-68e50508f96d tempest-VolumesTransfersTest-2032649736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:15:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-93a6dbec-dc87-41d9-8bcc-68e50508f96d tempest-VolumesTransfersTest-2032649736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:15:34 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-93a6dbec-dc87-41d9-8bcc-68e50508f96d tempest-VolumesTransfersTest-2032649736 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:15:34 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-93a6dbec-dc87-41d9-8bcc-68e50508f96d tempest-VolumesTransfersTest-2032649736 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:15:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-93a6dbec-dc87-41d9-8bcc-68e50508f96d tempest-VolumesTransfersTest-2032649736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ca98e22c-639d-4d86-b5d9-ffbee3f98e26 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:15:34 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-b22b5ad1-e390-439a-8ea3-86cccc984f6a tempest-VolumesDeleteCascade-111846741 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:15:34 devstack sudo[99074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ca98e22c-639d-4d86-b5d9-ffbee3f98e26 1073741824
Jul 03 01:15:34 devstack sudo[99074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:15:34 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[db61474d-6385-4103-bb3b-c8ba9ddd00e1]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:15:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b22b5ad1-e390-439a-8ea3-86cccc984f6a tempest-VolumesDeleteCascade-111846741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe.56d8d3ed-32ef-4af2-bb53-77a2ae2dbdd6 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:15:34 devstack sudo[99076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe.56d8d3ed-32ef-4af2-bb53-77a2ae2dbdd6
Jul 03 01:15:34 devstack sudo[99076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:15:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f962d521-17fd-434e-9f7d-7c3b20b1a71c tempest-VolumesActionsTest-1288723690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:15:35 devstack sudo[99076]: pam_unix(sudo:session): session closed for user root
Jul 03 01:15:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b22b5ad1-e390-439a-8ea3-86cccc984f6a tempest-VolumesDeleteCascade-111846741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe.56d8d3ed-32ef-4af2-bb53-77a2ae2dbdd6" returned: 0 in 0.771s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:15:35 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-b22b5ad1-e390-439a-8ea3-86cccc984f6a tempest-VolumesDeleteCascade-111846741 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:15:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b22b5ad1-e390-439a-8ea3-86cccc984f6a tempest-VolumesDeleteCascade-111846741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe.00c11e32-bbdf-4eff-a3c8-654a736a80ad {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:15:35 devstack sudo[99074]: pam_unix(sudo:session): session closed for user root
Jul 03 01:15:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-93a6dbec-dc87-41d9-8bcc-68e50508f96d tempest-VolumesTransfersTest-2032649736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ca98e22c-639d-4d86-b5d9-ffbee3f98e26 1073741824" returned: 0 in 0.820s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:15:35 devstack sudo[99084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe.00c11e32-bbdf-4eff-a3c8-654a736a80ad
Jul 03 01:15:35 devstack sudo[99084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:15:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-93a6dbec-dc87-41d9-8bcc-68e50508f96d tempest-VolumesTransfersTest-2032649736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ca98e22c-639d-4d86-b5d9-ffbee3f98e26 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:15:35 devstack sudo[99086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ca98e22c-639d-4d86-b5d9-ffbee3f98e26
Jul 03 01:15:35 devstack sudo[99086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:15:35 devstack sudo[99086]: pam_unix(sudo:session): session closed for user root
Jul 03 01:15:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-93a6dbec-dc87-41d9-8bcc-68e50508f96d tempest-VolumesTransfersTest-2032649736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ca98e22c-639d-4d86-b5d9-ffbee3f98e26" returned: 0 in 0.649s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:15:35 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-93a6dbec-dc87-41d9-8bcc-68e50508f96d tempest-VolumesTransfersTest-2032649736 None] <== create_volume: return (1511ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:15:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-93a6dbec-dc87-41d9-8bcc-68e50508f96d tempest-VolumesTransfersTest-2032649736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.514s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:15:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f962d521-17fd-434e-9f7d-7c3b20b1a71c tempest-VolumesActionsTest-1288723690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.308s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:15:35 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-93a6dbec-dc87-41d9-8bcc-68e50508f96d tempest-VolumesTransfersTest-2032649736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff9b1053-8677-45ce-a7cf-dad730c7f1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca98e22c-639d-4d86-b5d9-ffbee3f98e26', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:15:35 devstack sudo[99084]: pam_unix(sudo:session): session closed for user root
Jul 03 01:15:35 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-93a6dbec-dc87-41d9-8bcc-68e50508f96d tempest-VolumesTransfersTest-2032649736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f2e0308-f2ba-466a-9382-4f4ed1413595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:15:35 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d44c26-d901-4ccb-a658-c2b5e05fed26]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:15:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f962d521-17fd-434e-9f7d-7c3b20b1a71c tempest-VolumesActionsTest-1288723690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-48a2c0f1-8c98-4310-87d1-ed911e42f70c {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:15:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b22b5ad1-e390-439a-8ea3-86cccc984f6a tempest-VolumesDeleteCascade-111846741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe.00c11e32-bbdf-4eff-a3c8-654a736a80ad" returned: 0 in 0.744s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:15:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b22b5ad1-e390-439a-8ea3-86cccc984f6a tempest-VolumesDeleteCascade-111846741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe.00c11e32-bbdf-4eff-a3c8-654a736a80ad {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:15:35 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-93a6dbec-dc87-41d9-8bcc-68e50508f96d tempest-VolumesTransfersTest-2032649736 None] Volume volume-ca98e22c-639d-4d86-b5d9-ffbee3f98e26 (ca98e22c-639d-4d86-b5d9-ffbee3f98e26): created successfully
Jul 03 01:15:35 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-93a6dbec-dc87-41d9-8bcc-68e50508f96d tempest-VolumesTransfersTest-2032649736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f2e0308-f2ba-466a-9382-4f4ed1413595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:15:35 devstack sudo[99093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe.00c11e32-bbdf-4eff-a3c8-654a736a80ad
Jul 03 01:15:35 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-93a6dbec-dc87-41d9-8bcc-68e50508f96d tempest-VolumesTransfersTest-2032649736 None] Flow 'volume_create_manager' (9b434a8a-bf21-49d3-84d9-fea306f938c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:15:35 devstack sudo[99093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:15:35 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-93a6dbec-dc87-41d9-8bcc-68e50508f96d tempest-VolumesTransfersTest-2032649736 None] Created volume successfully.
Jul 03 01:15:35 devstack sudo[99092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-48a2c0f1-8c98-4310-87d1-ed911e42f70c
Jul 03 01:15:35 devstack sudo[99092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:15:36 devstack sudo[99093]: pam_unix(sudo:session): session closed for user root
Jul 03 01:15:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b22b5ad1-e390-439a-8ea3-86cccc984f6a tempest-VolumesDeleteCascade-111846741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe.00c11e32-bbdf-4eff-a3c8-654a736a80ad" returned: 0 in 0.729s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:15:36 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-b22b5ad1-e390-439a-8ea3-86cccc984f6a tempest-VolumesDeleteCascade-111846741 None] Lock "cinder-quobyte-00c11e32-bbdf-4eff-a3c8-654a736a80ad" released by "_delete_snapshot" :: held 3.364s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:15:36 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-b22b5ad1-e390-439a-8ea3-86cccc984f6a tempest-VolumesDeleteCascade-111846741 None] Lock "cinder-quobyte-55cc30a9-c75e-4996-8c39-7c1eedda49fe" released by "delete_snapshot" :: held 3.391s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:15:36 devstack sudo[99092]: pam_unix(sudo:session): session closed for user root
Jul 03 01:15:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f962d521-17fd-434e-9f7d-7c3b20b1a71c tempest-VolumesActionsTest-1288723690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-48a2c0f1-8c98-4310-87d1-ed911e42f70c" returned: 0 in 0.797s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:15:36 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51f7c94-0fc9-41ea-9cfe-e7e89f96dd62]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:15:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f962d521-17fd-434e-9f7d-7c3b20b1a71c tempest-VolumesActionsTest-1288723690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-48a2c0f1-8c98-4310-87d1-ed911e42f70c {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:15:36 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-b22b5ad1-e390-439a-8ea3-86cccc984f6a tempest-VolumesDeleteCascade-111846741 None] Created reservations ['135019e3-e24b-4529-82c0-ad01c28b34ef', '77168c4f-3ccc-4e25-907b-208288b54d38', 'c5fb818c-86b0-48cf-8ef7-4f865042cf16', '24868865-44ad-498a-b499-1e438f4a7c33'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:15:36 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-077539e6-5edc-4002-8346-66db84b4a28c tempest-VolumesTransfersTest-550930157 None] Acquiring lock "cinder-ca98e22c-639d-4d86-b5d9-ffbee3f98e26-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:15:36 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-077539e6-5edc-4002-8346-66db84b4a28c tempest-VolumesTransfersTest-550930157 None] Lock "cinder-ca98e22c-639d-4d86-b5d9-ffbee3f98e26-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:15:36 devstack sudo[99101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-48a2c0f1-8c98-4310-87d1-ed911e42f70c
Jul 03 01:15:36 devstack sudo[99101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:15:36 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-b22b5ad1-e390-439a-8ea3-86cccc984f6a tempest-VolumesDeleteCascade-111846741 None] Delete snapshot completed successfully.
Jul 03 01:15:36 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-b22b5ad1-e390-439a-8ea3-86cccc984f6a tempest-VolumesDeleteCascade-111846741 None] Lock "cinder-00c11e32-bbdf-4eff-a3c8-654a736a80ad-delete_snapshot" released by "delete_snapshot" :: held 3.612s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:15:36 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-b22b5ad1-e390-439a-8ea3-86cccc984f6a tempest-VolumesDeleteCascade-111846741 None] Acquiring lock "cinder-56d8d3ed-32ef-4af2-bb53-77a2ae2dbdd6-delete_snapshot" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:15:36 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-077539e6-5edc-4002-8346-66db84b4a28c tempest-VolumesTransfersTest-550930157 None] Acquiring lock "cinder-quobyte-ca98e22c-639d-4d86-b5d9-ffbee3f98e26" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:15:36 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-b22b5ad1-e390-439a-8ea3-86cccc984f6a tempest-VolumesDeleteCascade-111846741 None] Lock "cinder-56d8d3ed-32ef-4af2-bb53-77a2ae2dbdd6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:15:36 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-077539e6-5edc-4002-8346-66db84b4a28c tempest-VolumesTransfersTest-550930157 None] Lock "cinder-quobyte-ca98e22c-639d-4d86-b5d9-ffbee3f98e26" acquired by "delete_volume" :: waited 0.023s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:15:36 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-b22b5ad1-e390-439a-8ea3-86cccc984f6a tempest-VolumesDeleteCascade-111846741 None] Acquiring lock "cinder-quobyte-55cc30a9-c75e-4996-8c39-7c1eedda49fe" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:15:36 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[c045c644-ef43-4d11-a6af-14bc2211c811]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:15:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-077539e6-5edc-4002-8346-66db84b4a28c tempest-VolumesTransfersTest-550930157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ca98e22c-639d-4d86-b5d9-ffbee3f98e26 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:15:36 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-b22b5ad1-e390-439a-8ea3-86cccc984f6a tempest-VolumesDeleteCascade-111846741 None] Lock "cinder-quobyte-55cc30a9-c75e-4996-8c39-7c1eedda49fe" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:15:36 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-b22b5ad1-e390-439a-8ea3-86cccc984f6a tempest-VolumesDeleteCascade-111846741 None] Acquiring lock "cinder-quobyte-56d8d3ed-32ef-4af2-bb53-77a2ae2dbdd6" by "_delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:15:36 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-b22b5ad1-e390-439a-8ea3-86cccc984f6a tempest-VolumesDeleteCascade-111846741 None] Lock "cinder-quobyte-56d8d3ed-32ef-4af2-bb53-77a2ae2dbdd6" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:15:36 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-b22b5ad1-e390-439a-8ea3-86cccc984f6a tempest-VolumesDeleteCascade-111846741 None] Deleting offline snapshot 56d8d3ed-32ef-4af2-bb53-77a2ae2dbdd6 of volume 55cc30a9-c75e-4996-8c39-7c1eedda49fe {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 01:15:36 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-b22b5ad1-e390-439a-8ea3-86cccc984f6a tempest-VolumesDeleteCascade-111846741 None] snapshot_file for this snap is: volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe.56d8d3ed-32ef-4af2-bb53-77a2ae2dbdd6 {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 01:15:36 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa233e01-46f7-43cc-8a3d-80d3177c3cb1]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:15:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b22b5ad1-e390-439a-8ea3-86cccc984f6a tempest-VolumesDeleteCascade-111846741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe.56d8d3ed-32ef-4af2-bb53-77a2ae2dbdd6 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:15:37 devstack sudo[99103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ca98e22c-639d-4d86-b5d9-ffbee3f98e26
Jul 03 01:15:37 devstack sudo[99103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:15:37 devstack sudo[99104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe.56d8d3ed-32ef-4af2-bb53-77a2ae2dbdd6
Jul 03 01:15:37 devstack sudo[99104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:15:37 devstack sudo[99101]: pam_unix(sudo:session): session closed for user root
Jul 03 01:15:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f962d521-17fd-434e-9f7d-7c3b20b1a71c tempest-VolumesActionsTest-1288723690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-48a2c0f1-8c98-4310-87d1-ed911e42f70c" returned: 0 in 0.828s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:15:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f962d521-17fd-434e-9f7d-7c3b20b1a71c tempest-VolumesActionsTest-1288723690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-48a2c0f1-8c98-4310-87d1-ed911e42f70c /opt/stack/data/cinder/conversion/48a2c0f1-8c98-4310-87d1-ed911e42f70c.temp_image.ac51b136-bb94-42ab-a670-86ea41d7bd189ilqd0nj.img {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:15:37 devstack sudo[99110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-48a2c0f1-8c98-4310-87d1-ed911e42f70c /opt/stack/data/cinder/conversion/48a2c0f1-8c98-4310-87d1-ed911e42f70c.temp_image.ac51b136-bb94-42ab-a670-86ea41d7bd189ilqd0nj.img
Jul 03 01:15:37 devstack sudo[99110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:15:37 devstack sudo[99103]: pam_unix(sudo:session): session closed for user root
Jul 03 01:15:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-077539e6-5edc-4002-8346-66db84b4a28c tempest-VolumesTransfersTest-550930157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ca98e22c-639d-4d86-b5d9-ffbee3f98e26" returned: 0 in 0.792s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:15:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-077539e6-5edc-4002-8346-66db84b4a28c tempest-VolumesTransfersTest-550930157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ca98e22c-639d-4d86-b5d9-ffbee3f98e26 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:15:37 devstack sudo[99119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ca98e22c-639d-4d86-b5d9-ffbee3f98e26
Jul 03 01:15:37 devstack sudo[99119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:15:37 devstack sudo[99104]: pam_unix(sudo:session): session closed for user root
Jul 03 01:15:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b22b5ad1-e390-439a-8ea3-86cccc984f6a tempest-VolumesDeleteCascade-111846741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe.56d8d3ed-32ef-4af2-bb53-77a2ae2dbdd6" returned: 0 in 0.816s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:15:37 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-b22b5ad1-e390-439a-8ea3-86cccc984f6a tempest-VolumesDeleteCascade-111846741 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:15:37 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[8beae33e-f2af-46bd-a5f6-db0acc38265a]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:15:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b22b5ad1-e390-439a-8ea3-86cccc984f6a tempest-VolumesDeleteCascade-111846741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:15:37 devstack sudo[99121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe
Jul 03 01:15:37 devstack sudo[99121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:15:38 devstack sudo[99119]: pam_unix(sudo:session): session closed for user root
Jul 03 01:15:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-077539e6-5edc-4002-8346-66db84b4a28c tempest-VolumesTransfersTest-550930157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ca98e22c-639d-4d86-b5d9-ffbee3f98e26" returned: 0 in 0.998s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:15:38 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-077539e6-5edc-4002-8346-66db84b4a28c tempest-VolumesTransfersTest-550930157 None] Lock "cinder-quobyte-ca98e22c-639d-4d86-b5d9-ffbee3f98e26" released by "delete_volume" :: held 1.863s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:15:38 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-077539e6-5edc-4002-8346-66db84b4a28c tempest-VolumesTransfersTest-550930157 None] Created reservations ['f3294276-25e1-4c71-9918-432f45b996fb', 'b80176cd-0c8e-459d-9900-e7b2165d16d2', '190775a1-de0c-4696-937f-ae560c2f5f8f', 'fe5737bb-8fba-455a-a868-68ddc11ac06c'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:15:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-077539e6-5edc-4002-8346-66db84b4a28c tempest-VolumesTransfersTest-550930157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:15:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-077539e6-5edc-4002-8346-66db84b4a28c tempest-VolumesTransfersTest-550930157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:15:38 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-077539e6-5edc-4002-8346-66db84b4a28c tempest-VolumesTransfersTest-550930157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:15:39 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-077539e6-5edc-4002-8346-66db84b4a28c tempest-VolumesTransfersTest-550930157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:15:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-077539e6-5edc-4002-8346-66db84b4a28c tempest-VolumesTransfersTest-550930157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:15:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-077539e6-5edc-4002-8346-66db84b4a28c tempest-VolumesTransfersTest-550930157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:15:39 devstack sudo[99135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:15:39 devstack sudo[99135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:15:39 devstack sudo[99121]: pam_unix(sudo:session): session closed for user root
Jul 03 01:15:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b22b5ad1-e390-439a-8ea3-86cccc984f6a tempest-VolumesDeleteCascade-111846741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe" returned: 0 in 1.862s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:15:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b22b5ad1-e390-439a-8ea3-86cccc984f6a tempest-VolumesDeleteCascade-111846741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe.56d8d3ed-32ef-4af2-bb53-77a2ae2dbdd6 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:15:39 devstack sudo[99143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe.56d8d3ed-32ef-4af2-bb53-77a2ae2dbdd6
Jul 03 01:15:39 devstack sudo[99143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:15:40 devstack sudo[99135]: pam_unix(sudo:session): session closed for user root
Jul 03 01:15:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-077539e6-5edc-4002-8346-66db84b4a28c tempest-VolumesTransfersTest-550930157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 1.903s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:15:40 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-077539e6-5edc-4002-8346-66db84b4a28c tempest-VolumesTransfersTest-550930157 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:15:40 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-077539e6-5edc-4002-8346-66db84b4a28c tempest-VolumesTransfersTest-550930157 None] Deleted volume successfully.
Jul 03 01:15:41 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-077539e6-5edc-4002-8346-66db84b4a28c tempest-VolumesTransfersTest-550930157 None] Lock "cinder-ca98e22c-639d-4d86-b5d9-ffbee3f98e26-delete_volume" released by "delete_volume" :: held 4.199s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:15:41 devstack sudo[99143]: pam_unix(sudo:session): session closed for user root
Jul 03 01:15:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b22b5ad1-e390-439a-8ea3-86cccc984f6a tempest-VolumesDeleteCascade-111846741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe.56d8d3ed-32ef-4af2-bb53-77a2ae2dbdd6" returned: 0 in 1.862s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:15:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b22b5ad1-e390-439a-8ea3-86cccc984f6a tempest-VolumesDeleteCascade-111846741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe.56d8d3ed-32ef-4af2-bb53-77a2ae2dbdd6 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:15:41 devstack sudo[99154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe.56d8d3ed-32ef-4af2-bb53-77a2ae2dbdd6
Jul 03 01:15:41 devstack sudo[99154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:15:42 devstack sudo[99154]: pam_unix(sudo:session): session closed for user root
Jul 03 01:15:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b22b5ad1-e390-439a-8ea3-86cccc984f6a tempest-VolumesDeleteCascade-111846741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe.56d8d3ed-32ef-4af2-bb53-77a2ae2dbdd6" returned: 0 in 1.423s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:15:43 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-b22b5ad1-e390-439a-8ea3-86cccc984f6a tempest-VolumesDeleteCascade-111846741 None] Lock "cinder-quobyte-56d8d3ed-32ef-4af2-bb53-77a2ae2dbdd6" released by "_delete_snapshot" :: held 6.069s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:15:43 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-b22b5ad1-e390-439a-8ea3-86cccc984f6a tempest-VolumesDeleteCascade-111846741 None] Lock "cinder-quobyte-55cc30a9-c75e-4996-8c39-7c1eedda49fe" released by "delete_snapshot" :: held 6.092s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:15:43 devstack sudo[99110]: pam_unix(sudo:session): session closed for user root
Jul 03 01:15:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f962d521-17fd-434e-9f7d-7c3b20b1a71c tempest-VolumesActionsTest-1288723690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-48a2c0f1-8c98-4310-87d1-ed911e42f70c /opt/stack/data/cinder/conversion/48a2c0f1-8c98-4310-87d1-ed911e42f70c.temp_image.ac51b136-bb94-42ab-a670-86ea41d7bd189ilqd0nj.img" returned: 0 in 5.533s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:15:43 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e73af5-46c5-4acb-b5b9-5db46d2a1c18]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:15:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f962d521-17fd-434e-9f7d-7c3b20b1a71c tempest-VolumesActionsTest-1288723690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-48a2c0f1-8c98-4310-87d1-ed911e42f70c {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:15:43 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-b22b5ad1-e390-439a-8ea3-86cccc984f6a tempest-VolumesDeleteCascade-111846741 None] Created reservations ['5661973d-c1e2-4193-a939-609904247389', 'fc3bf443-acb3-4e9c-b882-08d8e14962f2', '6a37f578-afa3-44ac-b68d-43e17398e2f7', '5f5038ac-a240-4239-a792-c4614930092b'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:15:43 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-b22b5ad1-e390-439a-8ea3-86cccc984f6a tempest-VolumesDeleteCascade-111846741 None] Delete snapshot completed successfully.
Jul 03 01:15:43 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-b22b5ad1-e390-439a-8ea3-86cccc984f6a tempest-VolumesDeleteCascade-111846741 None] Lock "cinder-56d8d3ed-32ef-4af2-bb53-77a2ae2dbdd6-delete_snapshot" released by "delete_snapshot" :: held 6.289s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:15:43 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b22b5ad1-e390-439a-8ea3-86cccc984f6a tempest-VolumesDeleteCascade-111846741 None] Snapshots deleted, issuing volume delete {{(pid=86891) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Jul 03 01:15:43 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-b22b5ad1-e390-439a-8ea3-86cccc984f6a tempest-VolumesDeleteCascade-111846741 None] Acquiring lock "cinder-quobyte-55cc30a9-c75e-4996-8c39-7c1eedda49fe" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:15:43 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-b22b5ad1-e390-439a-8ea3-86cccc984f6a tempest-VolumesDeleteCascade-111846741 None] Lock "cinder-quobyte-55cc30a9-c75e-4996-8c39-7c1eedda49fe" acquired by "delete_volume" :: waited 0.014s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:15:43 devstack sudo[99157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-48a2c0f1-8c98-4310-87d1-ed911e42f70c
Jul 03 01:15:43 devstack sudo[99157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:15:43 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[494c4dc1-653f-4331-b64d-1e2f7cfb1c93]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:15:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b22b5ad1-e390-439a-8ea3-86cccc984f6a tempest-VolumesDeleteCascade-111846741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:15:43 devstack sudo[99159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe
Jul 03 01:15:43 devstack sudo[99159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:15:44 devstack sudo[99159]: pam_unix(sudo:session): session closed for user root
Jul 03 01:15:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b22b5ad1-e390-439a-8ea3-86cccc984f6a tempest-VolumesDeleteCascade-111846741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe" returned: 0 in 0.834s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:15:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b22b5ad1-e390-439a-8ea3-86cccc984f6a tempest-VolumesDeleteCascade-111846741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:15:44 devstack sudo[99167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe
Jul 03 01:15:44 devstack sudo[99167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:15:44 devstack sudo[99157]: pam_unix(sudo:session): session closed for user root
Jul 03 01:15:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f962d521-17fd-434e-9f7d-7c3b20b1a71c tempest-VolumesActionsTest-1288723690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-48a2c0f1-8c98-4310-87d1-ed911e42f70c" returned: 0 in 1.095s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:15:44 devstack cinder-volume[86891]: DEBUG cinder.image.image_utils [None req-f962d521-17fd-434e-9f7d-7c3b20b1a71c tempest-VolumesActionsTest-1288723690 None] Image conversion details: src /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-48a2c0f1-8c98-4310-87d1-ed911e42f70c, size 1024.00 MB, duration 5.53 sec, destination /opt/stack/data/cinder/conversion/48a2c0f1-8c98-4310-87d1-ed911e42f70c.temp_image.ac51b136-bb94-42ab-a670-86ea41d7bd189ilqd0nj.img {{(pid=86891) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 03 01:15:44 devstack cinder-volume[86891]: INFO cinder.image.image_utils [None req-f962d521-17fd-434e-9f7d-7c3b20b1a71c tempest-VolumesActionsTest-1288723690 None] Converted 1024.00 MB image at 185.04 MB/s
Jul 03 01:15:44 devstack cinder-volume[86891]: DEBUG cinder.image.image_utils [None req-f962d521-17fd-434e-9f7d-7c3b20b1a71c tempest-VolumesActionsTest-1288723690 None] ac51b136-bb94-42ab-a670-86ea41d7bd18 was raw, no need to convert to raw {{(pid=86891) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}}
Jul 03 01:15:44 devstack sudo[99167]: pam_unix(sudo:session): session closed for user root
Jul 03 01:15:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b22b5ad1-e390-439a-8ea3-86cccc984f6a tempest-VolumesDeleteCascade-111846741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-55cc30a9-c75e-4996-8c39-7c1eedda49fe" returned: 0 in 0.708s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:15:44 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-b22b5ad1-e390-439a-8ea3-86cccc984f6a tempest-VolumesDeleteCascade-111846741 None] Lock "cinder-quobyte-55cc30a9-c75e-4996-8c39-7c1eedda49fe" released by "delete_volume" :: held 1.633s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:15:44 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-b22b5ad1-e390-439a-8ea3-86cccc984f6a tempest-VolumesDeleteCascade-111846741 None] Created reservations ['303b1297-fd55-460f-a56a-73288a911b35', '39c126ce-51d1-410a-be5d-6983170c8c10', '95410e9a-0413-4256-81f1-daa6722506ed', '639aeb16-5996-473d-a3e0-7e77e6628c4e'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:15:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b22b5ad1-e390-439a-8ea3-86cccc984f6a tempest-VolumesDeleteCascade-111846741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:15:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b22b5ad1-e390-439a-8ea3-86cccc984f6a tempest-VolumesDeleteCascade-111846741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:15:44 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-b22b5ad1-e390-439a-8ea3-86cccc984f6a tempest-VolumesDeleteCascade-111846741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:15:44 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-b22b5ad1-e390-439a-8ea3-86cccc984f6a tempest-VolumesDeleteCascade-111846741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:15:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b22b5ad1-e390-439a-8ea3-86cccc984f6a tempest-VolumesDeleteCascade-111846741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:15:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b22b5ad1-e390-439a-8ea3-86cccc984f6a tempest-VolumesDeleteCascade-111846741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:15:44 devstack sudo[99170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:15:44 devstack sudo[99170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:15:45 devstack sudo[99170]: pam_unix(sudo:session): session closed for user root
Jul 03 01:15:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b22b5ad1-e390-439a-8ea3-86cccc984f6a tempest-VolumesDeleteCascade-111846741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.722s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:15:45 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-b22b5ad1-e390-439a-8ea3-86cccc984f6a tempest-VolumesDeleteCascade-111846741 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:15:45 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-b22b5ad1-e390-439a-8ea3-86cccc984f6a tempest-VolumesDeleteCascade-111846741 None] Deleted volume successfully.
Jul 03 01:15:45 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-b22b5ad1-e390-439a-8ea3-86cccc984f6a tempest-VolumesDeleteCascade-111846741 None] Lock "cinder-55cc30a9-c75e-4996-8c39-7c1eedda49fe-delete_volume" released by "delete_volume" :: held 12.569s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:15:46 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-a702b89e-2c41-4d64-8875-0b292c935aec tempest-VolumesDeleteCascade-111846741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:15:46 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a702b89e-2c41-4d64-8875-0b292c935aec tempest-VolumesDeleteCascade-111846741 None] Flow 'volume_create_manager' (24d5e0fc-e7ec-4b21-990a-95001f18cdc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:15:46 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a702b89e-2c41-4d64-8875-0b292c935aec tempest-VolumesDeleteCascade-111846741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (541f2216-4bed-4606-8527-a1a8a274ec96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:15:46 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a702b89e-2c41-4d64-8875-0b292c935aec tempest-VolumesDeleteCascade-111846741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (541f2216-4bed-4606-8527-a1a8a274ec96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:15:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2120180846',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ede261e-0fc2-4a29-8dec-5f13fd406565,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c26c8b32ff104dc9b16a548011440c55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:15:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:15:46Z,use_quota=True,user_id='7a974c46b5264104ba1adca50c161965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:15:46 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a702b89e-2c41-4d64-8875-0b292c935aec tempest-VolumesDeleteCascade-111846741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9707070b-6d31-49a0-aa7a-c1b22c7bc14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:15:46 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a702b89e-2c41-4d64-8875-0b292c935aec tempest-VolumesDeleteCascade-111846741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9707070b-6d31-49a0-aa7a-c1b22c7bc14d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:15:46 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a702b89e-2c41-4d64-8875-0b292c935aec tempest-VolumesDeleteCascade-111846741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cafdf10d-6c5d-4774-b5ae-21d994ca052b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:15:46 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a702b89e-2c41-4d64-8875-0b292c935aec tempest-VolumesDeleteCascade-111846741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cafdf10d-6c5d-4774-b5ae-21d994ca052b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ede261e-0fc2-4a29-8dec-5f13fd406565', 'volume_name': 'volume-4ede261e-0fc2-4a29-8dec-5f13fd406565', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:15:46 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a702b89e-2c41-4d64-8875-0b292c935aec tempest-VolumesDeleteCascade-111846741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50763c0b-9a53-4754-85da-c33882f0c6d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:15:46 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a702b89e-2c41-4d64-8875-0b292c935aec tempest-VolumesDeleteCascade-111846741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50763c0b-9a53-4754-85da-c33882f0c6d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:15:46 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a702b89e-2c41-4d64-8875-0b292c935aec tempest-VolumesDeleteCascade-111846741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (227df859-746e-40b6-bfeb-9ebc9b60eed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:15:46 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-a702b89e-2c41-4d64-8875-0b292c935aec tempest-VolumesDeleteCascade-111846741 None] Volume 4ede261e-0fc2-4a29-8dec-5f13fd406565: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ede261e-0fc2-4a29-8dec-5f13fd406565', 'volume_size': 1}
Jul 03 01:15:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a702b89e-2c41-4d64-8875-0b292c935aec tempest-VolumesDeleteCascade-111846741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:15:49 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-a23cdfec-be4b-47e6-9fd5-a5005bcf11d1 tempest-VolumesTransfersV357Test-897181408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:15:49 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a23cdfec-be4b-47e6-9fd5-a5005bcf11d1 tempest-VolumesTransfersV357Test-897181408 None] Flow 'volume_create_manager' (1bbcdb22-6c70-411c-8952-6743412f88b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:15:49 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a23cdfec-be4b-47e6-9fd5-a5005bcf11d1 tempest-VolumesTransfersV357Test-897181408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74aceab5-a7fd-48e0-98cc-833c9da18604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:15:49 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a23cdfec-be4b-47e6-9fd5-a5005bcf11d1 tempest-VolumesTransfersV357Test-897181408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74aceab5-a7fd-48e0-98cc-833c9da18604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-347818354',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eacdecab-34e5-45f8-a416-05933058ab75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6710b0bec86f45eb82a0af8d94aa3ac2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:15:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:15:49Z,use_quota=True,user_id='2cea558ed3454b5f810b8ac2e1354edc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:15:49 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a23cdfec-be4b-47e6-9fd5-a5005bcf11d1 tempest-VolumesTransfersV357Test-897181408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acbc9142-f6cf-413b-9538-8636be641ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:15:49 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a23cdfec-be4b-47e6-9fd5-a5005bcf11d1 tempest-VolumesTransfersV357Test-897181408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acbc9142-f6cf-413b-9538-8636be641ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:15:49 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a23cdfec-be4b-47e6-9fd5-a5005bcf11d1 tempest-VolumesTransfersV357Test-897181408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77da80cd-f2fc-46bf-bc98-8fb603f4e3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:15:49 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a23cdfec-be4b-47e6-9fd5-a5005bcf11d1 tempest-VolumesTransfersV357Test-897181408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77da80cd-f2fc-46bf-bc98-8fb603f4e3ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eacdecab-34e5-45f8-a416-05933058ab75', 'volume_name': 'volume-eacdecab-34e5-45f8-a416-05933058ab75', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:15:49 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a23cdfec-be4b-47e6-9fd5-a5005bcf11d1 tempest-VolumesTransfersV357Test-897181408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee504d98-6eb1-4533-8023-a2f96ad111da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:15:49 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a23cdfec-be4b-47e6-9fd5-a5005bcf11d1 tempest-VolumesTransfersV357Test-897181408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee504d98-6eb1-4533-8023-a2f96ad111da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:15:49 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a23cdfec-be4b-47e6-9fd5-a5005bcf11d1 tempest-VolumesTransfersV357Test-897181408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2939b1e2-bd40-48ce-b499-9f59639186f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:15:49 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-a23cdfec-be4b-47e6-9fd5-a5005bcf11d1 tempest-VolumesTransfersV357Test-897181408 None] Volume eacdecab-34e5-45f8-a416-05933058ab75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eacdecab-34e5-45f8-a416-05933058ab75', 'volume_size': 1}
Jul 03 01:15:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a23cdfec-be4b-47e6-9fd5-a5005bcf11d1 tempest-VolumesTransfersV357Test-897181408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:15:59 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:UPDATE=103,cinder:SELECT=80,cinder:INSERT=27,cinder:DELETE=7 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:15:59 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:UPDATE=80,cinder:DELETE=7,cinder:SELECT=94,cinder:INSERT=32 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:16:01 devstack cinder-volume[86891]: DEBUG oslo_service.periodic_task [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86891) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 01:16:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:16:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:16:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:16:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:16:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:16:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:01 devstack sudo[99175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:16:01 devstack sudo[99175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:02 devstack sudo[99175]: pam_unix(sudo:session): session closed for user root
Jul 03 01:16:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.625s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:16:02 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:16:02 devstack cinder-volume[86891]: DEBUG oslo_service.periodic_task [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running periodic task VolumeManager._thread_info {{(pid=86891) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 01:16:02 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] thread count: 28 {{(pid=86891) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 01:16:02 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] thread info: [<_MainThread(MainThread, started 136731296534656)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136731184953280)>, <Thread(Thread-3 (stat_writer), started daemon 136731184058816)>, <Thread(Rabbit-heartbeat, started daemon 136731184846080)>, <Thread(Thread-5 (_runner), started daemon 136731182936576)>, <Thread(Thread-7 (_runner), started daemon 136731182954944)>, <Thread(fd_logger, started daemon 136731181916416)>, <Thread(privsep_reader, started daemon 136731180942208)>, <Thread(tpool_thread_0, started daemon 136731172161216)>, <Thread(tpool_thread_1, started daemon 136731163768512)>, <Thread(tpool_thread_2, started daemon 136731155375808)>, <Thread(tpool_thread_3, started daemon 136731146983104)>, <Thread(tpool_thread_4, started daemon 136731138590400)>, <Thread(tpool_thread_5, started daemon 136731130197696)>, <Thread(tpool_thread_6, started daemon 136731121804992)>, <Thread(tpool_thread_7, started daemon 136731113412288)>, <Thread(tpool_thread_8, started daemon 136731105003200)>, <Thread(tpool_thread_9, started daemon 136731096594112)>, <Thread(tpool_thread_10, started daemon 136731088185024)>, <Thread(tpool_thread_11, started daemon 136731079775936)>, <Thread(tpool_thread_12, started daemon 136731071366848)>, <Thread(tpool_thread_13, started daemon 136731062957760)>, <Thread(tpool_thread_14, started daemon 136731054548672)>, <Thread(tpool_thread_15, started daemon 136731046139584)>, <Thread(tpool_thread_16, started daemon 136731037730496)>, <Thread(tpool_thread_17, started daemon 136731029321408)>, <Thread(tpool_thread_18, started daemon 136731020912320)>, <Thread(tpool_thread_19, started daemon 136731012503232)>] {{(pid=86891) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 01:16:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f962d521-17fd-434e-9f7d-7c3b20b1a71c tempest-VolumesActionsTest-1288723690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.699s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:16:04 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f962d521-17fd-434e-9f7d-7c3b20b1a71c tempest-VolumesActionsTest-1288723690 None] Uploaded volume to glance image-id: ac51b136-bb94-42ab-a670-86ea41d7bd18. {{(pid=86891) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Jul 03 01:16:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a702b89e-2c41-4d64-8875-0b292c935aec tempest-VolumesDeleteCascade-111846741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.101s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:16:04 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-a702b89e-2c41-4d64-8875-0b292c935aec tempest-VolumesDeleteCascade-111846741 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:15:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2120180846',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ede261e-0fc2-4a29-8dec-5f13fd406565,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c26c8b32ff104dc9b16a548011440c55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:15:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:15:46Z,use_quota=True,user_id='7a974c46b5264104ba1adca50c161965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:16:04 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-a702b89e-2c41-4d64-8875-0b292c935aec tempest-VolumesDeleteCascade-111846741 None] Creating volume 4ede261e-0fc2-4a29-8dec-5f13fd406565 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:16:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a702b89e-2c41-4d64-8875-0b292c935aec tempest-VolumesDeleteCascade-111846741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:16:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a702b89e-2c41-4d64-8875-0b292c935aec tempest-VolumesDeleteCascade-111846741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:16:04 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-a702b89e-2c41-4d64-8875-0b292c935aec tempest-VolumesDeleteCascade-111846741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:16:04 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-a702b89e-2c41-4d64-8875-0b292c935aec tempest-VolumesDeleteCascade-111846741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:16:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a702b89e-2c41-4d64-8875-0b292c935aec tempest-VolumesDeleteCascade-111846741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:16:04 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-a702b89e-2c41-4d64-8875-0b292c935aec tempest-VolumesDeleteCascade-111846741 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:16:04 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-a702b89e-2c41-4d64-8875-0b292c935aec tempest-VolumesDeleteCascade-111846741 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:16:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a702b89e-2c41-4d64-8875-0b292c935aec tempest-VolumesDeleteCascade-111846741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4ede261e-0fc2-4a29-8dec-5f13fd406565 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:04 devstack sudo[99178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4ede261e-0fc2-4a29-8dec-5f13fd406565 1073741824
Jul 03 01:16:04 devstack sudo[99178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:04 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-f962d521-17fd-434e-9f7d-7c3b20b1a71c tempest-VolumesActionsTest-1288723690 None] Copy volume to image completed successfully.
Jul 03 01:16:05 devstack sudo[99178]: pam_unix(sudo:session): session closed for user root
Jul 03 01:16:05 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a702b89e-2c41-4d64-8875-0b292c935aec tempest-VolumesDeleteCascade-111846741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4ede261e-0fc2-4a29-8dec-5f13fd406565 1073741824" returned: 0 in 0.879s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:16:05 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a702b89e-2c41-4d64-8875-0b292c935aec tempest-VolumesDeleteCascade-111846741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4ede261e-0fc2-4a29-8dec-5f13fd406565 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:05 devstack sudo[99184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4ede261e-0fc2-4a29-8dec-5f13fd406565
Jul 03 01:16:05 devstack sudo[99184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:05 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-8560a0ce-6712-488b-adc0-59a2bfcffc77 tempest-VolumesActionsTest-1288723690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:16:06 devstack sudo[99184]: pam_unix(sudo:session): session closed for user root
Jul 03 01:16:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a702b89e-2c41-4d64-8875-0b292c935aec tempest-VolumesDeleteCascade-111846741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4ede261e-0fc2-4a29-8dec-5f13fd406565" returned: 0 in 0.641s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:16:06 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-a702b89e-2c41-4d64-8875-0b292c935aec tempest-VolumesDeleteCascade-111846741 None] <== create_volume: return (1559ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:16:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a702b89e-2c41-4d64-8875-0b292c935aec tempest-VolumesDeleteCascade-111846741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.562s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:16:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a23cdfec-be4b-47e6-9fd5-a5005bcf11d1 tempest-VolumesTransfersV357Test-897181408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.785s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:16:06 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-a23cdfec-be4b-47e6-9fd5-a5005bcf11d1 tempest-VolumesTransfersV357Test-897181408 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-347818354',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eacdecab-34e5-45f8-a416-05933058ab75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6710b0bec86f45eb82a0af8d94aa3ac2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:15:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:15:49Z,use_quota=True,user_id='2cea558ed3454b5f810b8ac2e1354edc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:16:06 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-a23cdfec-be4b-47e6-9fd5-a5005bcf11d1 tempest-VolumesTransfersV357Test-897181408 None] Creating volume eacdecab-34e5-45f8-a416-05933058ab75 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:16:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a23cdfec-be4b-47e6-9fd5-a5005bcf11d1 tempest-VolumesTransfersV357Test-897181408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:16:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a23cdfec-be4b-47e6-9fd5-a5005bcf11d1 tempest-VolumesTransfersV357Test-897181408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:16:06 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-a23cdfec-be4b-47e6-9fd5-a5005bcf11d1 tempest-VolumesTransfersV357Test-897181408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:16:06 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-a23cdfec-be4b-47e6-9fd5-a5005bcf11d1 tempest-VolumesTransfersV357Test-897181408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:16:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a23cdfec-be4b-47e6-9fd5-a5005bcf11d1 tempest-VolumesTransfersV357Test-897181408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:16:06 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-a23cdfec-be4b-47e6-9fd5-a5005bcf11d1 tempest-VolumesTransfersV357Test-897181408 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:16:06 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-a23cdfec-be4b-47e6-9fd5-a5005bcf11d1 tempest-VolumesTransfersV357Test-897181408 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:16:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a23cdfec-be4b-47e6-9fd5-a5005bcf11d1 tempest-VolumesTransfersV357Test-897181408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-eacdecab-34e5-45f8-a416-05933058ab75 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:06 devstack sudo[99189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-eacdecab-34e5-45f8-a416-05933058ab75 1073741824
Jul 03 01:16:06 devstack sudo[99189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:06 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a702b89e-2c41-4d64-8875-0b292c935aec tempest-VolumesDeleteCascade-111846741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (227df859-746e-40b6-bfeb-9ebc9b60eed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ede261e-0fc2-4a29-8dec-5f13fd406565', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:16:06 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a702b89e-2c41-4d64-8875-0b292c935aec tempest-VolumesDeleteCascade-111846741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ec18316-46c5-4f05-ba94-2f75d33b93d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:16:06 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-a702b89e-2c41-4d64-8875-0b292c935aec tempest-VolumesDeleteCascade-111846741 None] Volume volume-4ede261e-0fc2-4a29-8dec-5f13fd406565 (4ede261e-0fc2-4a29-8dec-5f13fd406565): created successfully
Jul 03 01:16:06 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a702b89e-2c41-4d64-8875-0b292c935aec tempest-VolumesDeleteCascade-111846741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ec18316-46c5-4f05-ba94-2f75d33b93d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:16:06 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a702b89e-2c41-4d64-8875-0b292c935aec tempest-VolumesDeleteCascade-111846741 None] Flow 'volume_create_manager' (24d5e0fc-e7ec-4b21-990a-95001f18cdc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:16:06 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-a702b89e-2c41-4d64-8875-0b292c935aec tempest-VolumesDeleteCascade-111846741 None] Created volume successfully.
Jul 03 01:16:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1e21885b-739a-4477-8591-35ce8e6dffff tempest-VolumesDeleteCascade-111846741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:16:06 devstack sudo[99189]: pam_unix(sudo:session): session closed for user root
Jul 03 01:16:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a23cdfec-be4b-47e6-9fd5-a5005bcf11d1 tempest-VolumesTransfersV357Test-897181408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-eacdecab-34e5-45f8-a416-05933058ab75 1073741824" returned: 0 in 0.802s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:16:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a23cdfec-be4b-47e6-9fd5-a5005bcf11d1 tempest-VolumesTransfersV357Test-897181408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-eacdecab-34e5-45f8-a416-05933058ab75 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:06 devstack sudo[99195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-eacdecab-34e5-45f8-a416-05933058ab75
Jul 03 01:16:06 devstack sudo[99195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:07 devstack sudo[99195]: pam_unix(sudo:session): session closed for user root
Jul 03 01:16:07 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a23cdfec-be4b-47e6-9fd5-a5005bcf11d1 tempest-VolumesTransfersV357Test-897181408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-eacdecab-34e5-45f8-a416-05933058ab75" returned: 0 in 0.625s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:16:07 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-a23cdfec-be4b-47e6-9fd5-a5005bcf11d1 tempest-VolumesTransfersV357Test-897181408 None] <== create_volume: return (1463ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:16:07 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a23cdfec-be4b-47e6-9fd5-a5005bcf11d1 tempest-VolumesTransfersV357Test-897181408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.466s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:16:07 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-8560a0ce-6712-488b-adc0-59a2bfcffc77 tempest-VolumesActionsTest-1288723690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.963s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:16:07 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a23cdfec-be4b-47e6-9fd5-a5005bcf11d1 tempest-VolumesTransfersV357Test-897181408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2939b1e2-bd40-48ce-b499-9f59639186f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eacdecab-34e5-45f8-a416-05933058ab75', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:16:07 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a23cdfec-be4b-47e6-9fd5-a5005bcf11d1 tempest-VolumesTransfersV357Test-897181408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0262b6ca-0d55-411f-ad3d-713b594c2283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:16:07 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1bfc9ae-23eb-40b5-bd0a-b4d62ebd4eb8]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:16:07 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8560a0ce-6712-488b-adc0-59a2bfcffc77 tempest-VolumesActionsTest-1288723690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-48a2c0f1-8c98-4310-87d1-ed911e42f70c {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:07 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-a23cdfec-be4b-47e6-9fd5-a5005bcf11d1 tempest-VolumesTransfersV357Test-897181408 None] Volume volume-eacdecab-34e5-45f8-a416-05933058ab75 (eacdecab-34e5-45f8-a416-05933058ab75): created successfully
Jul 03 01:16:07 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a23cdfec-be4b-47e6-9fd5-a5005bcf11d1 tempest-VolumesTransfersV357Test-897181408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0262b6ca-0d55-411f-ad3d-713b594c2283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:16:07 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a23cdfec-be4b-47e6-9fd5-a5005bcf11d1 tempest-VolumesTransfersV357Test-897181408 None] Flow 'volume_create_manager' (1bbcdb22-6c70-411c-8952-6743412f88b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:16:07 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-a23cdfec-be4b-47e6-9fd5-a5005bcf11d1 tempest-VolumesTransfersV357Test-897181408 None] Created volume successfully.
Jul 03 01:16:07 devstack sudo[99198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-48a2c0f1-8c98-4310-87d1-ed911e42f70c
Jul 03 01:16:07 devstack sudo[99198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:08 devstack sudo[99198]: pam_unix(sudo:session): session closed for user root
Jul 03 01:16:08 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8560a0ce-6712-488b-adc0-59a2bfcffc77 tempest-VolumesActionsTest-1288723690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-48a2c0f1-8c98-4310-87d1-ed911e42f70c" returned: 0 in 0.780s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:16:08 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[6437bcda-1eea-4cac-9c81-660e4816a4b2]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:16:08 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8560a0ce-6712-488b-adc0-59a2bfcffc77 tempest-VolumesActionsTest-1288723690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-48a2c0f1-8c98-4310-87d1-ed911e42f70c {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:08 devstack sudo[99204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-48a2c0f1-8c98-4310-87d1-ed911e42f70c
Jul 03 01:16:08 devstack sudo[99204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:08 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-7f34f1e3-6d6b-4827-9d14-bd32894c910f tempest-VolumesTransfersV357Test-1596655635 None] Transfer volume completed successfully.
Jul 03 01:16:09 devstack sudo[99204]: pam_unix(sudo:session): session closed for user root
Jul 03 01:16:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8560a0ce-6712-488b-adc0-59a2bfcffc77 tempest-VolumesActionsTest-1288723690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-48a2c0f1-8c98-4310-87d1-ed911e42f70c" returned: 0 in 0.746s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:16:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8560a0ce-6712-488b-adc0-59a2bfcffc77 tempest-VolumesActionsTest-1288723690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-48a2c0f1-8c98-4310-87d1-ed911e42f70c /opt/stack/data/cinder/conversion/48a2c0f1-8c98-4310-87d1-ed911e42f70c.temp_image.046cdb08-bb0e-4296-a6e0-b0a0cbb1967d4ma6fh7c.img {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:09 devstack sudo[99210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-48a2c0f1-8c98-4310-87d1-ed911e42f70c /opt/stack/data/cinder/conversion/48a2c0f1-8c98-4310-87d1-ed911e42f70c.temp_image.046cdb08-bb0e-4296-a6e0-b0a0cbb1967d4ma6fh7c.img
Jul 03 01:16:09 devstack sudo[99210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:10 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-2eafb6dc-3a3d-4273-be4a-142736fe8ca7 tempest-VolumesTransfersV357Test-1957732239 None] Acquiring lock "cinder-eacdecab-34e5-45f8-a416-05933058ab75-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:16:10 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-2eafb6dc-3a3d-4273-be4a-142736fe8ca7 tempest-VolumesTransfersV357Test-1957732239 None] Lock "cinder-eacdecab-34e5-45f8-a416-05933058ab75-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:16:10 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-2eafb6dc-3a3d-4273-be4a-142736fe8ca7 tempest-VolumesTransfersV357Test-1957732239 None] Acquiring lock "cinder-quobyte-eacdecab-34e5-45f8-a416-05933058ab75" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:16:10 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-2eafb6dc-3a3d-4273-be4a-142736fe8ca7 tempest-VolumesTransfersV357Test-1957732239 None] Lock "cinder-quobyte-eacdecab-34e5-45f8-a416-05933058ab75" acquired by "delete_volume" :: waited 0.027s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:16:10 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48c3593-a1bd-4778-b530-82783e71db59]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:16:10 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-2eafb6dc-3a3d-4273-be4a-142736fe8ca7 tempest-VolumesTransfersV357Test-1957732239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-eacdecab-34e5-45f8-a416-05933058ab75 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:10 devstack sudo[99222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-eacdecab-34e5-45f8-a416-05933058ab75
Jul 03 01:16:10 devstack sudo[99222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:11 devstack sudo[99222]: pam_unix(sudo:session): session closed for user root
Jul 03 01:16:11 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-2eafb6dc-3a3d-4273-be4a-142736fe8ca7 tempest-VolumesTransfersV357Test-1957732239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-eacdecab-34e5-45f8-a416-05933058ab75" returned: 0 in 1.301s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:16:11 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-2eafb6dc-3a3d-4273-be4a-142736fe8ca7 tempest-VolumesTransfersV357Test-1957732239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-eacdecab-34e5-45f8-a416-05933058ab75 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:11 devstack sudo[99227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-eacdecab-34e5-45f8-a416-05933058ab75
Jul 03 01:16:11 devstack sudo[99227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:12 devstack sudo[99227]: pam_unix(sudo:session): session closed for user root
Jul 03 01:16:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-2eafb6dc-3a3d-4273-be4a-142736fe8ca7 tempest-VolumesTransfersV357Test-1957732239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-eacdecab-34e5-45f8-a416-05933058ab75" returned: 0 in 1.388s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:16:12 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-2eafb6dc-3a3d-4273-be4a-142736fe8ca7 tempest-VolumesTransfersV357Test-1957732239 None] Lock "cinder-quobyte-eacdecab-34e5-45f8-a416-05933058ab75" released by "delete_volume" :: held 2.769s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:16:13 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-2eafb6dc-3a3d-4273-be4a-142736fe8ca7 tempest-VolumesTransfersV357Test-1957732239 None] Created reservations ['bbfb9b63-3722-453a-9f14-d1512381ecdf', '5eddc090-36f8-4e18-91a4-bfdb63f1ca95', '671761f4-61be-4dd2-af91-7c6804fa56de', '3ffc4d17-6cb9-4ec9-b674-be429eeecac7'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:16:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-2eafb6dc-3a3d-4273-be4a-142736fe8ca7 tempest-VolumesTransfersV357Test-1957732239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:16:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-2eafb6dc-3a3d-4273-be4a-142736fe8ca7 tempest-VolumesTransfersV357Test-1957732239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:16:13 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-2eafb6dc-3a3d-4273-be4a-142736fe8ca7 tempest-VolumesTransfersV357Test-1957732239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:16:13 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-2eafb6dc-3a3d-4273-be4a-142736fe8ca7 tempest-VolumesTransfersV357Test-1957732239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:16:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-2eafb6dc-3a3d-4273-be4a-142736fe8ca7 tempest-VolumesTransfersV357Test-1957732239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:16:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-2eafb6dc-3a3d-4273-be4a-142736fe8ca7 tempest-VolumesTransfersV357Test-1957732239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:13 devstack sudo[99231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:16:13 devstack sudo[99231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:13 devstack sudo[99210]: pam_unix(sudo:session): session closed for user root
Jul 03 01:16:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8560a0ce-6712-488b-adc0-59a2bfcffc77 tempest-VolumesActionsTest-1288723690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-48a2c0f1-8c98-4310-87d1-ed911e42f70c /opt/stack/data/cinder/conversion/48a2c0f1-8c98-4310-87d1-ed911e42f70c.temp_image.046cdb08-bb0e-4296-a6e0-b0a0cbb1967d4ma6fh7c.img" returned: 0 in 4.849s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:16:14 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[260b4fe9-fa1e-4378-9de0-c5627a479145]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:16:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8560a0ce-6712-488b-adc0-59a2bfcffc77 tempest-VolumesActionsTest-1288723690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-48a2c0f1-8c98-4310-87d1-ed911e42f70c {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:14 devstack sudo[99231]: pam_unix(sudo:session): session closed for user root
Jul 03 01:16:14 devstack sudo[99233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-48a2c0f1-8c98-4310-87d1-ed911e42f70c
Jul 03 01:16:14 devstack sudo[99233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-2eafb6dc-3a3d-4273-be4a-142736fe8ca7 tempest-VolumesTransfersV357Test-1957732239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.951s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:16:14 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-2eafb6dc-3a3d-4273-be4a-142736fe8ca7 tempest-VolumesTransfersV357Test-1957732239 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:16:14 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-2eafb6dc-3a3d-4273-be4a-142736fe8ca7 tempest-VolumesTransfersV357Test-1957732239 None] Deleted volume successfully.
Jul 03 01:16:14 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-2eafb6dc-3a3d-4273-be4a-142736fe8ca7 tempest-VolumesTransfersV357Test-1957732239 None] Lock "cinder-eacdecab-34e5-45f8-a416-05933058ab75-delete_volume" released by "delete_volume" :: held 4.149s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:16:14 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-05bfc620-17e3-4edd-a9a8-5529ac3147f6 tempest-VolumesTransfersV357Test-897181408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:16:14 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-05bfc620-17e3-4edd-a9a8-5529ac3147f6 tempest-VolumesTransfersV357Test-897181408 None] Flow 'volume_create_manager' (78cd8365-8c4e-42b4-97ce-b7975795103f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:16:14 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-05bfc620-17e3-4edd-a9a8-5529ac3147f6 tempest-VolumesTransfersV357Test-897181408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13839a85-648d-46ee-8a5c-fdee18598943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:16:14 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-05bfc620-17e3-4edd-a9a8-5529ac3147f6 tempest-VolumesTransfersV357Test-897181408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13839a85-648d-46ee-8a5c-fdee18598943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1418819092',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2becbfb-4c94-4d08-afb4-fbcc0962748d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6710b0bec86f45eb82a0af8d94aa3ac2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:16:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:16:14Z,use_quota=True,user_id='2cea558ed3454b5f810b8ac2e1354edc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:16:14 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-05bfc620-17e3-4edd-a9a8-5529ac3147f6 tempest-VolumesTransfersV357Test-897181408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea62b97e-8c15-471e-9203-e5f603fab17d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:16:14 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-05bfc620-17e3-4edd-a9a8-5529ac3147f6 tempest-VolumesTransfersV357Test-897181408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea62b97e-8c15-471e-9203-e5f603fab17d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:16:14 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-05bfc620-17e3-4edd-a9a8-5529ac3147f6 tempest-VolumesTransfersV357Test-897181408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9374dc16-db67-45dc-b6f9-5c6b733b782f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:16:14 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-05bfc620-17e3-4edd-a9a8-5529ac3147f6 tempest-VolumesTransfersV357Test-897181408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9374dc16-db67-45dc-b6f9-5c6b733b782f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2becbfb-4c94-4d08-afb4-fbcc0962748d', 'volume_name': 'volume-d2becbfb-4c94-4d08-afb4-fbcc0962748d', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:16:14 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-05bfc620-17e3-4edd-a9a8-5529ac3147f6 tempest-VolumesTransfersV357Test-897181408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec46c8e0-6f7c-4a2e-a41d-48d2d8e23ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:16:14 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-05bfc620-17e3-4edd-a9a8-5529ac3147f6 tempest-VolumesTransfersV357Test-897181408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec46c8e0-6f7c-4a2e-a41d-48d2d8e23ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:16:14 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-05bfc620-17e3-4edd-a9a8-5529ac3147f6 tempest-VolumesTransfersV357Test-897181408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31786b9e-ed62-4f6d-b3b7-dac7cbe85a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:16:14 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-05bfc620-17e3-4edd-a9a8-5529ac3147f6 tempest-VolumesTransfersV357Test-897181408 None] Volume d2becbfb-4c94-4d08-afb4-fbcc0962748d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2becbfb-4c94-4d08-afb4-fbcc0962748d', 'volume_size': 1}
Jul 03 01:16:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-05bfc620-17e3-4edd-a9a8-5529ac3147f6 tempest-VolumesTransfersV357Test-897181408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:16:14 devstack sudo[99233]: pam_unix(sudo:session): session closed for user root
Jul 03 01:16:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8560a0ce-6712-488b-adc0-59a2bfcffc77 tempest-VolumesActionsTest-1288723690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-48a2c0f1-8c98-4310-87d1-ed911e42f70c" returned: 0 in 0.974s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:16:14 devstack cinder-volume[86891]: DEBUG cinder.image.image_utils [None req-8560a0ce-6712-488b-adc0-59a2bfcffc77 tempest-VolumesActionsTest-1288723690 None] Image conversion details: src /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-48a2c0f1-8c98-4310-87d1-ed911e42f70c, size 1024.00 MB, duration 4.85 sec, destination /opt/stack/data/cinder/conversion/48a2c0f1-8c98-4310-87d1-ed911e42f70c.temp_image.046cdb08-bb0e-4296-a6e0-b0a0cbb1967d4ma6fh7c.img {{(pid=86891) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 03 01:16:14 devstack cinder-volume[86891]: INFO cinder.image.image_utils [None req-8560a0ce-6712-488b-adc0-59a2bfcffc77 tempest-VolumesActionsTest-1288723690 None] Converted 1024.00 MB image at 211.12 MB/s
Jul 03 01:16:15 devstack cinder-volume[86891]: DEBUG cinder.image.image_utils [None req-8560a0ce-6712-488b-adc0-59a2bfcffc77 tempest-VolumesActionsTest-1288723690 None] 046cdb08-bb0e-4296-a6e0-b0a0cbb1967d was raw, converting to qcow2 {{(pid=86891) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}}
Jul 03 01:16:15 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[126cf229-f8d4-4b59-a75d-ee52d7a3e7b4]: (4, 'raw') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:16:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8560a0ce-6712-488b-adc0-59a2bfcffc77 tempest-VolumesActionsTest-1288723690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/48a2c0f1-8c98-4310-87d1-ed911e42f70c.temp_image.046cdb08-bb0e-4296-a6e0-b0a0cbb1967d4ma6fh7c.img {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:15 devstack sudo[99239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/48a2c0f1-8c98-4310-87d1-ed911e42f70c.temp_image.046cdb08-bb0e-4296-a6e0-b0a0cbb1967d4ma6fh7c.img
Jul 03 01:16:15 devstack sudo[99239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:15 devstack sudo[99239]: pam_unix(sudo:session): session closed for user root
Jul 03 01:16:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8560a0ce-6712-488b-adc0-59a2bfcffc77 tempest-VolumesActionsTest-1288723690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/48a2c0f1-8c98-4310-87d1-ed911e42f70c.temp_image.046cdb08-bb0e-4296-a6e0-b0a0cbb1967d4ma6fh7c.img" returned: 0 in 0.704s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:16:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8560a0ce-6712-488b-adc0-59a2bfcffc77 tempest-VolumesActionsTest-1288723690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/48a2c0f1-8c98-4310-87d1-ed911e42f70c.temp_image.046cdb08-bb0e-4296-a6e0-b0a0cbb1967d4ma6fh7c.img {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:15 devstack sudo[99243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/48a2c0f1-8c98-4310-87d1-ed911e42f70c.temp_image.046cdb08-bb0e-4296-a6e0-b0a0cbb1967d4ma6fh7c.img
Jul 03 01:16:15 devstack sudo[99243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:16 devstack sudo[99243]: pam_unix(sudo:session): session closed for user root
Jul 03 01:16:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8560a0ce-6712-488b-adc0-59a2bfcffc77 tempest-VolumesActionsTest-1288723690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/48a2c0f1-8c98-4310-87d1-ed911e42f70c.temp_image.046cdb08-bb0e-4296-a6e0-b0a0cbb1967d4ma6fh7c.img" returned: 1 in 0.710s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:16:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8560a0ce-6712-488b-adc0-59a2bfcffc77 tempest-VolumesActionsTest-1288723690 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/48a2c0f1-8c98-4310-87d1-ed911e42f70c.temp_image.046cdb08-bb0e-4296-a6e0-b0a0cbb1967d4ma6fh7c.img' failed. Not Retrying. {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 01:16:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8560a0ce-6712-488b-adc0-59a2bfcffc77 tempest-VolumesActionsTest-1288723690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/48a2c0f1-8c98-4310-87d1-ed911e42f70c.temp_image.046cdb08-bb0e-4296-a6e0-b0a0cbb1967d4ma6fh7c.img /opt/stack/data/cinder/conversion/vol_upload_nexfb4km {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:16 devstack sudo[99248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/48a2c0f1-8c98-4310-87d1-ed911e42f70c.temp_image.046cdb08-bb0e-4296-a6e0-b0a0cbb1967d4ma6fh7c.img /opt/stack/data/cinder/conversion/vol_upload_nexfb4km
Jul 03 01:16:16 devstack sudo[99248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:17 devstack sudo[99248]: pam_unix(sudo:session): session closed for user root
Jul 03 01:16:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8560a0ce-6712-488b-adc0-59a2bfcffc77 tempest-VolumesActionsTest-1288723690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/48a2c0f1-8c98-4310-87d1-ed911e42f70c.temp_image.046cdb08-bb0e-4296-a6e0-b0a0cbb1967d4ma6fh7c.img /opt/stack/data/cinder/conversion/vol_upload_nexfb4km" returned: 0 in 0.642s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:16:17 devstack cinder-volume[86891]: DEBUG cinder.image.image_utils [None req-8560a0ce-6712-488b-adc0-59a2bfcffc77 tempest-VolumesActionsTest-1288723690 None] Image conversion details: src /opt/stack/data/cinder/conversion/48a2c0f1-8c98-4310-87d1-ed911e42f70c.temp_image.046cdb08-bb0e-4296-a6e0-b0a0cbb1967d4ma6fh7c.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_nexfb4km {{(pid=86891) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 03 01:16:17 devstack cinder-volume[86891]: INFO cinder.image.image_utils [None req-8560a0ce-6712-488b-adc0-59a2bfcffc77 tempest-VolumesActionsTest-1288723690 None] Converted 1024.00 MB image at 1024.00 MB/s
Jul 03 01:16:17 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d33aa0-6fb5-4003-b53b-4a5722ee43e0]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:16:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8560a0ce-6712-488b-adc0-59a2bfcffc77 tempest-VolumesActionsTest-1288723690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_nexfb4km {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:17 devstack sudo[99253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_nexfb4km
Jul 03 01:16:17 devstack sudo[99253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:17 devstack sudo[99253]: pam_unix(sudo:session): session closed for user root
Jul 03 01:16:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8560a0ce-6712-488b-adc0-59a2bfcffc77 tempest-VolumesActionsTest-1288723690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_nexfb4km" returned: 0 in 0.810s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:16:19 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-8560a0ce-6712-488b-adc0-59a2bfcffc77 tempest-VolumesActionsTest-1288723690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.570s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:16:19 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-8560a0ce-6712-488b-adc0-59a2bfcffc77 tempest-VolumesActionsTest-1288723690 None] Uploaded volume to glance image-id: 046cdb08-bb0e-4296-a6e0-b0a0cbb1967d. {{(pid=86891) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Jul 03 01:16:19 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1e21885b-739a-4477-8591-35ce8e6dffff tempest-VolumesDeleteCascade-111846741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 12.462s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:16:19 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-1e21885b-739a-4477-8591-35ce8e6dffff tempest-VolumesDeleteCascade-111846741 None] Creating offline snapshot ad2d7649-343b-4433-b912-62078383ff06 of volume 4ede261e-0fc2-4a29-8dec-5f13fd406565 {{(pid=86891) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 01:16:19 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-8560a0ce-6712-488b-adc0-59a2bfcffc77 tempest-VolumesActionsTest-1288723690 None] Copy volume to image completed successfully.
Jul 03 01:16:19 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[90289e15-adae-4ac1-831e-cd2ae1cf356e]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:16:19 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1e21885b-739a-4477-8591-35ce8e6dffff tempest-VolumesDeleteCascade-111846741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4ede261e-0fc2-4a29-8dec-5f13fd406565 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:19 devstack sudo[99261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4ede261e-0fc2-4a29-8dec-5f13fd406565
Jul 03 01:16:19 devstack sudo[99261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:19 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e3bcdc4a-930c-4d69-a6ab-a162e296e32e tempest-VolumesActionsTest-1288723690 None] Acquiring lock "cinder-48a2c0f1-8c98-4310-87d1-ed911e42f70c-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:16:19 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e3bcdc4a-930c-4d69-a6ab-a162e296e32e tempest-VolumesActionsTest-1288723690 None] Lock "cinder-48a2c0f1-8c98-4310-87d1-ed911e42f70c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:16:19 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e3bcdc4a-930c-4d69-a6ab-a162e296e32e tempest-VolumesActionsTest-1288723690 None] Acquiring lock "cinder-quobyte-48a2c0f1-8c98-4310-87d1-ed911e42f70c" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:16:19 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e3bcdc4a-930c-4d69-a6ab-a162e296e32e tempest-VolumesActionsTest-1288723690 None] Lock "cinder-quobyte-48a2c0f1-8c98-4310-87d1-ed911e42f70c" acquired by "delete_volume" :: waited 0.017s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:16:19 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02a4231-fece-4a87-8d56-f314ac376a1d]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:16:19 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e3bcdc4a-930c-4d69-a6ab-a162e296e32e tempest-VolumesActionsTest-1288723690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-48a2c0f1-8c98-4310-87d1-ed911e42f70c {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:19 devstack sudo[99261]: pam_unix(sudo:session): session closed for user root
Jul 03 01:16:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1e21885b-739a-4477-8591-35ce8e6dffff tempest-VolumesDeleteCascade-111846741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4ede261e-0fc2-4a29-8dec-5f13fd406565" returned: 0 in 0.800s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:16:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1e21885b-739a-4477-8591-35ce8e6dffff tempest-VolumesDeleteCascade-111846741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4ede261e-0fc2-4a29-8dec-5f13fd406565,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4ede261e-0fc2-4a29-8dec-5f13fd406565.ad2d7649-343b-4433-b912-62078383ff06 1G {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:20 devstack sudo[99268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4ede261e-0fc2-4a29-8dec-5f13fd406565,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4ede261e-0fc2-4a29-8dec-5f13fd406565.ad2d7649-343b-4433-b912-62078383ff06 1G
Jul 03 01:16:20 devstack sudo[99268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:20 devstack sudo[99267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-48a2c0f1-8c98-4310-87d1-ed911e42f70c
Jul 03 01:16:20 devstack sudo[99267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:20 devstack sudo[99267]: pam_unix(sudo:session): session closed for user root
Jul 03 01:16:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e3bcdc4a-930c-4d69-a6ab-a162e296e32e tempest-VolumesActionsTest-1288723690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-48a2c0f1-8c98-4310-87d1-ed911e42f70c" returned: 0 in 0.745s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:16:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e3bcdc4a-930c-4d69-a6ab-a162e296e32e tempest-VolumesActionsTest-1288723690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-48a2c0f1-8c98-4310-87d1-ed911e42f70c {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:20 devstack sudo[99280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-48a2c0f1-8c98-4310-87d1-ed911e42f70c
Jul 03 01:16:20 devstack sudo[99280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:20 devstack sudo[99268]: pam_unix(sudo:session): session closed for user root
Jul 03 01:16:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1e21885b-739a-4477-8591-35ce8e6dffff tempest-VolumesDeleteCascade-111846741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4ede261e-0fc2-4a29-8dec-5f13fd406565,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4ede261e-0fc2-4a29-8dec-5f13fd406565.ad2d7649-343b-4433-b912-62078383ff06 1G" returned: 0 in 0.785s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:16:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1e21885b-739a-4477-8591-35ce8e6dffff tempest-VolumesDeleteCascade-111846741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ede261e-0fc2-4a29-8dec-5f13fd406565 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4ede261e-0fc2-4a29-8dec-5f13fd406565.ad2d7649-343b-4433-b912-62078383ff06 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:20 devstack sudo[99282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ede261e-0fc2-4a29-8dec-5f13fd406565 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4ede261e-0fc2-4a29-8dec-5f13fd406565.ad2d7649-343b-4433-b912-62078383ff06
Jul 03 01:16:20 devstack sudo[99282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:21 devstack sudo[99280]: pam_unix(sudo:session): session closed for user root
Jul 03 01:16:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e3bcdc4a-930c-4d69-a6ab-a162e296e32e tempest-VolumesActionsTest-1288723690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-48a2c0f1-8c98-4310-87d1-ed911e42f70c" returned: 0 in 0.635s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:16:21 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e3bcdc4a-930c-4d69-a6ab-a162e296e32e tempest-VolumesActionsTest-1288723690 None] Lock "cinder-quobyte-48a2c0f1-8c98-4310-87d1-ed911e42f70c" released by "delete_volume" :: held 1.418s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:16:21 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-e3bcdc4a-930c-4d69-a6ab-a162e296e32e tempest-VolumesActionsTest-1288723690 None] Created reservations ['ecd29a4f-028a-41cf-8fac-23d08544393c', '7f3fe04a-2dfa-47af-ab11-0585cb41e02e', 'f7652ca1-e3aa-416a-94ce-23f665012516', '175ba6af-b4cf-4055-aa1f-54e929b095b7'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:16:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e3bcdc4a-930c-4d69-a6ab-a162e296e32e tempest-VolumesActionsTest-1288723690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:16:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e3bcdc4a-930c-4d69-a6ab-a162e296e32e tempest-VolumesActionsTest-1288723690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:16:21 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-e3bcdc4a-930c-4d69-a6ab-a162e296e32e tempest-VolumesActionsTest-1288723690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:16:21 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-e3bcdc4a-930c-4d69-a6ab-a162e296e32e tempest-VolumesActionsTest-1288723690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:16:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e3bcdc4a-930c-4d69-a6ab-a162e296e32e tempest-VolumesActionsTest-1288723690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:16:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e3bcdc4a-930c-4d69-a6ab-a162e296e32e tempest-VolumesActionsTest-1288723690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:21 devstack sudo[99282]: pam_unix(sudo:session): session closed for user root
Jul 03 01:16:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1e21885b-739a-4477-8591-35ce8e6dffff tempest-VolumesDeleteCascade-111846741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ede261e-0fc2-4a29-8dec-5f13fd406565 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4ede261e-0fc2-4a29-8dec-5f13fd406565.ad2d7649-343b-4433-b912-62078383ff06" returned: 0 in 0.688s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:16:21 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-1e21885b-739a-4477-8591-35ce8e6dffff tempest-VolumesDeleteCascade-111846741 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4ede261e-0fc2-4a29-8dec-5f13fd406565.ad2d7649-343b-4433-b912-62078383ff06 is being set with open permissions: ugo+rw
Jul 03 01:16:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1e21885b-739a-4477-8591-35ce8e6dffff tempest-VolumesDeleteCascade-111846741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4ede261e-0fc2-4a29-8dec-5f13fd406565.ad2d7649-343b-4433-b912-62078383ff06 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:21 devstack sudo[99288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:16:21 devstack sudo[99288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:21 devstack sudo[99289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4ede261e-0fc2-4a29-8dec-5f13fd406565.ad2d7649-343b-4433-b912-62078383ff06
Jul 03 01:16:21 devstack sudo[99289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:22 devstack sudo[99288]: pam_unix(sudo:session): session closed for user root
Jul 03 01:16:22 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e3bcdc4a-930c-4d69-a6ab-a162e296e32e tempest-VolumesActionsTest-1288723690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.657s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:16:22 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-e3bcdc4a-930c-4d69-a6ab-a162e296e32e tempest-VolumesActionsTest-1288723690 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:16:22 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-e3bcdc4a-930c-4d69-a6ab-a162e296e32e tempest-VolumesActionsTest-1288723690 None] Deleted volume successfully.
Jul 03 01:16:22 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e3bcdc4a-930c-4d69-a6ab-a162e296e32e tempest-VolumesActionsTest-1288723690 None] Lock "cinder-48a2c0f1-8c98-4310-87d1-ed911e42f70c-delete_volume" released by "delete_volume" :: held 2.294s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:16:22 devstack sudo[99289]: pam_unix(sudo:session): session closed for user root
Jul 03 01:16:22 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1e21885b-739a-4477-8591-35ce8e6dffff tempest-VolumesDeleteCascade-111846741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4ede261e-0fc2-4a29-8dec-5f13fd406565.ad2d7649-343b-4433-b912-62078383ff06" returned: 0 in 0.721s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:16:22 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1e21885b-739a-4477-8591-35ce8e6dffff tempest-VolumesDeleteCascade-111846741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4ede261e-0fc2-4a29-8dec-5f13fd406565.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:22 devstack sudo[99294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4ede261e-0fc2-4a29-8dec-5f13fd406565.info
Jul 03 01:16:22 devstack sudo[99294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:22 devstack sudo[99294]: pam_unix(sudo:session): session closed for user root
Jul 03 01:16:22 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1e21885b-739a-4477-8591-35ce8e6dffff tempest-VolumesDeleteCascade-111846741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4ede261e-0fc2-4a29-8dec-5f13fd406565.info" returned: 0 in 0.716s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:16:22 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-1e21885b-739a-4477-8591-35ce8e6dffff tempest-VolumesDeleteCascade-111846741 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4ede261e-0fc2-4a29-8dec-5f13fd406565.info is being set with open permissions: ugo+rw
Jul 03 01:16:22 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1e21885b-739a-4477-8591-35ce8e6dffff tempest-VolumesDeleteCascade-111846741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4ede261e-0fc2-4a29-8dec-5f13fd406565.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:22 devstack sudo[99297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4ede261e-0fc2-4a29-8dec-5f13fd406565.info
Jul 03 01:16:22 devstack sudo[99297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:23 devstack sudo[99297]: pam_unix(sudo:session): session closed for user root
Jul 03 01:16:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1e21885b-739a-4477-8591-35ce8e6dffff tempest-VolumesDeleteCascade-111846741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4ede261e-0fc2-4a29-8dec-5f13fd406565.info" returned: 0 in 0.686s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:16:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1e21885b-739a-4477-8591-35ce8e6dffff tempest-VolumesDeleteCascade-111846741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.508s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:16:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-05bfc620-17e3-4edd-a9a8-5529ac3147f6 tempest-VolumesTransfersV357Test-897181408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.238s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:16:23 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-05bfc620-17e3-4edd-a9a8-5529ac3147f6 tempest-VolumesTransfersV357Test-897181408 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1418819092',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2becbfb-4c94-4d08-afb4-fbcc0962748d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6710b0bec86f45eb82a0af8d94aa3ac2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:16:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:16:14Z,use_quota=True,user_id='2cea558ed3454b5f810b8ac2e1354edc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:16:23 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-05bfc620-17e3-4edd-a9a8-5529ac3147f6 tempest-VolumesTransfersV357Test-897181408 None] Creating volume d2becbfb-4c94-4d08-afb4-fbcc0962748d {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:16:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-05bfc620-17e3-4edd-a9a8-5529ac3147f6 tempest-VolumesTransfersV357Test-897181408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:16:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-05bfc620-17e3-4edd-a9a8-5529ac3147f6 tempest-VolumesTransfersV357Test-897181408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:16:23 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-05bfc620-17e3-4edd-a9a8-5529ac3147f6 tempest-VolumesTransfersV357Test-897181408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:16:23 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-05bfc620-17e3-4edd-a9a8-5529ac3147f6 tempest-VolumesTransfersV357Test-897181408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:16:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-05bfc620-17e3-4edd-a9a8-5529ac3147f6 tempest-VolumesTransfersV357Test-897181408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:16:23 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-05bfc620-17e3-4edd-a9a8-5529ac3147f6 tempest-VolumesTransfersV357Test-897181408 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:16:23 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-05bfc620-17e3-4edd-a9a8-5529ac3147f6 tempest-VolumesTransfersV357Test-897181408 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:16:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-05bfc620-17e3-4edd-a9a8-5529ac3147f6 tempest-VolumesTransfersV357Test-897181408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d2becbfb-4c94-4d08-afb4-fbcc0962748d 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:23 devstack sudo[99301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d2becbfb-4c94-4d08-afb4-fbcc0962748d 1073741824
Jul 03 01:16:23 devstack sudo[99301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:23 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-1e21885b-739a-4477-8591-35ce8e6dffff tempest-VolumesDeleteCascade-111846741 None] Create snapshot completed successfully
Jul 03 01:16:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-05bfc620-17e3-4edd-a9a8-5529ac3147f6 tempest-VolumesTransfersV357Test-897181408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d2becbfb-4c94-4d08-afb4-fbcc0962748d 1073741824" returned: 0 in 0.915s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:16:24 devstack sudo[99301]: pam_unix(sudo:session): session closed for user root
Jul 03 01:16:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-05bfc620-17e3-4edd-a9a8-5529ac3147f6 tempest-VolumesTransfersV357Test-897181408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d2becbfb-4c94-4d08-afb4-fbcc0962748d {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:24 devstack sudo[99307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d2becbfb-4c94-4d08-afb4-fbcc0962748d
Jul 03 01:16:24 devstack sudo[99307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:25 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcbdf431-d075-4fd6-91ab-bc959c64a73b tempest-VolumesDeleteCascade-111846741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:16:25 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fcbdf431-d075-4fd6-91ab-bc959c64a73b tempest-VolumesDeleteCascade-111846741 None] Flow 'volume_create_manager' (56726822-a31b-45f7-8854-be5a615c907f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:16:25 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fcbdf431-d075-4fd6-91ab-bc959c64a73b tempest-VolumesDeleteCascade-111846741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84e5716d-7ece-4dfb-a72c-259e22411957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:16:25 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fcbdf431-d075-4fd6-91ab-bc959c64a73b tempest-VolumesDeleteCascade-111846741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84e5716d-7ece-4dfb-a72c-259e22411957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:16:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-673483268',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57f77350-647c-4af3-9d55-84d2014f8548,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c26c8b32ff104dc9b16a548011440c55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:16:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ad2d7649-343b-4433-b912-62078383ff06,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:16:25Z,use_quota=True,user_id='7a974c46b5264104ba1adca50c161965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:16:25 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fcbdf431-d075-4fd6-91ab-bc959c64a73b tempest-VolumesDeleteCascade-111846741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c6a7dd8-771c-4869-b5e2-adae1068bb42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:16:25 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fcbdf431-d075-4fd6-91ab-bc959c64a73b tempest-VolumesDeleteCascade-111846741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c6a7dd8-771c-4869-b5e2-adae1068bb42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:16:25 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fcbdf431-d075-4fd6-91ab-bc959c64a73b tempest-VolumesDeleteCascade-111846741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (344ee9b6-a81a-4e79-ba23-4e07517ae9e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:16:25 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fcbdf431-d075-4fd6-91ab-bc959c64a73b tempest-VolumesDeleteCascade-111846741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (344ee9b6-a81a-4e79-ba23-4e07517ae9e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '57f77350-647c-4af3-9d55-84d2014f8548', 'volume_name': 'volume-57f77350-647c-4af3-9d55-84d2014f8548', 'volume_size': 1, 'snapshot_id': 'ad2d7649-343b-4433-b912-62078383ff06'}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:16:25 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fcbdf431-d075-4fd6-91ab-bc959c64a73b tempest-VolumesDeleteCascade-111846741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5581be0-401b-42a1-9ded-3e68920fc0df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:16:25 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fcbdf431-d075-4fd6-91ab-bc959c64a73b tempest-VolumesDeleteCascade-111846741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5581be0-401b-42a1-9ded-3e68920fc0df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:16:25 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fcbdf431-d075-4fd6-91ab-bc959c64a73b tempest-VolumesDeleteCascade-111846741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f82bce8-cb51-445b-b011-fefb5e629fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:16:25 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-fcbdf431-d075-4fd6-91ab-bc959c64a73b tempest-VolumesDeleteCascade-111846741 None] Volume 57f77350-647c-4af3-9d55-84d2014f8548: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-57f77350-647c-4af3-9d55-84d2014f8548', 'volume_size': 1, 'snapshot_id': 'ad2d7649-343b-4433-b912-62078383ff06'}
Jul 03 01:16:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-fcbdf431-d075-4fd6-91ab-bc959c64a73b tempest-VolumesDeleteCascade-111846741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:16:25 devstack sudo[99307]: pam_unix(sudo:session): session closed for user root
Jul 03 01:16:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-05bfc620-17e3-4edd-a9a8-5529ac3147f6 tempest-VolumesTransfersV357Test-897181408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d2becbfb-4c94-4d08-afb4-fbcc0962748d" returned: 0 in 0.683s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:16:25 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-05bfc620-17e3-4edd-a9a8-5529ac3147f6 tempest-VolumesTransfersV357Test-897181408 None] <== create_volume: return (1699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:16:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-05bfc620-17e3-4edd-a9a8-5529ac3147f6 tempest-VolumesTransfersV357Test-897181408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.702s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:16:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-fcbdf431-d075-4fd6-91ab-bc959c64a73b tempest-VolumesDeleteCascade-111846741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.101s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:16:25 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-fcbdf431-d075-4fd6-91ab-bc959c64a73b tempest-VolumesDeleteCascade-111846741 None] Acquiring lock "cinder-quobyte-ad2d7649-343b-4433-b912-62078383ff06-57f77350-647c-4af3-9d55-84d2014f8548" by "_create_volume_from_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:16:25 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-05bfc620-17e3-4edd-a9a8-5529ac3147f6 tempest-VolumesTransfersV357Test-897181408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31786b9e-ed62-4f6d-b3b7-dac7cbe85a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2becbfb-4c94-4d08-afb4-fbcc0962748d', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:16:25 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-05bfc620-17e3-4edd-a9a8-5529ac3147f6 tempest-VolumesTransfersV357Test-897181408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d264a7b-bab8-46a5-9a1b-3926f9fe80df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:16:25 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-05bfc620-17e3-4edd-a9a8-5529ac3147f6 tempest-VolumesTransfersV357Test-897181408 None] Volume volume-d2becbfb-4c94-4d08-afb4-fbcc0962748d (d2becbfb-4c94-4d08-afb4-fbcc0962748d): created successfully
Jul 03 01:16:25 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-05bfc620-17e3-4edd-a9a8-5529ac3147f6 tempest-VolumesTransfersV357Test-897181408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d264a7b-bab8-46a5-9a1b-3926f9fe80df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:16:25 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-05bfc620-17e3-4edd-a9a8-5529ac3147f6 tempest-VolumesTransfersV357Test-897181408 None] Flow 'volume_create_manager' (78cd8365-8c4e-42b4-97ce-b7975795103f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:16:25 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-fcbdf431-d075-4fd6-91ab-bc959c64a73b tempest-VolumesDeleteCascade-111846741 None] Lock "cinder-quobyte-ad2d7649-343b-4433-b912-62078383ff06-57f77350-647c-4af3-9d55-84d2014f8548" acquired by "_create_volume_from_snapshot" :: waited 0.052s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:16:25 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-fcbdf431-d075-4fd6-91ab-bc959c64a73b tempest-VolumesDeleteCascade-111846741 None] Creating volume 57f77350-647c-4af3-9d55-84d2014f8548 from snapshot ad2d7649-343b-4433-b912-62078383ff06 {{(pid=86891) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 03 01:16:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-fcbdf431-d075-4fd6-91ab-bc959c64a73b tempest-VolumesDeleteCascade-111846741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:16:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-fcbdf431-d075-4fd6-91ab-bc959c64a73b tempest-VolumesDeleteCascade-111846741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:16:25 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-fcbdf431-d075-4fd6-91ab-bc959c64a73b tempest-VolumesDeleteCascade-111846741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:16:25 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-fcbdf431-d075-4fd6-91ab-bc959c64a73b tempest-VolumesDeleteCascade-111846741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:16:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-fcbdf431-d075-4fd6-91ab-bc959c64a73b tempest-VolumesDeleteCascade-111846741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:16:25 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-fcbdf431-d075-4fd6-91ab-bc959c64a73b tempest-VolumesDeleteCascade-111846741 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:16:25 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-fcbdf431-d075-4fd6-91ab-bc959c64a73b tempest-VolumesDeleteCascade-111846741 None] Acquiring lock "cinder-quobyte-57f77350-647c-4af3-9d55-84d2014f8548" by "_copy_volume_from_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:16:25 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-05bfc620-17e3-4edd-a9a8-5529ac3147f6 tempest-VolumesTransfersV357Test-897181408 None] Created volume successfully.
Jul 03 01:16:25 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-fcbdf431-d075-4fd6-91ab-bc959c64a73b tempest-VolumesDeleteCascade-111846741 None] Lock "cinder-quobyte-57f77350-647c-4af3-9d55-84d2014f8548" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:16:25 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-fcbdf431-d075-4fd6-91ab-bc959c64a73b tempest-VolumesDeleteCascade-111846741 None] snapshot: ad2d7649-343b-4433-b912-62078383ff06, volume: 57f77350-647c-4af3-9d55-84d2014f8548,  {{(pid=86891) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 03 01:16:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-fcbdf431-d075-4fd6-91ab-bc959c64a73b tempest-VolumesDeleteCascade-111846741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:16:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-fcbdf431-d075-4fd6-91ab-bc959c64a73b tempest-VolumesDeleteCascade-111846741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:16:25 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-fcbdf431-d075-4fd6-91ab-bc959c64a73b tempest-VolumesDeleteCascade-111846741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:16:25 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-fcbdf431-d075-4fd6-91ab-bc959c64a73b tempest-VolumesDeleteCascade-111846741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:16:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-fcbdf431-d075-4fd6-91ab-bc959c64a73b tempest-VolumesDeleteCascade-111846741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:16:25 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3a1463-efe8-405e-be5b-415a1e902a89]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:16:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-fcbdf431-d075-4fd6-91ab-bc959c64a73b tempest-VolumesDeleteCascade-111846741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4ede261e-0fc2-4a29-8dec-5f13fd406565.ad2d7649-343b-4433-b912-62078383ff06 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:25 devstack sudo[99311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4ede261e-0fc2-4a29-8dec-5f13fd406565.ad2d7649-343b-4433-b912-62078383ff06
Jul 03 01:16:25 devstack sudo[99311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:26 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-603dd2b3-9b19-46dd-9237-0d1eddbe3df9 tempest-VolumesTransfersV357Test-1957732239 None] Acquiring lock "cinder-d2becbfb-4c94-4d08-afb4-fbcc0962748d-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:16:26 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-603dd2b3-9b19-46dd-9237-0d1eddbe3df9 tempest-VolumesTransfersV357Test-1957732239 None] Lock "cinder-d2becbfb-4c94-4d08-afb4-fbcc0962748d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:16:26 devstack sudo[99311]: pam_unix(sudo:session): session closed for user root
Jul 03 01:16:26 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-fcbdf431-d075-4fd6-91ab-bc959c64a73b tempest-VolumesDeleteCascade-111846741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4ede261e-0fc2-4a29-8dec-5f13fd406565.ad2d7649-343b-4433-b912-62078383ff06" returned: 0 in 0.902s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:16:26 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-fcbdf431-d075-4fd6-91ab-bc959c64a73b tempest-VolumesDeleteCascade-111846741 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ede261e-0fc2-4a29-8dec-5f13fd406565(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:16:26 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-fcbdf431-d075-4fd6-91ab-bc959c64a73b tempest-VolumesDeleteCascade-111846741 None] will copy from snapshot at /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4ede261e-0fc2-4a29-8dec-5f13fd406565 {{(pid=86891) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 03 01:16:26 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-fcbdf431-d075-4fd6-91ab-bc959c64a73b tempest-VolumesDeleteCascade-111846741 None] Creating direct copy from snapshot {{(pid=86891) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 03 01:16:26 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-603dd2b3-9b19-46dd-9237-0d1eddbe3df9 tempest-VolumesTransfersV357Test-1957732239 None] Acquiring lock "cinder-quobyte-d2becbfb-4c94-4d08-afb4-fbcc0962748d" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:16:26 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3cf4965-9f36-4f72-9d68-f1346fe31ca6]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:16:26 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-fcbdf431-d075-4fd6-91ab-bc959c64a73b tempest-VolumesDeleteCascade-111846741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4ede261e-0fc2-4a29-8dec-5f13fd406565 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:26 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-603dd2b3-9b19-46dd-9237-0d1eddbe3df9 tempest-VolumesTransfersV357Test-1957732239 None] Lock "cinder-quobyte-d2becbfb-4c94-4d08-afb4-fbcc0962748d" acquired by "delete_volume" :: waited 0.036s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:16:26 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c2a4fe6-70f5-47f0-9c9e-0935725d10d7]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:16:26 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-603dd2b3-9b19-46dd-9237-0d1eddbe3df9 tempest-VolumesTransfersV357Test-1957732239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d2becbfb-4c94-4d08-afb4-fbcc0962748d {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:26 devstack sudo[99316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4ede261e-0fc2-4a29-8dec-5f13fd406565
Jul 03 01:16:26 devstack sudo[99316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:26 devstack sudo[99317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d2becbfb-4c94-4d08-afb4-fbcc0962748d
Jul 03 01:16:26 devstack sudo[99317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:27 devstack sudo[99316]: pam_unix(sudo:session): session closed for user root
Jul 03 01:16:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-fcbdf431-d075-4fd6-91ab-bc959c64a73b tempest-VolumesDeleteCascade-111846741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4ede261e-0fc2-4a29-8dec-5f13fd406565" returned: 0 in 0.839s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:16:27 devstack cinder-volume[86891]: DEBUG cinder.utils [None req-fcbdf431-d075-4fd6-91ab-bc959c64a73b tempest-VolumesDeleteCascade-111846741 None] Path /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-57f77350-647c-4af3-9d55-84d2014f8548 not found in is_blk_device check {{(pid=86891) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 03 01:16:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-fcbdf431-d075-4fd6-91ab-bc959c64a73b tempest-VolumesDeleteCascade-111846741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4ede261e-0fc2-4a29-8dec-5f13fd406565 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-57f77350-647c-4af3-9d55-84d2014f8548 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:27 devstack sudo[99360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4ede261e-0fc2-4a29-8dec-5f13fd406565 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-57f77350-647c-4af3-9d55-84d2014f8548
Jul 03 01:16:27 devstack sudo[99360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:27 devstack sudo[99317]: pam_unix(sudo:session): session closed for user root
Jul 03 01:16:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-603dd2b3-9b19-46dd-9237-0d1eddbe3df9 tempest-VolumesTransfersV357Test-1957732239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d2becbfb-4c94-4d08-afb4-fbcc0962748d" returned: 0 in 0.967s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:16:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-603dd2b3-9b19-46dd-9237-0d1eddbe3df9 tempest-VolumesTransfersV357Test-1957732239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d2becbfb-4c94-4d08-afb4-fbcc0962748d {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:27 devstack sudo[99364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d2becbfb-4c94-4d08-afb4-fbcc0962748d
Jul 03 01:16:27 devstack sudo[99364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:28 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-832d5ab8-8a5f-4f9e-98d6-7d8942060152 tempest-VolumesCloneNegativeTest-1482605118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:16:28 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-832d5ab8-8a5f-4f9e-98d6-7d8942060152 tempest-VolumesCloneNegativeTest-1482605118 None] Flow 'volume_create_manager' (75f19bc3-cb6f-4a71-b32c-2741ef8cbe4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:16:28 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-832d5ab8-8a5f-4f9e-98d6-7d8942060152 tempest-VolumesCloneNegativeTest-1482605118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bbeead1-dc93-45e9-ae51-fc18c4b44ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:16:28 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-832d5ab8-8a5f-4f9e-98d6-7d8942060152 tempest-VolumesCloneNegativeTest-1482605118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bbeead1-dc93-45e9-ae51-fc18c4b44ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:16:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-91201362',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=747dff76-1aca-41bb-b45a-f4495e858542,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfce688bfc9a4fcf966e7e40e6c1f2a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:16:28Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:16:28Z,use_quota=True,user_id='82e16a71c23c420abac4eb24dc3a6769',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:16:28 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-832d5ab8-8a5f-4f9e-98d6-7d8942060152 tempest-VolumesCloneNegativeTest-1482605118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07dc939e-4b19-462a-b99d-431b965ffb35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:16:28 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-832d5ab8-8a5f-4f9e-98d6-7d8942060152 tempest-VolumesCloneNegativeTest-1482605118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07dc939e-4b19-462a-b99d-431b965ffb35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:16:28 devstack sudo[99364]: pam_unix(sudo:session): session closed for user root
Jul 03 01:16:28 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-832d5ab8-8a5f-4f9e-98d6-7d8942060152 tempest-VolumesCloneNegativeTest-1482605118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7088fcae-3cef-4f01-b0a7-1bea2d331f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:16:28 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-832d5ab8-8a5f-4f9e-98d6-7d8942060152 tempest-VolumesCloneNegativeTest-1482605118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7088fcae-3cef-4f01-b0a7-1bea2d331f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '747dff76-1aca-41bb-b45a-f4495e858542', 'volume_name': 'volume-747dff76-1aca-41bb-b45a-f4495e858542', 'volume_size': 2}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:16:28 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-832d5ab8-8a5f-4f9e-98d6-7d8942060152 tempest-VolumesCloneNegativeTest-1482605118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ac052c8-cd05-48c4-a481-347b25050ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:16:28 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-832d5ab8-8a5f-4f9e-98d6-7d8942060152 tempest-VolumesCloneNegativeTest-1482605118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ac052c8-cd05-48c4-a481-347b25050ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:16:28 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-832d5ab8-8a5f-4f9e-98d6-7d8942060152 tempest-VolumesCloneNegativeTest-1482605118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09382369-6924-4423-b398-5bfd70acc999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:16:28 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-832d5ab8-8a5f-4f9e-98d6-7d8942060152 tempest-VolumesCloneNegativeTest-1482605118 None] Volume 747dff76-1aca-41bb-b45a-f4495e858542: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-747dff76-1aca-41bb-b45a-f4495e858542', 'volume_size': 2}
Jul 03 01:16:28 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-832d5ab8-8a5f-4f9e-98d6-7d8942060152 tempest-VolumesCloneNegativeTest-1482605118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:16:28 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-603dd2b3-9b19-46dd-9237-0d1eddbe3df9 tempest-VolumesTransfersV357Test-1957732239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d2becbfb-4c94-4d08-afb4-fbcc0962748d" returned: 0 in 0.793s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:16:28 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-603dd2b3-9b19-46dd-9237-0d1eddbe3df9 tempest-VolumesTransfersV357Test-1957732239 None] Lock "cinder-quobyte-d2becbfb-4c94-4d08-afb4-fbcc0962748d" released by "delete_volume" :: held 1.807s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:16:28 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-603dd2b3-9b19-46dd-9237-0d1eddbe3df9 tempest-VolumesTransfersV357Test-1957732239 None] Created reservations ['14313c7e-afd7-4723-8192-d2b515ad1805', '0e5a3121-3544-4ab5-b0f9-d9cf0390977e', 'ce5bbc95-b601-4c6f-ba43-dfa735203ad4', 'c7312a70-874f-417b-9159-a247d450dd83'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:16:28 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-603dd2b3-9b19-46dd-9237-0d1eddbe3df9 tempest-VolumesTransfersV357Test-1957732239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:16:28 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-603dd2b3-9b19-46dd-9237-0d1eddbe3df9 tempest-VolumesTransfersV357Test-1957732239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:16:28 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-603dd2b3-9b19-46dd-9237-0d1eddbe3df9 tempest-VolumesTransfersV357Test-1957732239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:16:28 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-603dd2b3-9b19-46dd-9237-0d1eddbe3df9 tempest-VolumesTransfersV357Test-1957732239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:16:28 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-603dd2b3-9b19-46dd-9237-0d1eddbe3df9 tempest-VolumesTransfersV357Test-1957732239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:16:28 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-603dd2b3-9b19-46dd-9237-0d1eddbe3df9 tempest-VolumesTransfersV357Test-1957732239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:28 devstack sudo[99378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:16:28 devstack sudo[99378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:29 devstack sudo[99378]: pam_unix(sudo:session): session closed for user root
Jul 03 01:16:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-603dd2b3-9b19-46dd-9237-0d1eddbe3df9 tempest-VolumesTransfersV357Test-1957732239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 1.282s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:16:29 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-603dd2b3-9b19-46dd-9237-0d1eddbe3df9 tempest-VolumesTransfersV357Test-1957732239 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:16:29 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-603dd2b3-9b19-46dd-9237-0d1eddbe3df9 tempest-VolumesTransfersV357Test-1957732239 None] Deleted volume successfully.
Jul 03 01:16:30 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-603dd2b3-9b19-46dd-9237-0d1eddbe3df9 tempest-VolumesTransfersV357Test-1957732239 None] Lock "cinder-d2becbfb-4c94-4d08-afb4-fbcc0962748d-delete_volume" released by "delete_volume" :: held 3.621s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:16:32 devstack sudo[99360]: pam_unix(sudo:session): session closed for user root
Jul 03 01:16:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-fcbdf431-d075-4fd6-91ab-bc959c64a73b tempest-VolumesDeleteCascade-111846741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4ede261e-0fc2-4a29-8dec-5f13fd406565 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-57f77350-647c-4af3-9d55-84d2014f8548" returned: 0 in 5.527s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:16:32 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd52ccf-36f1-4ecc-ab3e-d5c06de1f291]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:16:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-fcbdf431-d075-4fd6-91ab-bc959c64a73b tempest-VolumesDeleteCascade-111846741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4ede261e-0fc2-4a29-8dec-5f13fd406565 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:32 devstack sudo[99383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4ede261e-0fc2-4a29-8dec-5f13fd406565
Jul 03 01:16:32 devstack sudo[99383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:33 devstack sudo[99383]: pam_unix(sudo:session): session closed for user root
Jul 03 01:16:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-fcbdf431-d075-4fd6-91ab-bc959c64a73b tempest-VolumesDeleteCascade-111846741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4ede261e-0fc2-4a29-8dec-5f13fd406565" returned: 0 in 0.959s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:16:33 devstack cinder-volume[86891]: DEBUG cinder.image.image_utils [None req-fcbdf431-d075-4fd6-91ab-bc959c64a73b tempest-VolumesDeleteCascade-111846741 None] Image conversion details: src /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4ede261e-0fc2-4a29-8dec-5f13fd406565, size 1024.00 MB, duration 5.53 sec, destination /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-57f77350-647c-4af3-9d55-84d2014f8548 {{(pid=86891) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 03 01:16:33 devstack cinder-volume[86891]: INFO cinder.image.image_utils [None req-fcbdf431-d075-4fd6-91ab-bc959c64a73b tempest-VolumesDeleteCascade-111846741 None] Converted 1024.00 MB image at 185.22 MB/s
Jul 03 01:16:33 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-fcbdf431-d075-4fd6-91ab-bc959c64a73b tempest-VolumesDeleteCascade-111846741 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-57f77350-647c-4af3-9d55-84d2014f8548 is being set with open permissions: ugo+rw
Jul 03 01:16:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-fcbdf431-d075-4fd6-91ab-bc959c64a73b tempest-VolumesDeleteCascade-111846741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-57f77350-647c-4af3-9d55-84d2014f8548 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:33 devstack sudo[99388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-57f77350-647c-4af3-9d55-84d2014f8548
Jul 03 01:16:33 devstack sudo[99388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:34 devstack sudo[99388]: pam_unix(sudo:session): session closed for user root
Jul 03 01:16:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-fcbdf431-d075-4fd6-91ab-bc959c64a73b tempest-VolumesDeleteCascade-111846741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-57f77350-647c-4af3-9d55-84d2014f8548" returned: 0 in 0.727s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:16:34 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-fcbdf431-d075-4fd6-91ab-bc959c64a73b tempest-VolumesDeleteCascade-111846741 None] Lock "cinder-quobyte-57f77350-647c-4af3-9d55-84d2014f8548" released by "_copy_volume_from_snapshot" :: held 9.081s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:16:34 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-fcbdf431-d075-4fd6-91ab-bc959c64a73b tempest-VolumesDeleteCascade-111846741 None] Lock "cinder-quobyte-ad2d7649-343b-4433-b912-62078383ff06-57f77350-647c-4af3-9d55-84d2014f8548" released by "_create_volume_from_snapshot" :: held 9.119s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:16:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-fcbdf431-d075-4fd6-91ab-bc959c64a73b tempest-VolumesDeleteCascade-111846741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.172s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:16:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-832d5ab8-8a5f-4f9e-98d6-7d8942060152 tempest-VolumesCloneNegativeTest-1482605118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.280s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:16:34 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-832d5ab8-8a5f-4f9e-98d6-7d8942060152 tempest-VolumesCloneNegativeTest-1482605118 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:16:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-91201362',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=747dff76-1aca-41bb-b45a-f4495e858542,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfce688bfc9a4fcf966e7e40e6c1f2a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:16:28Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:16:28Z,use_quota=True,user_id='82e16a71c23c420abac4eb24dc3a6769',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:16:34 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-832d5ab8-8a5f-4f9e-98d6-7d8942060152 tempest-VolumesCloneNegativeTest-1482605118 None] Creating volume 747dff76-1aca-41bb-b45a-f4495e858542 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:16:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-832d5ab8-8a5f-4f9e-98d6-7d8942060152 tempest-VolumesCloneNegativeTest-1482605118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:16:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-832d5ab8-8a5f-4f9e-98d6-7d8942060152 tempest-VolumesCloneNegativeTest-1482605118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:16:34 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-832d5ab8-8a5f-4f9e-98d6-7d8942060152 tempest-VolumesCloneNegativeTest-1482605118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:16:34 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-832d5ab8-8a5f-4f9e-98d6-7d8942060152 tempest-VolumesCloneNegativeTest-1482605118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:16:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-832d5ab8-8a5f-4f9e-98d6-7d8942060152 tempest-VolumesCloneNegativeTest-1482605118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:16:34 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-832d5ab8-8a5f-4f9e-98d6-7d8942060152 tempest-VolumesCloneNegativeTest-1482605118 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:16:34 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-832d5ab8-8a5f-4f9e-98d6-7d8942060152 tempest-VolumesCloneNegativeTest-1482605118 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:16:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-832d5ab8-8a5f-4f9e-98d6-7d8942060152 tempest-VolumesCloneNegativeTest-1482605118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-747dff76-1aca-41bb-b45a-f4495e858542 2147483648 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:34 devstack sudo[99391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-747dff76-1aca-41bb-b45a-f4495e858542 2147483648
Jul 03 01:16:34 devstack sudo[99391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:34 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fcbdf431-d075-4fd6-91ab-bc959c64a73b tempest-VolumesDeleteCascade-111846741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f82bce8-cb51-445b-b011-fefb5e629fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57f77350-647c-4af3-9d55-84d2014f8548', 'volume_size': 1, 'snapshot_id': 'ad2d7649-343b-4433-b912-62078383ff06'}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:16:34 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fcbdf431-d075-4fd6-91ab-bc959c64a73b tempest-VolumesDeleteCascade-111846741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10bcf9fe-edf9-494a-93a6-08cb02fa50e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:16:34 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-fcbdf431-d075-4fd6-91ab-bc959c64a73b tempest-VolumesDeleteCascade-111846741 None] Volume volume-57f77350-647c-4af3-9d55-84d2014f8548 (57f77350-647c-4af3-9d55-84d2014f8548): created successfully
Jul 03 01:16:34 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fcbdf431-d075-4fd6-91ab-bc959c64a73b tempest-VolumesDeleteCascade-111846741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10bcf9fe-edf9-494a-93a6-08cb02fa50e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:16:34 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fcbdf431-d075-4fd6-91ab-bc959c64a73b tempest-VolumesDeleteCascade-111846741 None] Flow 'volume_create_manager' (56726822-a31b-45f7-8854-be5a615c907f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:16:34 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-fcbdf431-d075-4fd6-91ab-bc959c64a73b tempest-VolumesDeleteCascade-111846741 None] Created volume successfully.
Jul 03 01:16:35 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5e9cb5f4-fd76-497a-84a2-f3147534f932 tempest-VolumesDeleteCascade-111846741 None] Acquiring lock "cinder-4ede261e-0fc2-4a29-8dec-5f13fd406565-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:16:35 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5e9cb5f4-fd76-497a-84a2-f3147534f932 tempest-VolumesDeleteCascade-111846741 None] Lock "cinder-4ede261e-0fc2-4a29-8dec-5f13fd406565-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:16:35 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-5e9cb5f4-fd76-497a-84a2-f3147534f932 tempest-VolumesDeleteCascade-111846741 None] Performing cascade delete. {{(pid=86891) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Jul 03 01:16:35 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5e9cb5f4-fd76-497a-84a2-f3147534f932 tempest-VolumesDeleteCascade-111846741 None] Acquiring lock "cinder-ad2d7649-343b-4433-b912-62078383ff06-delete_snapshot" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:16:35 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5e9cb5f4-fd76-497a-84a2-f3147534f932 tempest-VolumesDeleteCascade-111846741 None] Lock "cinder-ad2d7649-343b-4433-b912-62078383ff06-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:16:35 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5e9cb5f4-fd76-497a-84a2-f3147534f932 tempest-VolumesDeleteCascade-111846741 None] Acquiring lock "cinder-quobyte-4ede261e-0fc2-4a29-8dec-5f13fd406565" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:16:35 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5e9cb5f4-fd76-497a-84a2-f3147534f932 tempest-VolumesDeleteCascade-111846741 None] Lock "cinder-quobyte-4ede261e-0fc2-4a29-8dec-5f13fd406565" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:16:35 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5e9cb5f4-fd76-497a-84a2-f3147534f932 tempest-VolumesDeleteCascade-111846741 None] Acquiring lock "cinder-quobyte-ad2d7649-343b-4433-b912-62078383ff06" by "_delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:16:35 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5e9cb5f4-fd76-497a-84a2-f3147534f932 tempest-VolumesDeleteCascade-111846741 None] Lock "cinder-quobyte-ad2d7649-343b-4433-b912-62078383ff06" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:16:35 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-5e9cb5f4-fd76-497a-84a2-f3147534f932 tempest-VolumesDeleteCascade-111846741 None] Deleting offline snapshot ad2d7649-343b-4433-b912-62078383ff06 of volume 4ede261e-0fc2-4a29-8dec-5f13fd406565 {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 01:16:35 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-5e9cb5f4-fd76-497a-84a2-f3147534f932 tempest-VolumesDeleteCascade-111846741 None] snapshot_file for this snap is: volume-4ede261e-0fc2-4a29-8dec-5f13fd406565.ad2d7649-343b-4433-b912-62078383ff06 {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 01:16:35 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e8f7d2-9171-4c27-b037-9cb0e90eb6e8]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:16:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5e9cb5f4-fd76-497a-84a2-f3147534f932 tempest-VolumesDeleteCascade-111846741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4ede261e-0fc2-4a29-8dec-5f13fd406565.ad2d7649-343b-4433-b912-62078383ff06 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:35 devstack sudo[99397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4ede261e-0fc2-4a29-8dec-5f13fd406565.ad2d7649-343b-4433-b912-62078383ff06
Jul 03 01:16:35 devstack sudo[99397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:35 devstack sudo[99391]: pam_unix(sudo:session): session closed for user root
Jul 03 01:16:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-832d5ab8-8a5f-4f9e-98d6-7d8942060152 tempest-VolumesCloneNegativeTest-1482605118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-747dff76-1aca-41bb-b45a-f4495e858542 2147483648" returned: 0 in 0.974s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:16:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-832d5ab8-8a5f-4f9e-98d6-7d8942060152 tempest-VolumesCloneNegativeTest-1482605118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-747dff76-1aca-41bb-b45a-f4495e858542 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:35 devstack sudo[99399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-747dff76-1aca-41bb-b45a-f4495e858542
Jul 03 01:16:35 devstack sudo[99399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:36 devstack sudo[99397]: pam_unix(sudo:session): session closed for user root
Jul 03 01:16:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5e9cb5f4-fd76-497a-84a2-f3147534f932 tempest-VolumesDeleteCascade-111846741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4ede261e-0fc2-4a29-8dec-5f13fd406565.ad2d7649-343b-4433-b912-62078383ff06" returned: 0 in 0.812s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:16:36 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-5e9cb5f4-fd76-497a-84a2-f3147534f932 tempest-VolumesDeleteCascade-111846741 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ede261e-0fc2-4a29-8dec-5f13fd406565(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:16:36 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[8942ee8f-2e6d-4a42-b979-d9b9e10ce596]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:16:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5e9cb5f4-fd76-497a-84a2-f3147534f932 tempest-VolumesDeleteCascade-111846741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4ede261e-0fc2-4a29-8dec-5f13fd406565 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:36 devstack sudo[99399]: pam_unix(sudo:session): session closed for user root
Jul 03 01:16:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-832d5ab8-8a5f-4f9e-98d6-7d8942060152 tempest-VolumesCloneNegativeTest-1482605118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-747dff76-1aca-41bb-b45a-f4495e858542" returned: 0 in 0.709s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:16:36 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-832d5ab8-8a5f-4f9e-98d6-7d8942060152 tempest-VolumesCloneNegativeTest-1482605118 None] <== create_volume: return (1737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:16:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-832d5ab8-8a5f-4f9e-98d6-7d8942060152 tempest-VolumesCloneNegativeTest-1482605118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.740s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:16:36 devstack sudo[99404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4ede261e-0fc2-4a29-8dec-5f13fd406565
Jul 03 01:16:36 devstack sudo[99404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:36 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-832d5ab8-8a5f-4f9e-98d6-7d8942060152 tempest-VolumesCloneNegativeTest-1482605118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09382369-6924-4423-b398-5bfd70acc999) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-747dff76-1aca-41bb-b45a-f4495e858542', 'volume_size': 2}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:16:36 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-832d5ab8-8a5f-4f9e-98d6-7d8942060152 tempest-VolumesCloneNegativeTest-1482605118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfd23fb5-ecbc-4eca-bd88-b65a7c3ddc65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:16:36 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-832d5ab8-8a5f-4f9e-98d6-7d8942060152 tempest-VolumesCloneNegativeTest-1482605118 None] Volume volume-747dff76-1aca-41bb-b45a-f4495e858542 (747dff76-1aca-41bb-b45a-f4495e858542): created successfully
Jul 03 01:16:36 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-832d5ab8-8a5f-4f9e-98d6-7d8942060152 tempest-VolumesCloneNegativeTest-1482605118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfd23fb5-ecbc-4eca-bd88-b65a7c3ddc65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:16:36 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-832d5ab8-8a5f-4f9e-98d6-7d8942060152 tempest-VolumesCloneNegativeTest-1482605118 None] Flow 'volume_create_manager' (75f19bc3-cb6f-4a71-b32c-2741ef8cbe4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:16:36 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-832d5ab8-8a5f-4f9e-98d6-7d8942060152 tempest-VolumesCloneNegativeTest-1482605118 None] Created volume successfully.
Jul 03 01:16:36 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3a1598d-784f-42ea-ad47-78fc08d1b9a7 tempest-VolumesCloneTest-218172247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:16:36 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a3a1598d-784f-42ea-ad47-78fc08d1b9a7 tempest-VolumesCloneTest-218172247 None] Flow 'volume_create_manager' (0e58a243-3c6f-4afd-beb2-a174f02c8f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:16:36 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a3a1598d-784f-42ea-ad47-78fc08d1b9a7 tempest-VolumesCloneTest-218172247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5d3514e-8e02-4921-9046-64e78cb37f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:16:36 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a3a1598d-784f-42ea-ad47-78fc08d1b9a7 tempest-VolumesCloneTest-218172247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5d3514e-8e02-4921-9046-64e78cb37f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:16:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-187890621',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36b7e994-bdb2-444f-9bd3-c6614a01bd5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f196951a3b3543b2adb89fee876be027',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:16:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:16:36Z,use_quota=True,user_id='35bf725b19404e37bc5c78680d599968',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:16:36 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a3a1598d-784f-42ea-ad47-78fc08d1b9a7 tempest-VolumesCloneTest-218172247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e0b2c53-a621-46a6-91bb-125abf5d0364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:16:36 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a3a1598d-784f-42ea-ad47-78fc08d1b9a7 tempest-VolumesCloneTest-218172247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e0b2c53-a621-46a6-91bb-125abf5d0364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:16:36 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a3a1598d-784f-42ea-ad47-78fc08d1b9a7 tempest-VolumesCloneTest-218172247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa653b64-d5f4-434e-aba7-71d1352478ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:16:36 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a3a1598d-784f-42ea-ad47-78fc08d1b9a7 tempest-VolumesCloneTest-218172247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa653b64-d5f4-434e-aba7-71d1352478ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36b7e994-bdb2-444f-9bd3-c6614a01bd5c', 'volume_name': 'volume-36b7e994-bdb2-444f-9bd3-c6614a01bd5c', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:16:36 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a3a1598d-784f-42ea-ad47-78fc08d1b9a7 tempest-VolumesCloneTest-218172247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6b49e01-ff32-40ed-be1e-1d4653b37c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:16:36 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a3a1598d-784f-42ea-ad47-78fc08d1b9a7 tempest-VolumesCloneTest-218172247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6b49e01-ff32-40ed-be1e-1d4653b37c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:16:36 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a3a1598d-784f-42ea-ad47-78fc08d1b9a7 tempest-VolumesCloneTest-218172247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d45728f2-2b1b-4b66-981f-cebe00866595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:16:36 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-a3a1598d-784f-42ea-ad47-78fc08d1b9a7 tempest-VolumesCloneTest-218172247 None] Volume 36b7e994-bdb2-444f-9bd3-c6614a01bd5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36b7e994-bdb2-444f-9bd3-c6614a01bd5c', 'volume_size': 1}
Jul 03 01:16:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a3a1598d-784f-42ea-ad47-78fc08d1b9a7 tempest-VolumesCloneTest-218172247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:16:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a3a1598d-784f-42ea-ad47-78fc08d1b9a7 tempest-VolumesCloneTest-218172247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:16:36 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-a3a1598d-784f-42ea-ad47-78fc08d1b9a7 tempest-VolumesCloneTest-218172247 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:16:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-187890621',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36b7e994-bdb2-444f-9bd3-c6614a01bd5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f196951a3b3543b2adb89fee876be027',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:16:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:16:36Z,use_quota=True,user_id='35bf725b19404e37bc5c78680d599968',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:16:36 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-a3a1598d-784f-42ea-ad47-78fc08d1b9a7 tempest-VolumesCloneTest-218172247 None] Creating volume 36b7e994-bdb2-444f-9bd3-c6614a01bd5c {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:16:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a3a1598d-784f-42ea-ad47-78fc08d1b9a7 tempest-VolumesCloneTest-218172247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:16:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a3a1598d-784f-42ea-ad47-78fc08d1b9a7 tempest-VolumesCloneTest-218172247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:16:36 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-a3a1598d-784f-42ea-ad47-78fc08d1b9a7 tempest-VolumesCloneTest-218172247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:16:36 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-a3a1598d-784f-42ea-ad47-78fc08d1b9a7 tempest-VolumesCloneTest-218172247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:16:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a3a1598d-784f-42ea-ad47-78fc08d1b9a7 tempest-VolumesCloneTest-218172247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:16:36 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-a3a1598d-784f-42ea-ad47-78fc08d1b9a7 tempest-VolumesCloneTest-218172247 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:16:36 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-a3a1598d-784f-42ea-ad47-78fc08d1b9a7 tempest-VolumesCloneTest-218172247 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:16:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a3a1598d-784f-42ea-ad47-78fc08d1b9a7 tempest-VolumesCloneTest-218172247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-36b7e994-bdb2-444f-9bd3-c6614a01bd5c 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:36 devstack sudo[99407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-36b7e994-bdb2-444f-9bd3-c6614a01bd5c 1073741824
Jul 03 01:16:36 devstack sudo[99407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:36 devstack sudo[99404]: pam_unix(sudo:session): session closed for user root
Jul 03 01:16:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5e9cb5f4-fd76-497a-84a2-f3147534f932 tempest-VolumesDeleteCascade-111846741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4ede261e-0fc2-4a29-8dec-5f13fd406565" returned: 0 in 0.777s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:16:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5e9cb5f4-fd76-497a-84a2-f3147534f932 tempest-VolumesDeleteCascade-111846741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4ede261e-0fc2-4a29-8dec-5f13fd406565.ad2d7649-343b-4433-b912-62078383ff06 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:36 devstack sudo[99412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4ede261e-0fc2-4a29-8dec-5f13fd406565.ad2d7649-343b-4433-b912-62078383ff06
Jul 03 01:16:36 devstack sudo[99412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:37 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-76d81bb6-1e0a-485f-9d6c-70f59fa1abcd tempest-VolumesCloneNegativeTest-1482605118 None] Acquiring lock "cinder-747dff76-1aca-41bb-b45a-f4495e858542-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:16:37 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-76d81bb6-1e0a-485f-9d6c-70f59fa1abcd tempest-VolumesCloneNegativeTest-1482605118 None] Lock "cinder-747dff76-1aca-41bb-b45a-f4495e858542-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:16:37 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-76d81bb6-1e0a-485f-9d6c-70f59fa1abcd tempest-VolumesCloneNegativeTest-1482605118 None] Acquiring lock "cinder-quobyte-747dff76-1aca-41bb-b45a-f4495e858542" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:16:37 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-76d81bb6-1e0a-485f-9d6c-70f59fa1abcd tempest-VolumesCloneNegativeTest-1482605118 None] Lock "cinder-quobyte-747dff76-1aca-41bb-b45a-f4495e858542" acquired by "delete_volume" :: waited 0.019s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:16:37 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[22bd24d9-3dce-4d11-b153-aa034da2d038]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:16:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-76d81bb6-1e0a-485f-9d6c-70f59fa1abcd tempest-VolumesCloneNegativeTest-1482605118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-747dff76-1aca-41bb-b45a-f4495e858542 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:37 devstack sudo[99418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-747dff76-1aca-41bb-b45a-f4495e858542
Jul 03 01:16:37 devstack sudo[99418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:37 devstack sudo[99407]: pam_unix(sudo:session): session closed for user root
Jul 03 01:16:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a3a1598d-784f-42ea-ad47-78fc08d1b9a7 tempest-VolumesCloneTest-218172247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-36b7e994-bdb2-444f-9bd3-c6614a01bd5c 1073741824" returned: 0 in 0.968s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:16:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a3a1598d-784f-42ea-ad47-78fc08d1b9a7 tempest-VolumesCloneTest-218172247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-36b7e994-bdb2-444f-9bd3-c6614a01bd5c {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:37 devstack sudo[99423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-36b7e994-bdb2-444f-9bd3-c6614a01bd5c
Jul 03 01:16:37 devstack sudo[99423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:37 devstack sudo[99412]: pam_unix(sudo:session): session closed for user root
Jul 03 01:16:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5e9cb5f4-fd76-497a-84a2-f3147534f932 tempest-VolumesDeleteCascade-111846741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4ede261e-0fc2-4a29-8dec-5f13fd406565.ad2d7649-343b-4433-b912-62078383ff06" returned: 0 in 0.757s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:16:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5e9cb5f4-fd76-497a-84a2-f3147534f932 tempest-VolumesDeleteCascade-111846741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4ede261e-0fc2-4a29-8dec-5f13fd406565.ad2d7649-343b-4433-b912-62078383ff06 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:37 devstack sudo[99425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4ede261e-0fc2-4a29-8dec-5f13fd406565.ad2d7649-343b-4433-b912-62078383ff06
Jul 03 01:16:37 devstack sudo[99425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:38 devstack sudo[99418]: pam_unix(sudo:session): session closed for user root
Jul 03 01:16:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-76d81bb6-1e0a-485f-9d6c-70f59fa1abcd tempest-VolumesCloneNegativeTest-1482605118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-747dff76-1aca-41bb-b45a-f4495e858542" returned: 0 in 0.832s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:16:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-76d81bb6-1e0a-485f-9d6c-70f59fa1abcd tempest-VolumesCloneNegativeTest-1482605118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-747dff76-1aca-41bb-b45a-f4495e858542 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:38 devstack sudo[99431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-747dff76-1aca-41bb-b45a-f4495e858542
Jul 03 01:16:38 devstack sudo[99431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:38 devstack sudo[99423]: pam_unix(sudo:session): session closed for user root
Jul 03 01:16:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a3a1598d-784f-42ea-ad47-78fc08d1b9a7 tempest-VolumesCloneTest-218172247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-36b7e994-bdb2-444f-9bd3-c6614a01bd5c" returned: 0 in 0.654s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:16:38 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-a3a1598d-784f-42ea-ad47-78fc08d1b9a7 tempest-VolumesCloneTest-218172247 None] <== create_volume: return (1668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:16:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a3a1598d-784f-42ea-ad47-78fc08d1b9a7 tempest-VolumesCloneTest-218172247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.670s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:16:38 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a3a1598d-784f-42ea-ad47-78fc08d1b9a7 tempest-VolumesCloneTest-218172247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d45728f2-2b1b-4b66-981f-cebe00866595) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36b7e994-bdb2-444f-9bd3-c6614a01bd5c', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:16:38 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a3a1598d-784f-42ea-ad47-78fc08d1b9a7 tempest-VolumesCloneTest-218172247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c22dadd4-89b9-4a39-9c17-c189bf1465c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:16:38 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-a3a1598d-784f-42ea-ad47-78fc08d1b9a7 tempest-VolumesCloneTest-218172247 None] Volume volume-36b7e994-bdb2-444f-9bd3-c6614a01bd5c (36b7e994-bdb2-444f-9bd3-c6614a01bd5c): created successfully
Jul 03 01:16:38 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a3a1598d-784f-42ea-ad47-78fc08d1b9a7 tempest-VolumesCloneTest-218172247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c22dadd4-89b9-4a39-9c17-c189bf1465c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:16:38 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a3a1598d-784f-42ea-ad47-78fc08d1b9a7 tempest-VolumesCloneTest-218172247 None] Flow 'volume_create_manager' (0e58a243-3c6f-4afd-beb2-a174f02c8f02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:16:38 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-a3a1598d-784f-42ea-ad47-78fc08d1b9a7 tempest-VolumesCloneTest-218172247 None] Created volume successfully.
Jul 03 01:16:38 devstack sudo[99425]: pam_unix(sudo:session): session closed for user root
Jul 03 01:16:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5e9cb5f4-fd76-497a-84a2-f3147534f932 tempest-VolumesDeleteCascade-111846741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4ede261e-0fc2-4a29-8dec-5f13fd406565.ad2d7649-343b-4433-b912-62078383ff06" returned: 0 in 0.668s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:16:38 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5e9cb5f4-fd76-497a-84a2-f3147534f932 tempest-VolumesDeleteCascade-111846741 None] Lock "cinder-quobyte-ad2d7649-343b-4433-b912-62078383ff06" released by "_delete_snapshot" :: held 3.155s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:16:38 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5e9cb5f4-fd76-497a-84a2-f3147534f932 tempest-VolumesDeleteCascade-111846741 None] Lock "cinder-quobyte-4ede261e-0fc2-4a29-8dec-5f13fd406565" released by "delete_snapshot" :: held 3.181s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:16:38 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-5e9cb5f4-fd76-497a-84a2-f3147534f932 tempest-VolumesDeleteCascade-111846741 None] Created reservations ['a838d1cb-7b5e-417a-847b-8ca602d55603', 'a2fd1a3d-7f13-4e1f-b6cd-6eb0ada1ccea', '63859e33-4f1a-40ee-9fe8-e5fb17c4edbc', '301951e4-f401-4e24-b6cf-f2b8b5b73e6c'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:16:38 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-5e9cb5f4-fd76-497a-84a2-f3147534f932 tempest-VolumesDeleteCascade-111846741 None] Delete snapshot completed successfully.
Jul 03 01:16:38 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5e9cb5f4-fd76-497a-84a2-f3147534f932 tempest-VolumesDeleteCascade-111846741 None] Lock "cinder-ad2d7649-343b-4433-b912-62078383ff06-delete_snapshot" released by "delete_snapshot" :: held 3.361s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:16:38 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-5e9cb5f4-fd76-497a-84a2-f3147534f932 tempest-VolumesDeleteCascade-111846741 None] Snapshots deleted, issuing volume delete {{(pid=86891) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Jul 03 01:16:38 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5e9cb5f4-fd76-497a-84a2-f3147534f932 tempest-VolumesDeleteCascade-111846741 None] Acquiring lock "cinder-quobyte-4ede261e-0fc2-4a29-8dec-5f13fd406565" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:16:38 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5e9cb5f4-fd76-497a-84a2-f3147534f932 tempest-VolumesDeleteCascade-111846741 None] Lock "cinder-quobyte-4ede261e-0fc2-4a29-8dec-5f13fd406565" acquired by "delete_volume" :: waited 0.019s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:16:38 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5def940-c91e-4897-9ed3-6a41a116752e]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:16:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5e9cb5f4-fd76-497a-84a2-f3147534f932 tempest-VolumesDeleteCascade-111846741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4ede261e-0fc2-4a29-8dec-5f13fd406565 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:38 devstack sudo[99435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4ede261e-0fc2-4a29-8dec-5f13fd406565
Jul 03 01:16:38 devstack sudo[99435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:38 devstack sudo[99431]: pam_unix(sudo:session): session closed for user root
Jul 03 01:16:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-76d81bb6-1e0a-485f-9d6c-70f59fa1abcd tempest-VolumesCloneNegativeTest-1482605118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-747dff76-1aca-41bb-b45a-f4495e858542" returned: 0 in 0.742s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:16:38 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-76d81bb6-1e0a-485f-9d6c-70f59fa1abcd tempest-VolumesCloneNegativeTest-1482605118 None] Lock "cinder-quobyte-747dff76-1aca-41bb-b45a-f4495e858542" released by "delete_volume" :: held 1.628s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:16:38 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-76d81bb6-1e0a-485f-9d6c-70f59fa1abcd tempest-VolumesCloneNegativeTest-1482605118 None] Created reservations ['6d6f5d7e-0b37-4a90-8fe0-e37a0c5d14ca', '880ddafc-49d3-4b2d-901e-b863b703d707', '606230fb-efca-431c-937a-31da9c3c18bd', 'fb865b8e-92a8-4548-8711-ef98602ad544'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:16:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-76d81bb6-1e0a-485f-9d6c-70f59fa1abcd tempest-VolumesCloneNegativeTest-1482605118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:16:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-76d81bb6-1e0a-485f-9d6c-70f59fa1abcd tempest-VolumesCloneNegativeTest-1482605118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:16:39 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-76d81bb6-1e0a-485f-9d6c-70f59fa1abcd tempest-VolumesCloneNegativeTest-1482605118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:16:39 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-76d81bb6-1e0a-485f-9d6c-70f59fa1abcd tempest-VolumesCloneNegativeTest-1482605118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:16:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-76d81bb6-1e0a-485f-9d6c-70f59fa1abcd tempest-VolumesCloneNegativeTest-1482605118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:16:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-76d81bb6-1e0a-485f-9d6c-70f59fa1abcd tempest-VolumesCloneNegativeTest-1482605118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:39 devstack sudo[99438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:16:39 devstack sudo[99438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:39 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:16:39 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] Flow 'volume_create_manager' (7e400580-a239-42c3-85df-62cb5f84034a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:16:39 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bd2ee1d-6a90-4f17-8160-c6afa5b78291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:16:39 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bd2ee1d-6a90-4f17-8160-c6afa5b78291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:16:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1709510408',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d71a700c-f70a-42c5-929f-42769c0f4d4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f196951a3b3543b2adb89fee876be027',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:16:39Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=36b7e994-bdb2-444f-9bd3-c6614a01bd5c,status='creating',terminated_at=None,updated_at=2026-07-02T23:16:39Z,use_quota=True,user_id='35bf725b19404e37bc5c78680d599968',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:16:39 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d0d6fc7-88f3-4eca-a277-196ee7a0c0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:16:39 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d0d6fc7-88f3-4eca-a277-196ee7a0c0d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:16:39 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d52af232-6f33-4d5e-aba3-de1170194e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:16:39 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d52af232-6f33-4d5e-aba3-de1170194e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'd71a700c-f70a-42c5-929f-42769c0f4d4c', 'volume_name': 'volume-d71a700c-f70a-42c5-929f-42769c0f4d4c', 'volume_size': 2, 'source_volid': '36b7e994-bdb2-444f-9bd3-c6614a01bd5c', 'source_volstatus': 'available'}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:16:39 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92143550-b101-4ad3-9548-f2bdb58ddfe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:16:39 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92143550-b101-4ad3-9548-f2bdb58ddfe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:16:39 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2854cef9-1733-4a7f-a616-8ae5f377bc17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:16:39 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] Volume d71a700c-f70a-42c5-929f-42769c0f4d4c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-d71a700c-f70a-42c5-929f-42769c0f4d4c', 'volume_size': 2, 'source_volid': '36b7e994-bdb2-444f-9bd3-c6614a01bd5c', 'source_volstatus': 'available'}
Jul 03 01:16:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:16:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:16:39 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] Cloning volume 36b7e994-bdb2-444f-9bd3-c6614a01bd5c to volume d71a700c-f70a-42c5-929f-42769c0f4d4c
Jul 03 01:16:39 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] Creating offline snapshot e3fa0d82-85d0-44ef-a95d-8acb3b600ec6 of volume 36b7e994-bdb2-444f-9bd3-c6614a01bd5c {{(pid=86891) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 01:16:39 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[11969b88-3cb7-4601-81c0-82c903008626]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:16:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-36b7e994-bdb2-444f-9bd3-c6614a01bd5c {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:39 devstack sudo[99435]: pam_unix(sudo:session): session closed for user root
Jul 03 01:16:39 devstack sudo[99442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-36b7e994-bdb2-444f-9bd3-c6614a01bd5c
Jul 03 01:16:39 devstack sudo[99442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5e9cb5f4-fd76-497a-84a2-f3147534f932 tempest-VolumesDeleteCascade-111846741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4ede261e-0fc2-4a29-8dec-5f13fd406565" returned: 0 in 0.839s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:16:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5e9cb5f4-fd76-497a-84a2-f3147534f932 tempest-VolumesDeleteCascade-111846741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4ede261e-0fc2-4a29-8dec-5f13fd406565 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:39 devstack sudo[99445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4ede261e-0fc2-4a29-8dec-5f13fd406565
Jul 03 01:16:39 devstack sudo[99445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:39 devstack sudo[99438]: pam_unix(sudo:session): session closed for user root
Jul 03 01:16:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-76d81bb6-1e0a-485f-9d6c-70f59fa1abcd tempest-VolumesCloneNegativeTest-1482605118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.746s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:16:39 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-76d81bb6-1e0a-485f-9d6c-70f59fa1abcd tempest-VolumesCloneNegativeTest-1482605118 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:16:39 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-76d81bb6-1e0a-485f-9d6c-70f59fa1abcd tempest-VolumesCloneNegativeTest-1482605118 None] Deleted volume successfully.
Jul 03 01:16:39 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-76d81bb6-1e0a-485f-9d6c-70f59fa1abcd tempest-VolumesCloneNegativeTest-1482605118 None] Lock "cinder-747dff76-1aca-41bb-b45a-f4495e858542-delete_volume" released by "delete_volume" :: held 2.624s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:16:40 devstack sudo[99442]: pam_unix(sudo:session): session closed for user root
Jul 03 01:16:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-36b7e994-bdb2-444f-9bd3-c6614a01bd5c" returned: 0 in 0.888s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:16:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-36b7e994-bdb2-444f-9bd3-c6614a01bd5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-36b7e994-bdb2-444f-9bd3-c6614a01bd5c.e3fa0d82-85d0-44ef-a95d-8acb3b600ec6 1G {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:40 devstack sudo[99458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-36b7e994-bdb2-444f-9bd3-c6614a01bd5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-36b7e994-bdb2-444f-9bd3-c6614a01bd5c.e3fa0d82-85d0-44ef-a95d-8acb3b600ec6 1G
Jul 03 01:16:40 devstack sudo[99458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:40 devstack sudo[99445]: pam_unix(sudo:session): session closed for user root
Jul 03 01:16:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5e9cb5f4-fd76-497a-84a2-f3147534f932 tempest-VolumesDeleteCascade-111846741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4ede261e-0fc2-4a29-8dec-5f13fd406565" returned: 0 in 0.822s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:16:40 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5e9cb5f4-fd76-497a-84a2-f3147534f932 tempest-VolumesDeleteCascade-111846741 None] Lock "cinder-quobyte-4ede261e-0fc2-4a29-8dec-5f13fd406565" released by "delete_volume" :: held 1.727s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:16:40 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-5e9cb5f4-fd76-497a-84a2-f3147534f932 tempest-VolumesDeleteCascade-111846741 None] Created reservations ['de366bcf-8282-42a3-bc62-fcd7b93482ce', '1819dff4-167c-4ead-b997-96cdbbe5260b', '57b38db0-e5e1-4d5f-a46f-c478020b7021', '0be04ac1-58a8-460a-b526-b9c351a8da0e'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:16:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-5e9cb5f4-fd76-497a-84a2-f3147534f932 tempest-VolumesDeleteCascade-111846741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:16:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-5e9cb5f4-fd76-497a-84a2-f3147534f932 tempest-VolumesDeleteCascade-111846741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:16:40 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-5e9cb5f4-fd76-497a-84a2-f3147534f932 tempest-VolumesDeleteCascade-111846741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:16:40 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-5e9cb5f4-fd76-497a-84a2-f3147534f932 tempest-VolumesDeleteCascade-111846741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:16:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-5e9cb5f4-fd76-497a-84a2-f3147534f932 tempest-VolumesDeleteCascade-111846741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:16:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5e9cb5f4-fd76-497a-84a2-f3147534f932 tempest-VolumesDeleteCascade-111846741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:40 devstack sudo[99460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:16:40 devstack sudo[99460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:40 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-767c00ae-57eb-440f-afc8-f4216660f9aa tempest-VolumesDeleteCascade-111846741 None] Acquiring lock "cinder-57f77350-647c-4af3-9d55-84d2014f8548-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:16:40 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-767c00ae-57eb-440f-afc8-f4216660f9aa tempest-VolumesDeleteCascade-111846741 None] Lock "cinder-57f77350-647c-4af3-9d55-84d2014f8548-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:16:40 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-767c00ae-57eb-440f-afc8-f4216660f9aa tempest-VolumesDeleteCascade-111846741 None] Acquiring lock "cinder-quobyte-57f77350-647c-4af3-9d55-84d2014f8548" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:16:40 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-767c00ae-57eb-440f-afc8-f4216660f9aa tempest-VolumesDeleteCascade-111846741 None] Lock "cinder-quobyte-57f77350-647c-4af3-9d55-84d2014f8548" acquired by "delete_volume" :: waited 0.017s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:16:40 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8babbb5-00b0-489d-9b22-add702ddf1d0]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:16:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-767c00ae-57eb-440f-afc8-f4216660f9aa tempest-VolumesDeleteCascade-111846741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-57f77350-647c-4af3-9d55-84d2014f8548 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:41 devstack sudo[99465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-57f77350-647c-4af3-9d55-84d2014f8548
Jul 03 01:16:41 devstack sudo[99465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:41 devstack sudo[99458]: pam_unix(sudo:session): session closed for user root
Jul 03 01:16:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-36b7e994-bdb2-444f-9bd3-c6614a01bd5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-36b7e994-bdb2-444f-9bd3-c6614a01bd5c.e3fa0d82-85d0-44ef-a95d-8acb3b600ec6 1G" returned: 0 in 0.999s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:16:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36b7e994-bdb2-444f-9bd3-c6614a01bd5c -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-36b7e994-bdb2-444f-9bd3-c6614a01bd5c.e3fa0d82-85d0-44ef-a95d-8acb3b600ec6 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:41 devstack sudo[99469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36b7e994-bdb2-444f-9bd3-c6614a01bd5c -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-36b7e994-bdb2-444f-9bd3-c6614a01bd5c.e3fa0d82-85d0-44ef-a95d-8acb3b600ec6
Jul 03 01:16:41 devstack sudo[99469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:41 devstack sudo[99460]: pam_unix(sudo:session): session closed for user root
Jul 03 01:16:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5e9cb5f4-fd76-497a-84a2-f3147534f932 tempest-VolumesDeleteCascade-111846741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.828s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:16:41 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-5e9cb5f4-fd76-497a-84a2-f3147534f932 tempest-VolumesDeleteCascade-111846741 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:16:41 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-5e9cb5f4-fd76-497a-84a2-f3147534f932 tempest-VolumesDeleteCascade-111846741 None] Deleted volume successfully.
Jul 03 01:16:41 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5e9cb5f4-fd76-497a-84a2-f3147534f932 tempest-VolumesDeleteCascade-111846741 None] Lock "cinder-4ede261e-0fc2-4a29-8dec-5f13fd406565-delete_volume" released by "delete_volume" :: held 6.173s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:16:41 devstack sudo[99465]: pam_unix(sudo:session): session closed for user root
Jul 03 01:16:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-767c00ae-57eb-440f-afc8-f4216660f9aa tempest-VolumesDeleteCascade-111846741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-57f77350-647c-4af3-9d55-84d2014f8548" returned: 0 in 0.876s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:16:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-767c00ae-57eb-440f-afc8-f4216660f9aa tempest-VolumesDeleteCascade-111846741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-57f77350-647c-4af3-9d55-84d2014f8548 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:41 devstack sudo[99477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-57f77350-647c-4af3-9d55-84d2014f8548
Jul 03 01:16:41 devstack sudo[99477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:41 devstack sudo[99469]: pam_unix(sudo:session): session closed for user root
Jul 03 01:16:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36b7e994-bdb2-444f-9bd3-c6614a01bd5c -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-36b7e994-bdb2-444f-9bd3-c6614a01bd5c.e3fa0d82-85d0-44ef-a95d-8acb3b600ec6" returned: 0 in 0.721s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:16:41 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-36b7e994-bdb2-444f-9bd3-c6614a01bd5c.e3fa0d82-85d0-44ef-a95d-8acb3b600ec6 is being set with open permissions: ugo+rw
Jul 03 01:16:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-36b7e994-bdb2-444f-9bd3-c6614a01bd5c.e3fa0d82-85d0-44ef-a95d-8acb3b600ec6 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:41 devstack sudo[99479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-36b7e994-bdb2-444f-9bd3-c6614a01bd5c.e3fa0d82-85d0-44ef-a95d-8acb3b600ec6
Jul 03 01:16:41 devstack sudo[99479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:42 devstack sudo[99477]: pam_unix(sudo:session): session closed for user root
Jul 03 01:16:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-767c00ae-57eb-440f-afc8-f4216660f9aa tempest-VolumesDeleteCascade-111846741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-57f77350-647c-4af3-9d55-84d2014f8548" returned: 0 in 0.677s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:16:42 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-767c00ae-57eb-440f-afc8-f4216660f9aa tempest-VolumesDeleteCascade-111846741 None] Lock "cinder-quobyte-57f77350-647c-4af3-9d55-84d2014f8548" released by "delete_volume" :: held 1.605s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:16:42 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-767c00ae-57eb-440f-afc8-f4216660f9aa tempest-VolumesDeleteCascade-111846741 None] Created reservations ['5fbdb962-70f9-47d1-b7de-a1693f4ccde0', '7e459425-fb56-4f08-aa5d-57b136fa4ab5', '02a434e5-6ce7-4e23-9e26-e160a8f6ce60', 'dd8e39b1-a1d0-415b-8c02-1c708aa4bf3c'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:16:42 devstack sudo[99479]: pam_unix(sudo:session): session closed for user root
Jul 03 01:16:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-36b7e994-bdb2-444f-9bd3-c6614a01bd5c.e3fa0d82-85d0-44ef-a95d-8acb3b600ec6" returned: 0 in 0.715s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:16:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-36b7e994-bdb2-444f-9bd3-c6614a01bd5c.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-767c00ae-57eb-440f-afc8-f4216660f9aa tempest-VolumesDeleteCascade-111846741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:16:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-767c00ae-57eb-440f-afc8-f4216660f9aa tempest-VolumesDeleteCascade-111846741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:16:42 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-767c00ae-57eb-440f-afc8-f4216660f9aa tempest-VolumesDeleteCascade-111846741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:16:42 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-767c00ae-57eb-440f-afc8-f4216660f9aa tempest-VolumesDeleteCascade-111846741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:16:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-767c00ae-57eb-440f-afc8-f4216660f9aa tempest-VolumesDeleteCascade-111846741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:16:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-767c00ae-57eb-440f-afc8-f4216660f9aa tempest-VolumesDeleteCascade-111846741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:42 devstack sudo[99483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-36b7e994-bdb2-444f-9bd3-c6614a01bd5c.info
Jul 03 01:16:42 devstack sudo[99483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:42 devstack sudo[99484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:16:42 devstack sudo[99484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:43 devstack sudo[99484]: pam_unix(sudo:session): session closed for user root
Jul 03 01:16:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-767c00ae-57eb-440f-afc8-f4216660f9aa tempest-VolumesDeleteCascade-111846741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.732s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:16:43 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-767c00ae-57eb-440f-afc8-f4216660f9aa tempest-VolumesDeleteCascade-111846741 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:16:43 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-767c00ae-57eb-440f-afc8-f4216660f9aa tempest-VolumesDeleteCascade-111846741 None] Deleted volume successfully.
Jul 03 01:16:43 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-767c00ae-57eb-440f-afc8-f4216660f9aa tempest-VolumesDeleteCascade-111846741 None] Lock "cinder-57f77350-647c-4af3-9d55-84d2014f8548-delete_volume" released by "delete_volume" :: held 2.637s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:16:43 devstack sudo[99483]: pam_unix(sudo:session): session closed for user root
Jul 03 01:16:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-36b7e994-bdb2-444f-9bd3-c6614a01bd5c.info" returned: 0 in 0.833s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:16:43 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-36b7e994-bdb2-444f-9bd3-c6614a01bd5c.info is being set with open permissions: ugo+rw
Jul 03 01:16:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-36b7e994-bdb2-444f-9bd3-c6614a01bd5c.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:43 devstack sudo[99489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-36b7e994-bdb2-444f-9bd3-c6614a01bd5c.info
Jul 03 01:16:43 devstack sudo[99489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:44 devstack sudo[99489]: pam_unix(sudo:session): session closed for user root
Jul 03 01:16:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-36b7e994-bdb2-444f-9bd3-c6614a01bd5c.info" returned: 0 in 0.724s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:16:44 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] Acquiring lock "cinder-quobyte-d71a700c-f70a-42c5-929f-42769c0f4d4c" by "_copy_volume_from_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:16:44 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] Lock "cinder-quobyte-d71a700c-f70a-42c5-929f-42769c0f4d4c" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:16:44 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] snapshot: e3fa0d82-85d0-44ef-a95d-8acb3b600ec6, volume: d71a700c-f70a-42c5-929f-42769c0f4d4c,  {{(pid=86891) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 03 01:16:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:16:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:16:44 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:16:44 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:16:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:16:44 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[62dd0904-d635-4a47-a0dc-aa14d8c5e5d5]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:16:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-36b7e994-bdb2-444f-9bd3-c6614a01bd5c.e3fa0d82-85d0-44ef-a95d-8acb3b600ec6 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:44 devstack sudo[99492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-36b7e994-bdb2-444f-9bd3-c6614a01bd5c.e3fa0d82-85d0-44ef-a95d-8acb3b600ec6
Jul 03 01:16:44 devstack sudo[99492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:45 devstack sudo[99492]: pam_unix(sudo:session): session closed for user root
Jul 03 01:16:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-36b7e994-bdb2-444f-9bd3-c6614a01bd5c.e3fa0d82-85d0-44ef-a95d-8acb3b600ec6" returned: 0 in 0.851s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:16:45 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36b7e994-bdb2-444f-9bd3-c6614a01bd5c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:16:45 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] will copy from snapshot at /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-36b7e994-bdb2-444f-9bd3-c6614a01bd5c {{(pid=86891) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 03 01:16:45 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] Creating direct copy from snapshot {{(pid=86891) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 03 01:16:45 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e8b9ff-c6c5-4440-a2b6-b222413e8870]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:16:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-36b7e994-bdb2-444f-9bd3-c6614a01bd5c {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:45 devstack sudo[99497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-36b7e994-bdb2-444f-9bd3-c6614a01bd5c
Jul 03 01:16:45 devstack sudo[99497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:46 devstack sudo[99497]: pam_unix(sudo:session): session closed for user root
Jul 03 01:16:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-36b7e994-bdb2-444f-9bd3-c6614a01bd5c" returned: 0 in 0.880s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:16:46 devstack cinder-volume[86891]: DEBUG cinder.utils [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] Path /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d71a700c-f70a-42c5-929f-42769c0f4d4c not found in is_blk_device check {{(pid=86891) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 03 01:16:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-36b7e994-bdb2-444f-9bd3-c6614a01bd5c /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d71a700c-f70a-42c5-929f-42769c0f4d4c {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:46 devstack sudo[99502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-36b7e994-bdb2-444f-9bd3-c6614a01bd5c /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d71a700c-f70a-42c5-929f-42769c0f4d4c
Jul 03 01:16:46 devstack sudo[99502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:50 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d92981a-9a96-452c-bd6e-5c94dc71ec53 tempest-VolumesTransfersV355Test-1577619451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:16:50 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-2d92981a-9a96-452c-bd6e-5c94dc71ec53 tempest-VolumesTransfersV355Test-1577619451 None] Flow 'volume_create_manager' (0e62fa22-0a32-422c-a1b8-101b28e8952b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:16:50 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-2d92981a-9a96-452c-bd6e-5c94dc71ec53 tempest-VolumesTransfersV355Test-1577619451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (386793b8-aa97-498c-aa77-bb2d5db4c725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:16:50 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-2d92981a-9a96-452c-bd6e-5c94dc71ec53 tempest-VolumesTransfersV355Test-1577619451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (386793b8-aa97-498c-aa77-bb2d5db4c725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:16:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1746399573',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d45e960a-516b-40a8-b9e2-68ac21471d15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a3d8ae243404ea095845b9b76608c65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:16:50Z,use_quota=True,user_id='0ff99c382a3b4262b02c8fb791b281c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:16:50 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-2d92981a-9a96-452c-bd6e-5c94dc71ec53 tempest-VolumesTransfersV355Test-1577619451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ce4dc5c-a6b6-4cf8-96dc-d9c5a101524f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:16:50 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-2d92981a-9a96-452c-bd6e-5c94dc71ec53 tempest-VolumesTransfersV355Test-1577619451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ce4dc5c-a6b6-4cf8-96dc-d9c5a101524f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:16:50 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-2d92981a-9a96-452c-bd6e-5c94dc71ec53 tempest-VolumesTransfersV355Test-1577619451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c4da0d9-2854-4aed-9ac5-7292429e160f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:16:50 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-2d92981a-9a96-452c-bd6e-5c94dc71ec53 tempest-VolumesTransfersV355Test-1577619451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c4da0d9-2854-4aed-9ac5-7292429e160f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd45e960a-516b-40a8-b9e2-68ac21471d15', 'volume_name': 'volume-d45e960a-516b-40a8-b9e2-68ac21471d15', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:16:50 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-2d92981a-9a96-452c-bd6e-5c94dc71ec53 tempest-VolumesTransfersV355Test-1577619451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (844fb013-b561-4a33-8290-3f597e7289db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:16:50 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-2d92981a-9a96-452c-bd6e-5c94dc71ec53 tempest-VolumesTransfersV355Test-1577619451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (844fb013-b561-4a33-8290-3f597e7289db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:16:50 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-2d92981a-9a96-452c-bd6e-5c94dc71ec53 tempest-VolumesTransfersV355Test-1577619451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1691d266-7876-4c5d-a143-0a4dd8fd6a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:16:50 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-2d92981a-9a96-452c-bd6e-5c94dc71ec53 tempest-VolumesTransfersV355Test-1577619451 None] Volume d45e960a-516b-40a8-b9e2-68ac21471d15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d45e960a-516b-40a8-b9e2-68ac21471d15', 'volume_size': 1}
Jul 03 01:16:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-2d92981a-9a96-452c-bd6e-5c94dc71ec53 tempest-VolumesTransfersV355Test-1577619451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:16:52 devstack sudo[99502]: pam_unix(sudo:session): session closed for user root
Jul 03 01:16:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-36b7e994-bdb2-444f-9bd3-c6614a01bd5c /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d71a700c-f70a-42c5-929f-42769c0f4d4c" returned: 0 in 5.919s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:16:52 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b2394f8-5a81-4ccf-956d-5a2195dab60b]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:16:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-36b7e994-bdb2-444f-9bd3-c6614a01bd5c {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:52 devstack sudo[99516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-36b7e994-bdb2-444f-9bd3-c6614a01bd5c
Jul 03 01:16:52 devstack sudo[99516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:53 devstack sudo[99516]: pam_unix(sudo:session): session closed for user root
Jul 03 01:16:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-36b7e994-bdb2-444f-9bd3-c6614a01bd5c" returned: 0 in 0.991s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:16:53 devstack cinder-volume[86891]: DEBUG cinder.image.image_utils [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] Image conversion details: src /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-36b7e994-bdb2-444f-9bd3-c6614a01bd5c, size 1024.00 MB, duration 5.92 sec, destination /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d71a700c-f70a-42c5-929f-42769c0f4d4c {{(pid=86891) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 03 01:16:53 devstack cinder-volume[86891]: INFO cinder.image.image_utils [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] Converted 1024.00 MB image at 172.99 MB/s
Jul 03 01:16:53 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d71a700c-f70a-42c5-929f-42769c0f4d4c is being set with open permissions: ugo+rw
Jul 03 01:16:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d71a700c-f70a-42c5-929f-42769c0f4d4c {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:53 devstack sudo[99522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d71a700c-f70a-42c5-929f-42769c0f4d4c
Jul 03 01:16:53 devstack sudo[99522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:53 devstack sudo[99522]: pam_unix(sudo:session): session closed for user root
Jul 03 01:16:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d71a700c-f70a-42c5-929f-42769c0f4d4c" returned: 0 in 0.667s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:16:53 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] Lock "cinder-quobyte-d71a700c-f70a-42c5-929f-42769c0f4d4c" released by "_copy_volume_from_snapshot" :: held 9.420s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:16:53 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] Acquiring lock "cinder-quobyte-e3fa0d82-85d0-44ef-a95d-8acb3b600ec6" by "_delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:16:53 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] Lock "cinder-quobyte-e3fa0d82-85d0-44ef-a95d-8acb3b600ec6" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:16:53 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] Deleting offline snapshot e3fa0d82-85d0-44ef-a95d-8acb3b600ec6 of volume 36b7e994-bdb2-444f-9bd3-c6614a01bd5c {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 01:16:53 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] snapshot_file for this snap is: volume-36b7e994-bdb2-444f-9bd3-c6614a01bd5c.e3fa0d82-85d0-44ef-a95d-8acb3b600ec6 {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 01:16:53 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[3811c709-28e7-4caf-a241-1ea5888984df]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:16:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-36b7e994-bdb2-444f-9bd3-c6614a01bd5c.e3fa0d82-85d0-44ef-a95d-8acb3b600ec6 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:53 devstack sudo[99525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-36b7e994-bdb2-444f-9bd3-c6614a01bd5c.e3fa0d82-85d0-44ef-a95d-8acb3b600ec6
Jul 03 01:16:53 devstack sudo[99525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:54 devstack sudo[99525]: pam_unix(sudo:session): session closed for user root
Jul 03 01:16:54 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-36b7e994-bdb2-444f-9bd3-c6614a01bd5c.e3fa0d82-85d0-44ef-a95d-8acb3b600ec6" returned: 0 in 0.830s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:16:54 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36b7e994-bdb2-444f-9bd3-c6614a01bd5c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:16:54 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[7adc705f-f3de-45ee-af79-cd128a29228f]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:16:54 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-36b7e994-bdb2-444f-9bd3-c6614a01bd5c {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:54 devstack sudo[99530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-36b7e994-bdb2-444f-9bd3-c6614a01bd5c
Jul 03 01:16:54 devstack sudo[99530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:55 devstack sudo[99530]: pam_unix(sudo:session): session closed for user root
Jul 03 01:16:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-36b7e994-bdb2-444f-9bd3-c6614a01bd5c" returned: 0 in 0.755s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:16:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-36b7e994-bdb2-444f-9bd3-c6614a01bd5c.e3fa0d82-85d0-44ef-a95d-8acb3b600ec6 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:55 devstack sudo[99535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-36b7e994-bdb2-444f-9bd3-c6614a01bd5c.e3fa0d82-85d0-44ef-a95d-8acb3b600ec6
Jul 03 01:16:55 devstack sudo[99535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:56 devstack sudo[99535]: pam_unix(sudo:session): session closed for user root
Jul 03 01:16:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-36b7e994-bdb2-444f-9bd3-c6614a01bd5c.e3fa0d82-85d0-44ef-a95d-8acb3b600ec6" returned: 0 in 0.824s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:16:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-36b7e994-bdb2-444f-9bd3-c6614a01bd5c.e3fa0d82-85d0-44ef-a95d-8acb3b600ec6 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:56 devstack sudo[99540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-36b7e994-bdb2-444f-9bd3-c6614a01bd5c.e3fa0d82-85d0-44ef-a95d-8acb3b600ec6
Jul 03 01:16:56 devstack sudo[99540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:56 devstack sudo[99540]: pam_unix(sudo:session): session closed for user root
Jul 03 01:16:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-36b7e994-bdb2-444f-9bd3-c6614a01bd5c.e3fa0d82-85d0-44ef-a95d-8acb3b600ec6" returned: 0 in 0.663s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:16:56 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] Lock "cinder-quobyte-e3fa0d82-85d0-44ef-a95d-8acb3b600ec6" released by "_delete_snapshot" :: held 3.169s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:16:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.674s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:16:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-2d92981a-9a96-452c-bd6e-5c94dc71ec53 tempest-VolumesTransfersV355Test-1577619451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.360s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:16:56 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-2d92981a-9a96-452c-bd6e-5c94dc71ec53 tempest-VolumesTransfersV355Test-1577619451 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:16:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1746399573',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d45e960a-516b-40a8-b9e2-68ac21471d15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a3d8ae243404ea095845b9b76608c65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:16:50Z,use_quota=True,user_id='0ff99c382a3b4262b02c8fb791b281c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:16:56 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-2d92981a-9a96-452c-bd6e-5c94dc71ec53 tempest-VolumesTransfersV355Test-1577619451 None] Creating volume d45e960a-516b-40a8-b9e2-68ac21471d15 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:16:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-2d92981a-9a96-452c-bd6e-5c94dc71ec53 tempest-VolumesTransfersV355Test-1577619451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:16:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-2d92981a-9a96-452c-bd6e-5c94dc71ec53 tempest-VolumesTransfersV355Test-1577619451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:16:56 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-2d92981a-9a96-452c-bd6e-5c94dc71ec53 tempest-VolumesTransfersV355Test-1577619451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:16:56 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-2d92981a-9a96-452c-bd6e-5c94dc71ec53 tempest-VolumesTransfersV355Test-1577619451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:16:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-2d92981a-9a96-452c-bd6e-5c94dc71ec53 tempest-VolumesTransfersV355Test-1577619451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:16:56 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-2d92981a-9a96-452c-bd6e-5c94dc71ec53 tempest-VolumesTransfersV355Test-1577619451 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:16:56 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-2d92981a-9a96-452c-bd6e-5c94dc71ec53 tempest-VolumesTransfersV355Test-1577619451 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:16:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-2d92981a-9a96-452c-bd6e-5c94dc71ec53 tempest-VolumesTransfersV355Test-1577619451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d45e960a-516b-40a8-b9e2-68ac21471d15 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:56 devstack sudo[99543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d45e960a-516b-40a8-b9e2-68ac21471d15 1073741824
Jul 03 01:16:57 devstack sudo[99543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:57 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2854cef9-1733-4a7f-a616-8ae5f377bc17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d71a700c-f70a-42c5-929f-42769c0f4d4c', 'volume_size': 2, 'source_volid': '36b7e994-bdb2-444f-9bd3-c6614a01bd5c', 'source_volstatus': 'available'}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:16:57 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7637e7d-c948-4d8a-b86d-de7975afbc90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:16:57 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] Volume volume-d71a700c-f70a-42c5-929f-42769c0f4d4c (d71a700c-f70a-42c5-929f-42769c0f4d4c): created successfully
Jul 03 01:16:57 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7637e7d-c948-4d8a-b86d-de7975afbc90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:16:57 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] Flow 'volume_create_manager' (7e400580-a239-42c3-85df-62cb5f84034a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:16:57 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-21f72e1a-9a2f-405d-80b6-e08bbe27693c tempest-VolumesSnapshotTestJSON-1936633444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:16:57 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-21f72e1a-9a2f-405d-80b6-e08bbe27693c tempest-VolumesSnapshotTestJSON-1936633444 None] Flow 'volume_create_manager' (d07db030-1c7f-4759-8289-623d1db0ddda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:16:57 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-21f72e1a-9a2f-405d-80b6-e08bbe27693c tempest-VolumesSnapshotTestJSON-1936633444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (590e9b89-bc33-44f4-a827-f3106b026c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:16:57 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-83be5969-0241-4d74-81a1-55a32526a9fe tempest-VolumesCloneTest-218172247 None] Created volume successfully.
Jul 03 01:16:57 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-21f72e1a-9a2f-405d-80b6-e08bbe27693c tempest-VolumesSnapshotTestJSON-1936633444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (590e9b89-bc33-44f4-a827-f3106b026c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:16:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1679201644',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de77010b-5740-4b6c-bc34-f6923b0c848b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='419a343cdaef48b4b9fe4a37c9cff5b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:16:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:16:57Z,use_quota=True,user_id='d621ec04955f45368862c149d3c33d00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:16:57 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-21f72e1a-9a2f-405d-80b6-e08bbe27693c tempest-VolumesSnapshotTestJSON-1936633444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91f789ca-7fa5-47d3-b65b-6bf9cf70a832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:16:57 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-21f72e1a-9a2f-405d-80b6-e08bbe27693c tempest-VolumesSnapshotTestJSON-1936633444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91f789ca-7fa5-47d3-b65b-6bf9cf70a832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:16:57 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-21f72e1a-9a2f-405d-80b6-e08bbe27693c tempest-VolumesSnapshotTestJSON-1936633444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbc16bca-cf6a-4e54-a79c-2ff860f1bb44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:16:57 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-21f72e1a-9a2f-405d-80b6-e08bbe27693c tempest-VolumesSnapshotTestJSON-1936633444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbc16bca-cf6a-4e54-a79c-2ff860f1bb44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de77010b-5740-4b6c-bc34-f6923b0c848b', 'volume_name': 'volume-de77010b-5740-4b6c-bc34-f6923b0c848b', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:16:57 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-21f72e1a-9a2f-405d-80b6-e08bbe27693c tempest-VolumesSnapshotTestJSON-1936633444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6267957d-5b6b-48cb-b519-071b0bf1e8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:16:57 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-21f72e1a-9a2f-405d-80b6-e08bbe27693c tempest-VolumesSnapshotTestJSON-1936633444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6267957d-5b6b-48cb-b519-071b0bf1e8b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:16:57 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-21f72e1a-9a2f-405d-80b6-e08bbe27693c tempest-VolumesSnapshotTestJSON-1936633444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c69b9c09-250c-40d7-9862-03a26ab30c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:16:57 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-21f72e1a-9a2f-405d-80b6-e08bbe27693c tempest-VolumesSnapshotTestJSON-1936633444 None] Volume de77010b-5740-4b6c-bc34-f6923b0c848b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de77010b-5740-4b6c-bc34-f6923b0c848b', 'volume_size': 1}
Jul 03 01:16:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-21f72e1a-9a2f-405d-80b6-e08bbe27693c tempest-VolumesSnapshotTestJSON-1936633444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:16:57 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-008a461d-4933-4d92-9149-1b265d6a4051 tempest-VolumesCloneTest-218172247 None] Acquiring lock "cinder-d71a700c-f70a-42c5-929f-42769c0f4d4c-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:16:57 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-008a461d-4933-4d92-9149-1b265d6a4051 tempest-VolumesCloneTest-218172247 None] Lock "cinder-d71a700c-f70a-42c5-929f-42769c0f4d4c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:16:57 devstack sudo[99543]: pam_unix(sudo:session): session closed for user root
Jul 03 01:16:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-2d92981a-9a96-452c-bd6e-5c94dc71ec53 tempest-VolumesTransfersV355Test-1577619451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d45e960a-516b-40a8-b9e2-68ac21471d15 1073741824" returned: 0 in 0.864s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:16:57 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-008a461d-4933-4d92-9149-1b265d6a4051 tempest-VolumesCloneTest-218172247 None] Acquiring lock "cinder-quobyte-d71a700c-f70a-42c5-929f-42769c0f4d4c" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:16:57 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-008a461d-4933-4d92-9149-1b265d6a4051 tempest-VolumesCloneTest-218172247 None] Lock "cinder-quobyte-d71a700c-f70a-42c5-929f-42769c0f4d4c" acquired by "delete_volume" :: waited 0.017s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:16:57 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[202026da-a4bb-4d1c-96e5-779e73b3b331]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:16:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-008a461d-4933-4d92-9149-1b265d6a4051 tempest-VolumesCloneTest-218172247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d71a700c-f70a-42c5-929f-42769c0f4d4c {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-2d92981a-9a96-452c-bd6e-5c94dc71ec53 tempest-VolumesTransfersV355Test-1577619451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d45e960a-516b-40a8-b9e2-68ac21471d15 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:57 devstack sudo[99550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d45e960a-516b-40a8-b9e2-68ac21471d15
Jul 03 01:16:57 devstack sudo[99550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:58 devstack sudo[99549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d71a700c-f70a-42c5-929f-42769c0f4d4c
Jul 03 01:16:58 devstack sudo[99549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:58 devstack sudo[99550]: pam_unix(sudo:session): session closed for user root
Jul 03 01:16:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-2d92981a-9a96-452c-bd6e-5c94dc71ec53 tempest-VolumesTransfersV355Test-1577619451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d45e960a-516b-40a8-b9e2-68ac21471d15" returned: 0 in 0.652s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:16:58 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-2d92981a-9a96-452c-bd6e-5c94dc71ec53 tempest-VolumesTransfersV355Test-1577619451 None] <== create_volume: return (1595ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:16:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-2d92981a-9a96-452c-bd6e-5c94dc71ec53 tempest-VolumesTransfersV355Test-1577619451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.598s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:16:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-21f72e1a-9a2f-405d-80b6-e08bbe27693c tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.426s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:16:58 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-21f72e1a-9a2f-405d-80b6-e08bbe27693c tempest-VolumesSnapshotTestJSON-1936633444 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:16:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1679201644',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de77010b-5740-4b6c-bc34-f6923b0c848b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='419a343cdaef48b4b9fe4a37c9cff5b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:16:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:16:57Z,use_quota=True,user_id='d621ec04955f45368862c149d3c33d00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:16:58 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-21f72e1a-9a2f-405d-80b6-e08bbe27693c tempest-VolumesSnapshotTestJSON-1936633444 None] Creating volume de77010b-5740-4b6c-bc34-f6923b0c848b {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:16:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-21f72e1a-9a2f-405d-80b6-e08bbe27693c tempest-VolumesSnapshotTestJSON-1936633444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:16:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-21f72e1a-9a2f-405d-80b6-e08bbe27693c tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:16:58 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-21f72e1a-9a2f-405d-80b6-e08bbe27693c tempest-VolumesSnapshotTestJSON-1936633444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:16:58 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-21f72e1a-9a2f-405d-80b6-e08bbe27693c tempest-VolumesSnapshotTestJSON-1936633444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:16:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-21f72e1a-9a2f-405d-80b6-e08bbe27693c tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:16:58 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-21f72e1a-9a2f-405d-80b6-e08bbe27693c tempest-VolumesSnapshotTestJSON-1936633444 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:16:58 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-21f72e1a-9a2f-405d-80b6-e08bbe27693c tempest-VolumesSnapshotTestJSON-1936633444 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:16:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-21f72e1a-9a2f-405d-80b6-e08bbe27693c tempest-VolumesSnapshotTestJSON-1936633444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-de77010b-5740-4b6c-bc34-f6923b0c848b 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:58 devstack sudo[99558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-de77010b-5740-4b6c-bc34-f6923b0c848b 1073741824
Jul 03 01:16:58 devstack sudo[99558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:58 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-2d92981a-9a96-452c-bd6e-5c94dc71ec53 tempest-VolumesTransfersV355Test-1577619451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1691d266-7876-4c5d-a143-0a4dd8fd6a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d45e960a-516b-40a8-b9e2-68ac21471d15', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:16:58 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-2d92981a-9a96-452c-bd6e-5c94dc71ec53 tempest-VolumesTransfersV355Test-1577619451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8295b384-8f6f-46a3-9a7e-799d198cd618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:16:58 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-2d92981a-9a96-452c-bd6e-5c94dc71ec53 tempest-VolumesTransfersV355Test-1577619451 None] Volume volume-d45e960a-516b-40a8-b9e2-68ac21471d15 (d45e960a-516b-40a8-b9e2-68ac21471d15): created successfully
Jul 03 01:16:58 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-2d92981a-9a96-452c-bd6e-5c94dc71ec53 tempest-VolumesTransfersV355Test-1577619451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8295b384-8f6f-46a3-9a7e-799d198cd618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:16:58 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-2d92981a-9a96-452c-bd6e-5c94dc71ec53 tempest-VolumesTransfersV355Test-1577619451 None] Flow 'volume_create_manager' (0e62fa22-0a32-422c-a1b8-101b28e8952b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:16:58 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-2d92981a-9a96-452c-bd6e-5c94dc71ec53 tempest-VolumesTransfersV355Test-1577619451 None] Created volume successfully.
Jul 03 01:16:58 devstack sudo[99549]: pam_unix(sudo:session): session closed for user root
Jul 03 01:16:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-008a461d-4933-4d92-9149-1b265d6a4051 tempest-VolumesCloneTest-218172247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d71a700c-f70a-42c5-929f-42769c0f4d4c" returned: 0 in 0.811s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:16:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-008a461d-4933-4d92-9149-1b265d6a4051 tempest-VolumesCloneTest-218172247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d71a700c-f70a-42c5-929f-42769c0f4d4c {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:58 devstack sudo[99560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d71a700c-f70a-42c5-929f-42769c0f4d4c
Jul 03 01:16:58 devstack sudo[99560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:59 devstack sudo[99560]: pam_unix(sudo:session): session closed for user root
Jul 03 01:16:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-008a461d-4933-4d92-9149-1b265d6a4051 tempest-VolumesCloneTest-218172247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d71a700c-f70a-42c5-929f-42769c0f4d4c" returned: 0 in 0.711s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:16:59 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-008a461d-4933-4d92-9149-1b265d6a4051 tempest-VolumesCloneTest-218172247 None] Lock "cinder-quobyte-d71a700c-f70a-42c5-929f-42769c0f4d4c" released by "delete_volume" :: held 1.563s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:16:59 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:SELECT=65,cinder:INSERT=24,cinder:DELETE=7,cinder:UPDATE=74 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:16:59 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:SELECT=61,cinder:UPDATE=88,cinder:INSERT=14,cinder:DELETE=8 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:16:59 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-4b6355b7-9141-49f7-9ec2-79d97d7b49b1 tempest-VolumesTransfersV355Test-673764846 None] Transfer volume completed successfully.
Jul 03 01:16:59 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-008a461d-4933-4d92-9149-1b265d6a4051 tempest-VolumesCloneTest-218172247 None] Created reservations ['94c7c97f-08c0-4ef4-b6a8-e3e50631cf24', 'da6b3872-ac8f-4686-9d61-577269baa719', '638bd0c0-856f-4583-acf8-e26a10ee71bb', 'b70230b3-0f92-4403-9700-d117bf68a280'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:16:59 devstack sudo[99558]: pam_unix(sudo:session): session closed for user root
Jul 03 01:16:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-21f72e1a-9a2f-405d-80b6-e08bbe27693c tempest-VolumesSnapshotTestJSON-1936633444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-de77010b-5740-4b6c-bc34-f6923b0c848b 1073741824" returned: 0 in 0.979s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:16:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-008a461d-4933-4d92-9149-1b265d6a4051 tempest-VolumesCloneTest-218172247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:16:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-008a461d-4933-4d92-9149-1b265d6a4051 tempest-VolumesCloneTest-218172247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:16:59 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-008a461d-4933-4d92-9149-1b265d6a4051 tempest-VolumesCloneTest-218172247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:16:59 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-008a461d-4933-4d92-9149-1b265d6a4051 tempest-VolumesCloneTest-218172247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:16:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-008a461d-4933-4d92-9149-1b265d6a4051 tempest-VolumesCloneTest-218172247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:16:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-008a461d-4933-4d92-9149-1b265d6a4051 tempest-VolumesCloneTest-218172247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-21f72e1a-9a2f-405d-80b6-e08bbe27693c tempest-VolumesSnapshotTestJSON-1936633444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-de77010b-5740-4b6c-bc34-f6923b0c848b {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:16:59 devstack sudo[99566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:16:59 devstack sudo[99566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:16:59 devstack sudo[99567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-de77010b-5740-4b6c-bc34-f6923b0c848b
Jul 03 01:16:59 devstack sudo[99567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:00 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e59ba0ae-c73a-404b-94c1-e29df39b65e8 tempest-VolumesCloneTest-218172247 None] Acquiring lock "cinder-36b7e994-bdb2-444f-9bd3-c6614a01bd5c-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:17:00 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e59ba0ae-c73a-404b-94c1-e29df39b65e8 tempest-VolumesCloneTest-218172247 None] Lock "cinder-36b7e994-bdb2-444f-9bd3-c6614a01bd5c-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:17:00 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e59ba0ae-c73a-404b-94c1-e29df39b65e8 tempest-VolumesCloneTest-218172247 None] Acquiring lock "cinder-quobyte-36b7e994-bdb2-444f-9bd3-c6614a01bd5c" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:17:00 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e59ba0ae-c73a-404b-94c1-e29df39b65e8 tempest-VolumesCloneTest-218172247 None] Lock "cinder-quobyte-36b7e994-bdb2-444f-9bd3-c6614a01bd5c" acquired by "delete_volume" :: waited 0.021s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:17:00 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[417c08a7-654b-401d-a456-a3488136ba79]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:17:00 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e59ba0ae-c73a-404b-94c1-e29df39b65e8 tempest-VolumesCloneTest-218172247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-36b7e994-bdb2-444f-9bd3-c6614a01bd5c {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:00 devstack sudo[99566]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:00 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-008a461d-4933-4d92-9149-1b265d6a4051 tempest-VolumesCloneTest-218172247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.792s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:00 devstack sudo[99567]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:00 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-008a461d-4933-4d92-9149-1b265d6a4051 tempest-VolumesCloneTest-218172247 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:17:00 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-21f72e1a-9a2f-405d-80b6-e08bbe27693c tempest-VolumesSnapshotTestJSON-1936633444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-de77010b-5740-4b6c-bc34-f6923b0c848b" returned: 0 in 0.787s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:00 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-21f72e1a-9a2f-405d-80b6-e08bbe27693c tempest-VolumesSnapshotTestJSON-1936633444 None] <== create_volume: return (1836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:17:00 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-21f72e1a-9a2f-405d-80b6-e08bbe27693c tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.838s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:17:00 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-008a461d-4933-4d92-9149-1b265d6a4051 tempest-VolumesCloneTest-218172247 None] Deleted volume successfully.
Jul 03 01:17:00 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-21f72e1a-9a2f-405d-80b6-e08bbe27693c tempest-VolumesSnapshotTestJSON-1936633444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c69b9c09-250c-40d7-9862-03a26ab30c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de77010b-5740-4b6c-bc34-f6923b0c848b', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:17:00 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-21f72e1a-9a2f-405d-80b6-e08bbe27693c tempest-VolumesSnapshotTestJSON-1936633444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a1ed117-8e70-4d43-9bae-3f6c0e9ab1af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:17:00 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-21f72e1a-9a2f-405d-80b6-e08bbe27693c tempest-VolumesSnapshotTestJSON-1936633444 None] Volume volume-de77010b-5740-4b6c-bc34-f6923b0c848b (de77010b-5740-4b6c-bc34-f6923b0c848b): created successfully
Jul 03 01:17:00 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-21f72e1a-9a2f-405d-80b6-e08bbe27693c tempest-VolumesSnapshotTestJSON-1936633444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a1ed117-8e70-4d43-9bae-3f6c0e9ab1af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:17:00 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-21f72e1a-9a2f-405d-80b6-e08bbe27693c tempest-VolumesSnapshotTestJSON-1936633444 None] Flow 'volume_create_manager' (d07db030-1c7f-4759-8289-623d1db0ddda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:17:00 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-008a461d-4933-4d92-9149-1b265d6a4051 tempest-VolumesCloneTest-218172247 None] Lock "cinder-d71a700c-f70a-42c5-929f-42769c0f4d4c-delete_volume" released by "delete_volume" :: held 2.643s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:17:00 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-21f72e1a-9a2f-405d-80b6-e08bbe27693c tempest-VolumesSnapshotTestJSON-1936633444 None] Created volume successfully.
Jul 03 01:17:00 devstack sudo[99572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-36b7e994-bdb2-444f-9bd3-c6614a01bd5c
Jul 03 01:17:00 devstack sudo[99572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:00 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-2cb06023-d5d7-4c0d-8131-a08172d13c8a tempest-VolumesTransfersV355Test-432290679 None] Acquiring lock "cinder-d45e960a-516b-40a8-b9e2-68ac21471d15-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:17:00 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-2cb06023-d5d7-4c0d-8131-a08172d13c8a tempest-VolumesTransfersV355Test-432290679 None] Lock "cinder-d45e960a-516b-40a8-b9e2-68ac21471d15-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:17:00 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-2cb06023-d5d7-4c0d-8131-a08172d13c8a tempest-VolumesTransfersV355Test-432290679 None] Acquiring lock "cinder-quobyte-d45e960a-516b-40a8-b9e2-68ac21471d15" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:17:00 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-2cb06023-d5d7-4c0d-8131-a08172d13c8a tempest-VolumesTransfersV355Test-432290679 None] Lock "cinder-quobyte-d45e960a-516b-40a8-b9e2-68ac21471d15" acquired by "delete_volume" :: waited 0.017s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:17:00 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac1a905-73e4-45ec-9d7f-f21f3dd6025c]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:17:00 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-2cb06023-d5d7-4c0d-8131-a08172d13c8a tempest-VolumesTransfersV355Test-432290679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d45e960a-516b-40a8-b9e2-68ac21471d15 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:00 devstack sudo[99574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d45e960a-516b-40a8-b9e2-68ac21471d15
Jul 03 01:17:00 devstack sudo[99574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:01 devstack sudo[99572]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e59ba0ae-c73a-404b-94c1-e29df39b65e8 tempest-VolumesCloneTest-218172247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-36b7e994-bdb2-444f-9bd3-c6614a01bd5c" returned: 0 in 0.790s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e59ba0ae-c73a-404b-94c1-e29df39b65e8 tempest-VolumesCloneTest-218172247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-36b7e994-bdb2-444f-9bd3-c6614a01bd5c {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:01 devstack sudo[99582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-36b7e994-bdb2-444f-9bd3-c6614a01bd5c
Jul 03 01:17:01 devstack sudo[99582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:01 devstack sudo[99574]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-2cb06023-d5d7-4c0d-8131-a08172d13c8a tempest-VolumesTransfersV355Test-432290679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d45e960a-516b-40a8-b9e2-68ac21471d15" returned: 0 in 0.818s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-2cb06023-d5d7-4c0d-8131-a08172d13c8a tempest-VolumesTransfersV355Test-432290679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d45e960a-516b-40a8-b9e2-68ac21471d15 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:01 devstack sudo[99587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d45e960a-516b-40a8-b9e2-68ac21471d15
Jul 03 01:17:01 devstack sudo[99587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-9469d72a-de4a-4a00-bdfc-d49a2c11d762 tempest-VolumesSnapshotTestJSON-1936633444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:17:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-9469d72a-de4a-4a00-bdfc-d49a2c11d762 tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:17:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-9469d72a-de4a-4a00-bdfc-d49a2c11d762 tempest-VolumesSnapshotTestJSON-1936633444 None] Creating offline snapshot a717e53b-db1d-4f0b-9cd2-b925819a6c6d of volume de77010b-5740-4b6c-bc34-f6923b0c848b {{(pid=86891) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 01:17:01 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9fa35bb-32cd-4bd1-82aa-b21a7078d0e3]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:17:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9469d72a-de4a-4a00-bdfc-d49a2c11d762 tempest-VolumesSnapshotTestJSON-1936633444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-de77010b-5740-4b6c-bc34-f6923b0c848b {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:01 devstack sudo[99589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-de77010b-5740-4b6c-bc34-f6923b0c848b
Jul 03 01:17:01 devstack sudo[99589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:01 devstack sudo[99582]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e59ba0ae-c73a-404b-94c1-e29df39b65e8 tempest-VolumesCloneTest-218172247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-36b7e994-bdb2-444f-9bd3-c6614a01bd5c" returned: 0 in 0.715s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:01 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e59ba0ae-c73a-404b-94c1-e29df39b65e8 tempest-VolumesCloneTest-218172247 None] Lock "cinder-quobyte-36b7e994-bdb2-444f-9bd3-c6614a01bd5c" released by "delete_volume" :: held 1.603s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:17:01 devstack cinder-volume[86891]: DEBUG oslo_service.periodic_task [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86891) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 01:17:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:17:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:17:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:17:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:17:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:17:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:01 devstack sudo[99592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:17:01 devstack sudo[99592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:02 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-e59ba0ae-c73a-404b-94c1-e29df39b65e8 tempest-VolumesCloneTest-218172247 None] Created reservations ['0f77713c-13a2-4d28-a3ee-684ba6a05684', '0d6556d1-f4d9-401a-a072-8aa591fbeff8', '45c9b884-4418-47ab-9642-45b33ee177f1', 'bdac2697-e817-4a3b-b69e-eed69f2cc399'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:17:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e59ba0ae-c73a-404b-94c1-e29df39b65e8 tempest-VolumesCloneTest-218172247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:17:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e59ba0ae-c73a-404b-94c1-e29df39b65e8 tempest-VolumesCloneTest-218172247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:17:02 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-e59ba0ae-c73a-404b-94c1-e29df39b65e8 tempest-VolumesCloneTest-218172247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:17:02 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-e59ba0ae-c73a-404b-94c1-e29df39b65e8 tempest-VolumesCloneTest-218172247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:17:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e59ba0ae-c73a-404b-94c1-e29df39b65e8 tempest-VolumesCloneTest-218172247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:17:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e59ba0ae-c73a-404b-94c1-e29df39b65e8 tempest-VolumesCloneTest-218172247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:02 devstack sudo[99595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:17:02 devstack sudo[99595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:02 devstack sudo[99587]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-2cb06023-d5d7-4c0d-8131-a08172d13c8a tempest-VolumesTransfersV355Test-432290679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d45e960a-516b-40a8-b9e2-68ac21471d15" returned: 0 in 0.781s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:02 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-2cb06023-d5d7-4c0d-8131-a08172d13c8a tempest-VolumesTransfersV355Test-432290679 None] Lock "cinder-quobyte-d45e960a-516b-40a8-b9e2-68ac21471d15" released by "delete_volume" :: held 1.652s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:17:02 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-2cb06023-d5d7-4c0d-8131-a08172d13c8a tempest-VolumesTransfersV355Test-432290679 None] Created reservations ['8c3090a3-441b-4bd7-9871-e5807e75ae41', '2af80d02-7896-4dd8-911a-df58ea3e06dd', 'bc6b0c6f-443c-4ea7-86c7-974168dc0f96', '236a5877-cd0c-4fba-9f77-cab3caab8ac7'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:17:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-2cb06023-d5d7-4c0d-8131-a08172d13c8a tempest-VolumesTransfersV355Test-432290679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:17:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-2cb06023-d5d7-4c0d-8131-a08172d13c8a tempest-VolumesTransfersV355Test-432290679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:17:02 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-2cb06023-d5d7-4c0d-8131-a08172d13c8a tempest-VolumesTransfersV355Test-432290679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:17:02 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-2cb06023-d5d7-4c0d-8131-a08172d13c8a tempest-VolumesTransfersV355Test-432290679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:17:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-2cb06023-d5d7-4c0d-8131-a08172d13c8a tempest-VolumesTransfersV355Test-432290679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:17:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-2cb06023-d5d7-4c0d-8131-a08172d13c8a tempest-VolumesTransfersV355Test-432290679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:02 devstack sudo[99599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:17:02 devstack sudo[99599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:02 devstack sudo[99592]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.795s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:02 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:17:02 devstack sudo[99589]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9469d72a-de4a-4a00-bdfc-d49a2c11d762 tempest-VolumesSnapshotTestJSON-1936633444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-de77010b-5740-4b6c-bc34-f6923b0c848b" returned: 0 in 1.173s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9469d72a-de4a-4a00-bdfc-d49a2c11d762 tempest-VolumesSnapshotTestJSON-1936633444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-de77010b-5740-4b6c-bc34-f6923b0c848b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-de77010b-5740-4b6c-bc34-f6923b0c848b.a717e53b-db1d-4f0b-9cd2-b925819a6c6d 1G {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:02 devstack cinder-volume[86891]: DEBUG oslo_service.periodic_task [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running periodic task VolumeManager._thread_info {{(pid=86891) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 01:17:02 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] thread count: 28 {{(pid=86891) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 01:17:02 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] thread info: [<_MainThread(MainThread, started 136731296534656)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136731184953280)>, <Thread(Thread-3 (stat_writer), started daemon 136731184058816)>, <Thread(Rabbit-heartbeat, started daemon 136731184846080)>, <Thread(Thread-5 (_runner), started daemon 136731182936576)>, <Thread(Thread-7 (_runner), started daemon 136731182954944)>, <Thread(fd_logger, started daemon 136731181916416)>, <Thread(privsep_reader, started daemon 136731180942208)>, <Thread(tpool_thread_0, started daemon 136731172161216)>, <Thread(tpool_thread_1, started daemon 136731163768512)>, <Thread(tpool_thread_2, started daemon 136731155375808)>, <Thread(tpool_thread_3, started daemon 136731146983104)>, <Thread(tpool_thread_4, started daemon 136731138590400)>, <Thread(tpool_thread_5, started daemon 136731130197696)>, <Thread(tpool_thread_6, started daemon 136731121804992)>, <Thread(tpool_thread_7, started daemon 136731113412288)>, <Thread(tpool_thread_8, started daemon 136731105003200)>, <Thread(tpool_thread_9, started daemon 136731096594112)>, <Thread(tpool_thread_10, started daemon 136731088185024)>, <Thread(tpool_thread_11, started daemon 136731079775936)>, <Thread(tpool_thread_12, started daemon 136731071366848)>, <Thread(tpool_thread_13, started daemon 136731062957760)>, <Thread(tpool_thread_14, started daemon 136731054548672)>, <Thread(tpool_thread_15, started daemon 136731046139584)>, <Thread(tpool_thread_16, started daemon 136731037730496)>, <Thread(tpool_thread_17, started daemon 136731029321408)>, <Thread(tpool_thread_18, started daemon 136731020912320)>, <Thread(tpool_thread_19, started daemon 136731012503232)>] {{(pid=86891) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 01:17:02 devstack sudo[99603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-de77010b-5740-4b6c-bc34-f6923b0c848b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-de77010b-5740-4b6c-bc34-f6923b0c848b.a717e53b-db1d-4f0b-9cd2-b925819a6c6d 1G
Jul 03 01:17:02 devstack sudo[99603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:03 devstack sudo[99595]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e59ba0ae-c73a-404b-94c1-e29df39b65e8 tempest-VolumesCloneTest-218172247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 1.001s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:03 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-e59ba0ae-c73a-404b-94c1-e29df39b65e8 tempest-VolumesCloneTest-218172247 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:17:03 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-e59ba0ae-c73a-404b-94c1-e29df39b65e8 tempest-VolumesCloneTest-218172247 None] Deleted volume successfully.
Jul 03 01:17:03 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e59ba0ae-c73a-404b-94c1-e29df39b65e8 tempest-VolumesCloneTest-218172247 None] Lock "cinder-36b7e994-bdb2-444f-9bd3-c6614a01bd5c-delete_volume" released by "delete_volume" :: held 2.945s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:17:03 devstack sudo[99599]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-2cb06023-d5d7-4c0d-8131-a08172d13c8a tempest-VolumesTransfersV355Test-432290679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.944s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:03 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-2cb06023-d5d7-4c0d-8131-a08172d13c8a tempest-VolumesTransfersV355Test-432290679 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:17:03 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-2cb06023-d5d7-4c0d-8131-a08172d13c8a tempest-VolumesTransfersV355Test-432290679 None] Deleted volume successfully.
Jul 03 01:17:03 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-2cb06023-d5d7-4c0d-8131-a08172d13c8a tempest-VolumesTransfersV355Test-432290679 None] Lock "cinder-d45e960a-516b-40a8-b9e2-68ac21471d15-delete_volume" released by "delete_volume" :: held 2.870s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:17:03 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a7d8928-f6bb-4f74-81aa-809a70a74490 tempest-VolumesTransfersV355Test-1577619451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:17:03 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3a7d8928-f6bb-4f74-81aa-809a70a74490 tempest-VolumesTransfersV355Test-1577619451 None] Flow 'volume_create_manager' (1f218adf-ec9b-4fb5-bf45-20445ade9648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:17:03 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3a7d8928-f6bb-4f74-81aa-809a70a74490 tempest-VolumesTransfersV355Test-1577619451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b64d189-64a6-425e-b987-46c83a76a97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:17:03 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3a7d8928-f6bb-4f74-81aa-809a70a74490 tempest-VolumesTransfersV355Test-1577619451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b64d189-64a6-425e-b987-46c83a76a97e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:17:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1667087476',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baac4dfc-5a46-4d7e-b813-ce1f8d9a80a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a3d8ae243404ea095845b9b76608c65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:17:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:17:03Z,use_quota=True,user_id='0ff99c382a3b4262b02c8fb791b281c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:17:03 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3a7d8928-f6bb-4f74-81aa-809a70a74490 tempest-VolumesTransfersV355Test-1577619451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a111aaf4-9912-47a2-8151-4020a8a192ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:17:03 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3a7d8928-f6bb-4f74-81aa-809a70a74490 tempest-VolumesTransfersV355Test-1577619451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a111aaf4-9912-47a2-8151-4020a8a192ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:17:03 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3a7d8928-f6bb-4f74-81aa-809a70a74490 tempest-VolumesTransfersV355Test-1577619451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (281ef1c2-4de7-4466-9010-029ab8c86bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:17:03 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3a7d8928-f6bb-4f74-81aa-809a70a74490 tempest-VolumesTransfersV355Test-1577619451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (281ef1c2-4de7-4466-9010-029ab8c86bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'baac4dfc-5a46-4d7e-b813-ce1f8d9a80a3', 'volume_name': 'volume-baac4dfc-5a46-4d7e-b813-ce1f8d9a80a3', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:17:03 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3a7d8928-f6bb-4f74-81aa-809a70a74490 tempest-VolumesTransfersV355Test-1577619451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdbaab96-3dd6-45f5-a589-9cae4da3a2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:17:03 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3a7d8928-f6bb-4f74-81aa-809a70a74490 tempest-VolumesTransfersV355Test-1577619451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdbaab96-3dd6-45f5-a589-9cae4da3a2b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:17:03 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3a7d8928-f6bb-4f74-81aa-809a70a74490 tempest-VolumesTransfersV355Test-1577619451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeec6ddd-3abf-4c38-a822-6f5975c59649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:17:03 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-3a7d8928-f6bb-4f74-81aa-809a70a74490 tempest-VolumesTransfersV355Test-1577619451 None] Volume baac4dfc-5a46-4d7e-b813-ce1f8d9a80a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-baac4dfc-5a46-4d7e-b813-ce1f8d9a80a3', 'volume_size': 1}
Jul 03 01:17:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-3a7d8928-f6bb-4f74-81aa-809a70a74490 tempest-VolumesTransfersV355Test-1577619451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:17:03 devstack sudo[99603]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9469d72a-de4a-4a00-bdfc-d49a2c11d762 tempest-VolumesSnapshotTestJSON-1936633444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-de77010b-5740-4b6c-bc34-f6923b0c848b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-de77010b-5740-4b6c-bc34-f6923b0c848b.a717e53b-db1d-4f0b-9cd2-b925819a6c6d 1G" returned: 0 in 1.068s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9469d72a-de4a-4a00-bdfc-d49a2c11d762 tempest-VolumesSnapshotTestJSON-1936633444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de77010b-5740-4b6c-bc34-f6923b0c848b -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-de77010b-5740-4b6c-bc34-f6923b0c848b.a717e53b-db1d-4f0b-9cd2-b925819a6c6d {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:03 devstack sudo[99610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de77010b-5740-4b6c-bc34-f6923b0c848b -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-de77010b-5740-4b6c-bc34-f6923b0c848b.a717e53b-db1d-4f0b-9cd2-b925819a6c6d
Jul 03 01:17:03 devstack sudo[99610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:04 devstack sudo[99610]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9469d72a-de4a-4a00-bdfc-d49a2c11d762 tempest-VolumesSnapshotTestJSON-1936633444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de77010b-5740-4b6c-bc34-f6923b0c848b -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-de77010b-5740-4b6c-bc34-f6923b0c848b.a717e53b-db1d-4f0b-9cd2-b925819a6c6d" returned: 0 in 0.771s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:04 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-9469d72a-de4a-4a00-bdfc-d49a2c11d762 tempest-VolumesSnapshotTestJSON-1936633444 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-de77010b-5740-4b6c-bc34-f6923b0c848b.a717e53b-db1d-4f0b-9cd2-b925819a6c6d is being set with open permissions: ugo+rw
Jul 03 01:17:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9469d72a-de4a-4a00-bdfc-d49a2c11d762 tempest-VolumesSnapshotTestJSON-1936633444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-de77010b-5740-4b6c-bc34-f6923b0c848b.a717e53b-db1d-4f0b-9cd2-b925819a6c6d {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:04 devstack sudo[99615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-de77010b-5740-4b6c-bc34-f6923b0c848b.a717e53b-db1d-4f0b-9cd2-b925819a6c6d
Jul 03 01:17:04 devstack sudo[99615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:05 devstack sudo[99615]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:05 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9469d72a-de4a-4a00-bdfc-d49a2c11d762 tempest-VolumesSnapshotTestJSON-1936633444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-de77010b-5740-4b6c-bc34-f6923b0c848b.a717e53b-db1d-4f0b-9cd2-b925819a6c6d" returned: 0 in 0.670s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:05 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9469d72a-de4a-4a00-bdfc-d49a2c11d762 tempest-VolumesSnapshotTestJSON-1936633444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-de77010b-5740-4b6c-bc34-f6923b0c848b.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:05 devstack sudo[99618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-de77010b-5740-4b6c-bc34-f6923b0c848b.info
Jul 03 01:17:05 devstack sudo[99618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:05 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdad88fd-6716-432e-bc49-6b7c58381ac1 tempest-VolumesExtendTest-1472913743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:17:05 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bdad88fd-6716-432e-bc49-6b7c58381ac1 tempest-VolumesExtendTest-1472913743 None] Flow 'volume_create_manager' (6971db6d-7784-4690-9c08-8c41202bf89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:17:05 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bdad88fd-6716-432e-bc49-6b7c58381ac1 tempest-VolumesExtendTest-1472913743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (103fe49c-acf1-4501-aa00-328194965432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:17:05 devstack sudo[99618]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:05 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bdad88fd-6716-432e-bc49-6b7c58381ac1 tempest-VolumesExtendTest-1472913743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (103fe49c-acf1-4501-aa00-328194965432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:17:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-132340795',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4090df1-dd84-4112-a16e-ed638334fd9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ed70549c8914e1ba780dd2e50c6f7fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:17:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:17:06Z,use_quota=True,user_id='f4d0653a66fd4e5092b980c352f1f03c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:17:05 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bdad88fd-6716-432e-bc49-6b7c58381ac1 tempest-VolumesExtendTest-1472913743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16d68135-24ea-44ed-a908-230bd13382b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:17:05 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bdad88fd-6716-432e-bc49-6b7c58381ac1 tempest-VolumesExtendTest-1472913743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16d68135-24ea-44ed-a908-230bd13382b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:17:06 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bdad88fd-6716-432e-bc49-6b7c58381ac1 tempest-VolumesExtendTest-1472913743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a096fd82-7b47-48c2-a9da-c5ef4fa0c02e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:17:06 devstack cinder-volume[86891]: DEBUG cinder.image.glance [None req-bdad88fd-6716-432e-bc49-6b7c58381ac1 tempest-VolumesExtendTest-1472913743 None] Creating Keystone auth plugin from conf {{(pid=86891) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 03 01:17:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9469d72a-de4a-4a00-bdfc-d49a2c11d762 tempest-VolumesSnapshotTestJSON-1936633444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-de77010b-5740-4b6c-bc34-f6923b0c848b.info" returned: 0 in 0.706s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:06 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-9469d72a-de4a-4a00-bdfc-d49a2c11d762 tempest-VolumesSnapshotTestJSON-1936633444 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-de77010b-5740-4b6c-bc34-f6923b0c848b.info is being set with open permissions: ugo+rw
Jul 03 01:17:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9469d72a-de4a-4a00-bdfc-d49a2c11d762 tempest-VolumesSnapshotTestJSON-1936633444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-de77010b-5740-4b6c-bc34-f6923b0c848b.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:06 devstack sudo[99622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-de77010b-5740-4b6c-bc34-f6923b0c848b.info
Jul 03 01:17:06 devstack sudo[99622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:06 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bdad88fd-6716-432e-bc49-6b7c58381ac1 tempest-VolumesExtendTest-1472913743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a096fd82-7b47-48c2-a9da-c5ef4fa0c02e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a4090df1-dd84-4112-a16e-ed638334fd9a', 'volume_name': 'volume-a4090df1-dd84-4112-a16e-ed638334fd9a', 'volume_size': 1, 'image_id': '65cceacb-879b-4111-919c-966899666f55', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/65cceacb-879b-4111-919c-966899666f55', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0d33e5361cf145ffa2791b827e46aea8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '65cceacb-879b-4111-919c-966899666f55', 'created_at': datetime.datetime(2026, 7, 2, 22, 57, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 22, 57, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/65cceacb-879b-4111-919c-966899666f55/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7c5b3531eff0>}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:17:06 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bdad88fd-6716-432e-bc49-6b7c58381ac1 tempest-VolumesExtendTest-1472913743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a2bbee9-a4ac-42f8-be32-b1dd37006fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:17:06 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bdad88fd-6716-432e-bc49-6b7c58381ac1 tempest-VolumesExtendTest-1472913743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a2bbee9-a4ac-42f8-be32-b1dd37006fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:17:06 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bdad88fd-6716-432e-bc49-6b7c58381ac1 tempest-VolumesExtendTest-1472913743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15d3180a-79a4-4a2e-a272-29b4e14f84e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:17:06 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-bdad88fd-6716-432e-bc49-6b7c58381ac1 tempest-VolumesExtendTest-1472913743 None] Volume a4090df1-dd84-4112-a16e-ed638334fd9a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a4090df1-dd84-4112-a16e-ed638334fd9a', 'volume_size': 1, 'image_id': '65cceacb-879b-4111-919c-966899666f55', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/65cceacb-879b-4111-919c-966899666f55', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0d33e5361cf145ffa2791b827e46aea8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '65cceacb-879b-4111-919c-966899666f55', 'created_at': datetime.datetime(2026, 7, 2, 22, 57, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 22, 57, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/65cceacb-879b-4111-919c-966899666f55/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7c5b3531eff0>}
Jul 03 01:17:06 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdad88fd-6716-432e-bc49-6b7c58381ac1 tempest-VolumesExtendTest-1472913743 None] Trying to clone a4090df1-dd84-4112-a16e-ed638334fd9a from image 65cceacb-879b-4111-919c-966899666f55 at location (None, [{'url': 'file:///opt/stack/data/glance/images/65cceacb-879b-4111-919c-966899666f55', 'metadata': {}}]). {{(pid=86891) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 03 01:17:06 devstack cinder-volume[86891]: DEBUG cinder.image.image_utils [None req-bdad88fd-6716-432e-bc49-6b7c58381ac1 tempest-VolumesExtendTest-1472913743 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_65cceacb-879b-4111-919c-966899666f55_0epcwmt8devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86891) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 03 01:17:06 devstack cinder-volume[86891]: INFO cinder.image.image_utils [None req-bdad88fd-6716-432e-bc49-6b7c58381ac1 tempest-VolumesExtendTest-1472913743 None] Image download 20.69 MB at 20.69 MB/s
Jul 03 01:17:06 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[186cdedf-2abf-4dbe-b77c-130675e88713]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:17:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bdad88fd-6716-432e-bc49-6b7c58381ac1 tempest-VolumesExtendTest-1472913743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_65cceacb-879b-4111-919c-966899666f55_0epcwmt8devstack@QuobyteHD {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:06 devstack sudo[99622]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9469d72a-de4a-4a00-bdfc-d49a2c11d762 tempest-VolumesSnapshotTestJSON-1936633444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-de77010b-5740-4b6c-bc34-f6923b0c848b.info" returned: 0 in 0.698s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-9469d72a-de4a-4a00-bdfc-d49a2c11d762 tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.184s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:17:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-3a7d8928-f6bb-4f74-81aa-809a70a74490 tempest-VolumesTransfersV355Test-1577619451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.004s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:17:06 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-3a7d8928-f6bb-4f74-81aa-809a70a74490 tempest-VolumesTransfersV355Test-1577619451 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:17:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1667087476',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baac4dfc-5a46-4d7e-b813-ce1f8d9a80a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a3d8ae243404ea095845b9b76608c65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:17:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:17:03Z,use_quota=True,user_id='0ff99c382a3b4262b02c8fb791b281c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:17:06 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-3a7d8928-f6bb-4f74-81aa-809a70a74490 tempest-VolumesTransfersV355Test-1577619451 None] Creating volume baac4dfc-5a46-4d7e-b813-ce1f8d9a80a3 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:17:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-3a7d8928-f6bb-4f74-81aa-809a70a74490 tempest-VolumesTransfersV355Test-1577619451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:17:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-3a7d8928-f6bb-4f74-81aa-809a70a74490 tempest-VolumesTransfersV355Test-1577619451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:17:06 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-3a7d8928-f6bb-4f74-81aa-809a70a74490 tempest-VolumesTransfersV355Test-1577619451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:17:06 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-3a7d8928-f6bb-4f74-81aa-809a70a74490 tempest-VolumesTransfersV355Test-1577619451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:17:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-3a7d8928-f6bb-4f74-81aa-809a70a74490 tempest-VolumesTransfersV355Test-1577619451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:17:06 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-3a7d8928-f6bb-4f74-81aa-809a70a74490 tempest-VolumesTransfersV355Test-1577619451 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:17:06 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-3a7d8928-f6bb-4f74-81aa-809a70a74490 tempest-VolumesTransfersV355Test-1577619451 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:17:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-3a7d8928-f6bb-4f74-81aa-809a70a74490 tempest-VolumesTransfersV355Test-1577619451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-baac4dfc-5a46-4d7e-b813-ce1f8d9a80a3 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:06 devstack sudo[99626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_65cceacb-879b-4111-919c-966899666f55_0epcwmt8devstack@QuobyteHD
Jul 03 01:17:06 devstack sudo[99626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:06 devstack sudo[99627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-baac4dfc-5a46-4d7e-b813-ce1f8d9a80a3 1073741824
Jul 03 01:17:06 devstack sudo[99627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:06 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-9469d72a-de4a-4a00-bdfc-d49a2c11d762 tempest-VolumesSnapshotTestJSON-1936633444 None] Create snapshot completed successfully
Jul 03 01:17:07 devstack sudo[99626]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:07 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bdad88fd-6716-432e-bc49-6b7c58381ac1 tempest-VolumesExtendTest-1472913743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_65cceacb-879b-4111-919c-966899666f55_0epcwmt8devstack@QuobyteHD" returned: 0 in 0.777s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:07 devstack cinder-volume[86891]: DEBUG cinder.image.image_utils [None req-bdad88fd-6716-432e-bc49-6b7c58381ac1 tempest-VolumesExtendTest-1472913743 None] Temporary image 65cceacb-879b-4111-919c-966899666f55 is fetched for user f4d0653a66fd4e5092b980c352f1f03c. {{(pid=86891) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 03 01:17:07 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba248c05-166e-40d1-9445-2859722c1e92]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:17:07 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bdad88fd-6716-432e-bc49-6b7c58381ac1 tempest-VolumesExtendTest-1472913743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_65cceacb-879b-4111-919c-966899666f55_0epcwmt8devstack@QuobyteHD {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:07 devstack sudo[99637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_65cceacb-879b-4111-919c-966899666f55_0epcwmt8devstack@QuobyteHD
Jul 03 01:17:07 devstack sudo[99637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:07 devstack sudo[99627]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:07 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-3a7d8928-f6bb-4f74-81aa-809a70a74490 tempest-VolumesTransfersV355Test-1577619451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-baac4dfc-5a46-4d7e-b813-ce1f8d9a80a3 1073741824" returned: 0 in 0.872s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:07 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-3a7d8928-f6bb-4f74-81aa-809a70a74490 tempest-VolumesTransfersV355Test-1577619451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-baac4dfc-5a46-4d7e-b813-ce1f8d9a80a3 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:07 devstack sudo[99639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-baac4dfc-5a46-4d7e-b813-ce1f8d9a80a3
Jul 03 01:17:07 devstack sudo[99639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:07 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5e66f45e-efb2-4d73-98b3-3c4751f9f752 tempest-VolumesSnapshotTestJSON-1936633444 None] Acquiring lock "cinder-a717e53b-db1d-4f0b-9cd2-b925819a6c6d-delete_snapshot" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:17:07 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5e66f45e-efb2-4d73-98b3-3c4751f9f752 tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "cinder-a717e53b-db1d-4f0b-9cd2-b925819a6c6d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:17:08 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5e66f45e-efb2-4d73-98b3-3c4751f9f752 tempest-VolumesSnapshotTestJSON-1936633444 None] Acquiring lock "cinder-quobyte-de77010b-5740-4b6c-bc34-f6923b0c848b" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:17:08 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5e66f45e-efb2-4d73-98b3-3c4751f9f752 tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "cinder-quobyte-de77010b-5740-4b6c-bc34-f6923b0c848b" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:17:08 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5e66f45e-efb2-4d73-98b3-3c4751f9f752 tempest-VolumesSnapshotTestJSON-1936633444 None] Acquiring lock "cinder-quobyte-a717e53b-db1d-4f0b-9cd2-b925819a6c6d" by "_delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:17:08 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5e66f45e-efb2-4d73-98b3-3c4751f9f752 tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "cinder-quobyte-a717e53b-db1d-4f0b-9cd2-b925819a6c6d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:17:08 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-5e66f45e-efb2-4d73-98b3-3c4751f9f752 tempest-VolumesSnapshotTestJSON-1936633444 None] Deleting offline snapshot a717e53b-db1d-4f0b-9cd2-b925819a6c6d of volume de77010b-5740-4b6c-bc34-f6923b0c848b {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 01:17:08 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-5e66f45e-efb2-4d73-98b3-3c4751f9f752 tempest-VolumesSnapshotTestJSON-1936633444 None] snapshot_file for this snap is: volume-de77010b-5740-4b6c-bc34-f6923b0c848b.a717e53b-db1d-4f0b-9cd2-b925819a6c6d {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 01:17:08 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe672eb8-1b43-4cca-9470-df13b2d7f2ea]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:17:08 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5e66f45e-efb2-4d73-98b3-3c4751f9f752 tempest-VolumesSnapshotTestJSON-1936633444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-de77010b-5740-4b6c-bc34-f6923b0c848b.a717e53b-db1d-4f0b-9cd2-b925819a6c6d {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:08 devstack sudo[99637]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:08 devstack sudo[99641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-de77010b-5740-4b6c-bc34-f6923b0c848b.a717e53b-db1d-4f0b-9cd2-b925819a6c6d
Jul 03 01:17:08 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bdad88fd-6716-432e-bc49-6b7c58381ac1 tempest-VolumesExtendTest-1472913743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_65cceacb-879b-4111-919c-966899666f55_0epcwmt8devstack@QuobyteHD" returned: 0 in 0.712s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:08 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-bdad88fd-6716-432e-bc49-6b7c58381ac1 tempest-VolumesExtendTest-1472913743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:17:08 devstack sudo[99641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:08 devstack sudo[99639]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:08 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-3a7d8928-f6bb-4f74-81aa-809a70a74490 tempest-VolumesTransfersV355Test-1577619451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-baac4dfc-5a46-4d7e-b813-ce1f8d9a80a3" returned: 0 in 0.682s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:08 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-3a7d8928-f6bb-4f74-81aa-809a70a74490 tempest-VolumesTransfersV355Test-1577619451 None] <== create_volume: return (1608ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:17:08 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-3a7d8928-f6bb-4f74-81aa-809a70a74490 tempest-VolumesTransfersV355Test-1577619451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.610s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:17:08 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-bdad88fd-6716-432e-bc49-6b7c58381ac1 tempest-VolumesExtendTest-1472913743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.144s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:17:08 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-bdad88fd-6716-432e-bc49-6b7c58381ac1 tempest-VolumesExtendTest-1472913743 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:17:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-132340795',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4090df1-dd84-4112-a16e-ed638334fd9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ed70549c8914e1ba780dd2e50c6f7fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:17:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:17:06Z,use_quota=True,user_id='f4d0653a66fd4e5092b980c352f1f03c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:17:08 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-bdad88fd-6716-432e-bc49-6b7c58381ac1 tempest-VolumesExtendTest-1472913743 None] Creating volume a4090df1-dd84-4112-a16e-ed638334fd9a {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:17:08 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-bdad88fd-6716-432e-bc49-6b7c58381ac1 tempest-VolumesExtendTest-1472913743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:17:08 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-bdad88fd-6716-432e-bc49-6b7c58381ac1 tempest-VolumesExtendTest-1472913743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:17:08 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-bdad88fd-6716-432e-bc49-6b7c58381ac1 tempest-VolumesExtendTest-1472913743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:17:08 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-bdad88fd-6716-432e-bc49-6b7c58381ac1 tempest-VolumesExtendTest-1472913743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:17:08 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-bdad88fd-6716-432e-bc49-6b7c58381ac1 tempest-VolumesExtendTest-1472913743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:17:08 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-bdad88fd-6716-432e-bc49-6b7c58381ac1 tempest-VolumesExtendTest-1472913743 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:17:08 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-bdad88fd-6716-432e-bc49-6b7c58381ac1 tempest-VolumesExtendTest-1472913743 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:17:08 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bdad88fd-6716-432e-bc49-6b7c58381ac1 tempest-VolumesExtendTest-1472913743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a4090df1-dd84-4112-a16e-ed638334fd9a 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:08 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3a7d8928-f6bb-4f74-81aa-809a70a74490 tempest-VolumesTransfersV355Test-1577619451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeec6ddd-3abf-4c38-a822-6f5975c59649) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-baac4dfc-5a46-4d7e-b813-ce1f8d9a80a3', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:17:08 devstack sudo[99648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a4090df1-dd84-4112-a16e-ed638334fd9a 1073741824
Jul 03 01:17:08 devstack sudo[99648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:08 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3a7d8928-f6bb-4f74-81aa-809a70a74490 tempest-VolumesTransfersV355Test-1577619451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee429d90-8534-4f26-9059-56401424901c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:17:08 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-3a7d8928-f6bb-4f74-81aa-809a70a74490 tempest-VolumesTransfersV355Test-1577619451 None] Volume volume-baac4dfc-5a46-4d7e-b813-ce1f8d9a80a3 (baac4dfc-5a46-4d7e-b813-ce1f8d9a80a3): created successfully
Jul 03 01:17:08 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3a7d8928-f6bb-4f74-81aa-809a70a74490 tempest-VolumesTransfersV355Test-1577619451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee429d90-8534-4f26-9059-56401424901c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:17:08 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3a7d8928-f6bb-4f74-81aa-809a70a74490 tempest-VolumesTransfersV355Test-1577619451 None] Flow 'volume_create_manager' (1f218adf-ec9b-4fb5-bf45-20445ade9648) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:17:08 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-3a7d8928-f6bb-4f74-81aa-809a70a74490 tempest-VolumesTransfersV355Test-1577619451 None] Created volume successfully.
Jul 03 01:17:08 devstack sudo[99641]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:08 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5e66f45e-efb2-4d73-98b3-3c4751f9f752 tempest-VolumesSnapshotTestJSON-1936633444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-de77010b-5740-4b6c-bc34-f6923b0c848b.a717e53b-db1d-4f0b-9cd2-b925819a6c6d" returned: 0 in 0.741s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:08 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-5e66f45e-efb2-4d73-98b3-3c4751f9f752 tempest-VolumesSnapshotTestJSON-1936633444 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de77010b-5740-4b6c-bc34-f6923b0c848b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:17:08 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee46092d-fbcf-496d-9508-7e6d93f99880]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:17:08 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5e66f45e-efb2-4d73-98b3-3c4751f9f752 tempest-VolumesSnapshotTestJSON-1936633444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-de77010b-5740-4b6c-bc34-f6923b0c848b {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:08 devstack sudo[99653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-de77010b-5740-4b6c-bc34-f6923b0c848b
Jul 03 01:17:08 devstack sudo[99653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:09 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-10a25656-ffe3-4b78-9d52-fb98596d9dba tempest-VolumesTransfersV355Test-432290679 None] Acquiring lock "cinder-baac4dfc-5a46-4d7e-b813-ce1f8d9a80a3-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:17:09 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-10a25656-ffe3-4b78-9d52-fb98596d9dba tempest-VolumesTransfersV355Test-432290679 None] Lock "cinder-baac4dfc-5a46-4d7e-b813-ce1f8d9a80a3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:17:09 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-10a25656-ffe3-4b78-9d52-fb98596d9dba tempest-VolumesTransfersV355Test-432290679 None] Acquiring lock "cinder-quobyte-baac4dfc-5a46-4d7e-b813-ce1f8d9a80a3" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:17:09 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-10a25656-ffe3-4b78-9d52-fb98596d9dba tempest-VolumesTransfersV355Test-432290679 None] Lock "cinder-quobyte-baac4dfc-5a46-4d7e-b813-ce1f8d9a80a3" acquired by "delete_volume" :: waited 0.017s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:17:09 devstack sudo[99648]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bdad88fd-6716-432e-bc49-6b7c58381ac1 tempest-VolumesExtendTest-1472913743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a4090df1-dd84-4112-a16e-ed638334fd9a 1073741824" returned: 0 in 0.894s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:09 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4b6c91-971b-448c-99e6-169fd9a564a8]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:17:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-10a25656-ffe3-4b78-9d52-fb98596d9dba tempest-VolumesTransfersV355Test-432290679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-baac4dfc-5a46-4d7e-b813-ce1f8d9a80a3 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bdad88fd-6716-432e-bc49-6b7c58381ac1 tempest-VolumesExtendTest-1472913743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a4090df1-dd84-4112-a16e-ed638334fd9a {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:09 devstack sudo[99660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a4090df1-dd84-4112-a16e-ed638334fd9a
Jul 03 01:17:09 devstack sudo[99660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:09 devstack sudo[99659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-baac4dfc-5a46-4d7e-b813-ce1f8d9a80a3
Jul 03 01:17:09 devstack sudo[99659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:09 devstack sudo[99653]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5e66f45e-efb2-4d73-98b3-3c4751f9f752 tempest-VolumesSnapshotTestJSON-1936633444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-de77010b-5740-4b6c-bc34-f6923b0c848b" returned: 0 in 0.845s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5e66f45e-efb2-4d73-98b3-3c4751f9f752 tempest-VolumesSnapshotTestJSON-1936633444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-de77010b-5740-4b6c-bc34-f6923b0c848b.a717e53b-db1d-4f0b-9cd2-b925819a6c6d {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:09 devstack sudo[99666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-de77010b-5740-4b6c-bc34-f6923b0c848b.a717e53b-db1d-4f0b-9cd2-b925819a6c6d
Jul 03 01:17:09 devstack sudo[99666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:09 devstack sudo[99660]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bdad88fd-6716-432e-bc49-6b7c58381ac1 tempest-VolumesExtendTest-1472913743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a4090df1-dd84-4112-a16e-ed638334fd9a" returned: 0 in 0.659s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:09 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-bdad88fd-6716-432e-bc49-6b7c58381ac1 tempest-VolumesExtendTest-1472913743 None] <== create_volume: return (1604ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:17:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-bdad88fd-6716-432e-bc49-6b7c58381ac1 tempest-VolumesExtendTest-1472913743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.608s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:17:09 devstack cinder-volume[86891]: DEBUG cinder.volume.volume_utils [None req-bdad88fd-6716-432e-bc49-6b7c58381ac1 tempest-VolumesExtendTest-1472913743 None] Attempting download of 65cceacb-879b-4111-919c-966899666f55 ((None, [{'url': 'file:///opt/stack/data/glance/images/65cceacb-879b-4111-919c-966899666f55', 'metadata': {}}])) to volume a4090df1-dd84-4112-a16e-ed638334fd9a. {{(pid=86891) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 03 01:17:10 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e8c0e8-9854-4c7e-946b-62a7d24c24df]: (4, 'raw') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:17:10 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bdad88fd-6716-432e-bc49-6b7c58381ac1 tempest-VolumesExtendTest-1472913743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_65cceacb-879b-4111-919c-966899666f55_l19omnww {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:10 devstack sudo[99659]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:10 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-10a25656-ffe3-4b78-9d52-fb98596d9dba tempest-VolumesTransfersV355Test-432290679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-baac4dfc-5a46-4d7e-b813-ce1f8d9a80a3" returned: 0 in 0.794s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:10 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-10a25656-ffe3-4b78-9d52-fb98596d9dba tempest-VolumesTransfersV355Test-432290679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-baac4dfc-5a46-4d7e-b813-ce1f8d9a80a3 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:10 devstack sudo[99673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-baac4dfc-5a46-4d7e-b813-ce1f8d9a80a3
Jul 03 01:17:10 devstack sudo[99673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:10 devstack sudo[99672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_65cceacb-879b-4111-919c-966899666f55_l19omnww
Jul 03 01:17:10 devstack sudo[99672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:10 devstack sudo[99666]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:10 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5e66f45e-efb2-4d73-98b3-3c4751f9f752 tempest-VolumesSnapshotTestJSON-1936633444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-de77010b-5740-4b6c-bc34-f6923b0c848b.a717e53b-db1d-4f0b-9cd2-b925819a6c6d" returned: 0 in 0.737s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:10 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5e66f45e-efb2-4d73-98b3-3c4751f9f752 tempest-VolumesSnapshotTestJSON-1936633444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-de77010b-5740-4b6c-bc34-f6923b0c848b.a717e53b-db1d-4f0b-9cd2-b925819a6c6d {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:10 devstack sudo[99679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-de77010b-5740-4b6c-bc34-f6923b0c848b.a717e53b-db1d-4f0b-9cd2-b925819a6c6d
Jul 03 01:17:10 devstack sudo[99679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:10 devstack sudo[99673]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:10 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-10a25656-ffe3-4b78-9d52-fb98596d9dba tempest-VolumesTransfersV355Test-432290679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-baac4dfc-5a46-4d7e-b813-ce1f8d9a80a3" returned: 0 in 0.697s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:10 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-10a25656-ffe3-4b78-9d52-fb98596d9dba tempest-VolumesTransfersV355Test-432290679 None] Lock "cinder-quobyte-baac4dfc-5a46-4d7e-b813-ce1f8d9a80a3" released by "delete_volume" :: held 1.542s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:17:10 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-10a25656-ffe3-4b78-9d52-fb98596d9dba tempest-VolumesTransfersV355Test-432290679 None] Created reservations ['b380e12a-4757-4b03-ae71-476946cd081f', '0cb65625-64dd-42c8-a04d-64ee2d2d04fe', 'aa951de6-2e83-4794-a919-37798112a5e2', '1836bc55-3b90-462c-bfaa-e62c3ad14d4f'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:17:10 devstack sudo[99672]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:10 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bdad88fd-6716-432e-bc49-6b7c58381ac1 tempest-VolumesExtendTest-1472913743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_65cceacb-879b-4111-919c-966899666f55_l19omnww" returned: 0 in 0.793s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:10 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bdad88fd-6716-432e-bc49-6b7c58381ac1 tempest-VolumesExtendTest-1472913743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_65cceacb-879b-4111-919c-966899666f55_l19omnww {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:10 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-10a25656-ffe3-4b78-9d52-fb98596d9dba tempest-VolumesTransfersV355Test-432290679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:17:10 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-10a25656-ffe3-4b78-9d52-fb98596d9dba tempest-VolumesTransfersV355Test-432290679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:17:10 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-10a25656-ffe3-4b78-9d52-fb98596d9dba tempest-VolumesTransfersV355Test-432290679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:17:10 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-10a25656-ffe3-4b78-9d52-fb98596d9dba tempest-VolumesTransfersV355Test-432290679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:17:10 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-10a25656-ffe3-4b78-9d52-fb98596d9dba tempest-VolumesTransfersV355Test-432290679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:17:10 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-10a25656-ffe3-4b78-9d52-fb98596d9dba tempest-VolumesTransfersV355Test-432290679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:10 devstack sudo[99685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:17:10 devstack sudo[99685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:10 devstack sudo[99684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_65cceacb-879b-4111-919c-966899666f55_l19omnww
Jul 03 01:17:10 devstack sudo[99684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:11 devstack sudo[99679]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:11 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5e66f45e-efb2-4d73-98b3-3c4751f9f752 tempest-VolumesSnapshotTestJSON-1936633444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-de77010b-5740-4b6c-bc34-f6923b0c848b.a717e53b-db1d-4f0b-9cd2-b925819a6c6d" returned: 0 in 0.645s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:11 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5e66f45e-efb2-4d73-98b3-3c4751f9f752 tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "cinder-quobyte-a717e53b-db1d-4f0b-9cd2-b925819a6c6d" released by "_delete_snapshot" :: held 3.089s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:17:11 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5e66f45e-efb2-4d73-98b3-3c4751f9f752 tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "cinder-quobyte-de77010b-5740-4b6c-bc34-f6923b0c848b" released by "delete_snapshot" :: held 3.114s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:17:11 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-5e66f45e-efb2-4d73-98b3-3c4751f9f752 tempest-VolumesSnapshotTestJSON-1936633444 None] Created reservations ['b85c1095-eb3b-43ae-a1b7-9879366ba249', '4507fb1d-f5e0-40ae-aefd-739379e63007', 'c60d308f-e16c-405e-bd0d-920527ff7629', 'b55090c4-b8f3-4fd0-9547-24f9d0718083'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:17:11 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-5e66f45e-efb2-4d73-98b3-3c4751f9f752 tempest-VolumesSnapshotTestJSON-1936633444 None] Delete snapshot completed successfully.
Jul 03 01:17:11 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5e66f45e-efb2-4d73-98b3-3c4751f9f752 tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "cinder-a717e53b-db1d-4f0b-9cd2-b925819a6c6d-delete_snapshot" released by "delete_snapshot" :: held 3.313s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:17:11 devstack sudo[99684]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:11 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bdad88fd-6716-432e-bc49-6b7c58381ac1 tempest-VolumesExtendTest-1472913743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_65cceacb-879b-4111-919c-966899666f55_l19omnww" returned: 1 in 0.754s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:11 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bdad88fd-6716-432e-bc49-6b7c58381ac1 tempest-VolumesExtendTest-1472913743 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_65cceacb-879b-4111-919c-966899666f55_l19omnww' failed. Not Retrying. {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 01:17:11 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d5b7a5-08ab-42b1-b708-b79e9b3c752c]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:17:11 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bdad88fd-6716-432e-bc49-6b7c58381ac1 tempest-VolumesExtendTest-1472913743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_65cceacb-879b-4111-919c-966899666f55_0epcwmt8devstack@QuobyteHD {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:11 devstack sudo[99685]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:11 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-10a25656-ffe3-4b78-9d52-fb98596d9dba tempest-VolumesTransfersV355Test-432290679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.689s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:11 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-10a25656-ffe3-4b78-9d52-fb98596d9dba tempest-VolumesTransfersV355Test-432290679 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:17:11 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-10a25656-ffe3-4b78-9d52-fb98596d9dba tempest-VolumesTransfersV355Test-432290679 None] Deleted volume successfully.
Jul 03 01:17:11 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-10a25656-ffe3-4b78-9d52-fb98596d9dba tempest-VolumesTransfersV355Test-432290679 None] Lock "cinder-baac4dfc-5a46-4d7e-b813-ce1f8d9a80a3-delete_volume" released by "delete_volume" :: held 2.470s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:17:11 devstack sudo[99692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_65cceacb-879b-4111-919c-966899666f55_0epcwmt8devstack@QuobyteHD
Jul 03 01:17:11 devstack sudo[99692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:12 devstack sudo[99692]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bdad88fd-6716-432e-bc49-6b7c58381ac1 tempest-VolumesExtendTest-1472913743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_65cceacb-879b-4111-919c-966899666f55_0epcwmt8devstack@QuobyteHD" returned: 0 in 0.784s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:12 devstack cinder-volume[86891]: DEBUG cinder.image.image_utils [None req-bdad88fd-6716-432e-bc49-6b7c58381ac1 tempest-VolumesExtendTest-1472913743 None] 65cceacb-879b-4111-919c-966899666f55 was qcow2, converting to raw {{(pid=86891) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 03 01:17:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bdad88fd-6716-432e-bc49-6b7c58381ac1 tempest-VolumesExtendTest-1472913743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_65cceacb-879b-4111-919c-966899666f55_0epcwmt8devstack@QuobyteHD /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a4090df1-dd84-4112-a16e-ed638334fd9a {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:12 devstack sudo[99697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_65cceacb-879b-4111-919c-966899666f55_0epcwmt8devstack@QuobyteHD /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a4090df1-dd84-4112-a16e-ed638334fd9a
Jul 03 01:17:12 devstack sudo[99697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:12 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6cb05d2-697f-43da-b81d-398670f0dee9 tempest-VolumesSnapshotTestJSON-1936633444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:17:12 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a6cb05d2-697f-43da-b81d-398670f0dee9 tempest-VolumesSnapshotTestJSON-1936633444 None] Flow 'volume_create_manager' (2015dc47-56b6-4fa0-9c9e-9b834e7b7be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:17:12 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a6cb05d2-697f-43da-b81d-398670f0dee9 tempest-VolumesSnapshotTestJSON-1936633444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6894800-b072-4bd9-84b2-dcf2fbd7df83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:17:12 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a6cb05d2-697f-43da-b81d-398670f0dee9 tempest-VolumesSnapshotTestJSON-1936633444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6894800-b072-4bd9-84b2-dcf2fbd7df83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:17:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1836186494',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15e3c1b7-9203-4158-a416-0df0c9b99998,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='419a343cdaef48b4b9fe4a37c9cff5b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:17:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:17:13Z,use_quota=True,user_id='d621ec04955f45368862c149d3c33d00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:17:12 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a6cb05d2-697f-43da-b81d-398670f0dee9 tempest-VolumesSnapshotTestJSON-1936633444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b0359a2-fe2e-44f9-a63d-2f87f520c750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:17:12 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a6cb05d2-697f-43da-b81d-398670f0dee9 tempest-VolumesSnapshotTestJSON-1936633444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b0359a2-fe2e-44f9-a63d-2f87f520c750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:17:12 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a6cb05d2-697f-43da-b81d-398670f0dee9 tempest-VolumesSnapshotTestJSON-1936633444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06bd4bc6-dd83-4add-8210-5afd302e1503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:17:12 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a6cb05d2-697f-43da-b81d-398670f0dee9 tempest-VolumesSnapshotTestJSON-1936633444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06bd4bc6-dd83-4add-8210-5afd302e1503) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15e3c1b7-9203-4158-a416-0df0c9b99998', 'volume_name': 'volume-15e3c1b7-9203-4158-a416-0df0c9b99998', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:17:12 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a6cb05d2-697f-43da-b81d-398670f0dee9 tempest-VolumesSnapshotTestJSON-1936633444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe188593-a414-4f46-805e-e775f2fc51b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:17:12 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a6cb05d2-697f-43da-b81d-398670f0dee9 tempest-VolumesSnapshotTestJSON-1936633444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe188593-a414-4f46-805e-e775f2fc51b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:17:12 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a6cb05d2-697f-43da-b81d-398670f0dee9 tempest-VolumesSnapshotTestJSON-1936633444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5174360e-9631-40a7-b3e9-f4565cda7776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:17:12 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-a6cb05d2-697f-43da-b81d-398670f0dee9 tempest-VolumesSnapshotTestJSON-1936633444 None] Volume 15e3c1b7-9203-4158-a416-0df0c9b99998: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15e3c1b7-9203-4158-a416-0df0c9b99998', 'volume_size': 1}
Jul 03 01:17:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a6cb05d2-697f-43da-b81d-398670f0dee9 tempest-VolumesSnapshotTestJSON-1936633444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:17:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a6cb05d2-697f-43da-b81d-398670f0dee9 tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:17:12 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-a6cb05d2-697f-43da-b81d-398670f0dee9 tempest-VolumesSnapshotTestJSON-1936633444 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:17:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1836186494',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15e3c1b7-9203-4158-a416-0df0c9b99998,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='419a343cdaef48b4b9fe4a37c9cff5b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:17:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:17:13Z,use_quota=True,user_id='d621ec04955f45368862c149d3c33d00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:17:12 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-a6cb05d2-697f-43da-b81d-398670f0dee9 tempest-VolumesSnapshotTestJSON-1936633444 None] Creating volume 15e3c1b7-9203-4158-a416-0df0c9b99998 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:17:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a6cb05d2-697f-43da-b81d-398670f0dee9 tempest-VolumesSnapshotTestJSON-1936633444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:17:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a6cb05d2-697f-43da-b81d-398670f0dee9 tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:17:12 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-a6cb05d2-697f-43da-b81d-398670f0dee9 tempest-VolumesSnapshotTestJSON-1936633444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:17:12 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-a6cb05d2-697f-43da-b81d-398670f0dee9 tempest-VolumesSnapshotTestJSON-1936633444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:17:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a6cb05d2-697f-43da-b81d-398670f0dee9 tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:17:12 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-a6cb05d2-697f-43da-b81d-398670f0dee9 tempest-VolumesSnapshotTestJSON-1936633444 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:17:12 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-a6cb05d2-697f-43da-b81d-398670f0dee9 tempest-VolumesSnapshotTestJSON-1936633444 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:17:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a6cb05d2-697f-43da-b81d-398670f0dee9 tempest-VolumesSnapshotTestJSON-1936633444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-15e3c1b7-9203-4158-a416-0df0c9b99998 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:13 devstack sudo[99699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-15e3c1b7-9203-4158-a416-0df0c9b99998 1073741824
Jul 03 01:17:13 devstack sudo[99699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:14 devstack sudo[99699]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a6cb05d2-697f-43da-b81d-398670f0dee9 tempest-VolumesSnapshotTestJSON-1936633444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-15e3c1b7-9203-4158-a416-0df0c9b99998 1073741824" returned: 0 in 1.035s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a6cb05d2-697f-43da-b81d-398670f0dee9 tempest-VolumesSnapshotTestJSON-1936633444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-15e3c1b7-9203-4158-a416-0df0c9b99998 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:14 devstack sudo[99716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-15e3c1b7-9203-4158-a416-0df0c9b99998
Jul 03 01:17:14 devstack sudo[99716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:14 devstack sudo[99716]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a6cb05d2-697f-43da-b81d-398670f0dee9 tempest-VolumesSnapshotTestJSON-1936633444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-15e3c1b7-9203-4158-a416-0df0c9b99998" returned: 0 in 0.722s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:14 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-a6cb05d2-697f-43da-b81d-398670f0dee9 tempest-VolumesSnapshotTestJSON-1936633444 None] <== create_volume: return (1805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:17:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a6cb05d2-697f-43da-b81d-398670f0dee9 tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.810s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:17:14 devstack sudo[99697]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bdad88fd-6716-432e-bc49-6b7c58381ac1 tempest-VolumesExtendTest-1472913743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_65cceacb-879b-4111-919c-966899666f55_0epcwmt8devstack@QuobyteHD /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a4090df1-dd84-4112-a16e-ed638334fd9a" returned: 0 in 2.412s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:14 devstack cinder-volume[86891]: DEBUG cinder.image.image_utils [None req-bdad88fd-6716-432e-bc49-6b7c58381ac1 tempest-VolumesExtendTest-1472913743 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_65cceacb-879b-4111-919c-966899666f55_0epcwmt8devstack@QuobyteHD, size 112.00 MB, duration 2.41 sec, destination /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a4090df1-dd84-4112-a16e-ed638334fd9a {{(pid=86891) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 03 01:17:14 devstack cinder-volume[86891]: INFO cinder.image.image_utils [None req-bdad88fd-6716-432e-bc49-6b7c58381ac1 tempest-VolumesExtendTest-1472913743 None] Converted 112.00 MB image at 46.41 MB/s
Jul 03 01:17:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bdad88fd-6716-432e-bc49-6b7c58381ac1 tempest-VolumesExtendTest-1472913743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a4090df1-dd84-4112-a16e-ed638334fd9a 1G {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:14 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a6cb05d2-697f-43da-b81d-398670f0dee9 tempest-VolumesSnapshotTestJSON-1936633444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5174360e-9631-40a7-b3e9-f4565cda7776) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15e3c1b7-9203-4158-a416-0df0c9b99998', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:17:14 devstack sudo[99719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a4090df1-dd84-4112-a16e-ed638334fd9a 1G
Jul 03 01:17:14 devstack sudo[99719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:14 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a6cb05d2-697f-43da-b81d-398670f0dee9 tempest-VolumesSnapshotTestJSON-1936633444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fcf9f8f-60de-4035-b19a-bd561e3a8886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:17:14 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-a6cb05d2-697f-43da-b81d-398670f0dee9 tempest-VolumesSnapshotTestJSON-1936633444 None] Volume volume-15e3c1b7-9203-4158-a416-0df0c9b99998 (15e3c1b7-9203-4158-a416-0df0c9b99998): created successfully
Jul 03 01:17:14 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a6cb05d2-697f-43da-b81d-398670f0dee9 tempest-VolumesSnapshotTestJSON-1936633444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fcf9f8f-60de-4035-b19a-bd561e3a8886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:17:14 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a6cb05d2-697f-43da-b81d-398670f0dee9 tempest-VolumesSnapshotTestJSON-1936633444 None] Flow 'volume_create_manager' (2015dc47-56b6-4fa0-9c9e-9b834e7b7be0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:17:14 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-a6cb05d2-697f-43da-b81d-398670f0dee9 tempest-VolumesSnapshotTestJSON-1936633444 None] Created volume successfully.
Jul 03 01:17:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b553de7a-1e20-4cbc-8431-1ac6e7a8a18d tempest-VolumesSnapshotTestJSON-1936633444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:17:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b553de7a-1e20-4cbc-8431-1ac6e7a8a18d tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:17:15 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-b553de7a-1e20-4cbc-8431-1ac6e7a8a18d tempest-VolumesSnapshotTestJSON-1936633444 None] Creating offline snapshot b442346e-3711-4e21-b63d-50fa1f8ecf5f of volume 15e3c1b7-9203-4158-a416-0df0c9b99998 {{(pid=86891) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 01:17:15 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac2d596-5a57-4605-a147-c6806211e8d3]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:17:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b553de7a-1e20-4cbc-8431-1ac6e7a8a18d tempest-VolumesSnapshotTestJSON-1936633444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-15e3c1b7-9203-4158-a416-0df0c9b99998 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:15 devstack sudo[99729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-15e3c1b7-9203-4158-a416-0df0c9b99998
Jul 03 01:17:15 devstack sudo[99729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:15 devstack sudo[99719]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bdad88fd-6716-432e-bc49-6b7c58381ac1 tempest-VolumesExtendTest-1472913743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a4090df1-dd84-4112-a16e-ed638334fd9a 1G" returned: 0 in 0.849s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:15 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fca1fbc-9691-4007-ad58-910132c0a909]: (4, 'raw') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:17:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bdad88fd-6716-432e-bc49-6b7c58381ac1 tempest-VolumesExtendTest-1472913743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a4090df1-dd84-4112-a16e-ed638334fd9a {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:15 devstack sudo[99734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a4090df1-dd84-4112-a16e-ed638334fd9a
Jul 03 01:17:15 devstack sudo[99734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:16 devstack sudo[99729]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b553de7a-1e20-4cbc-8431-1ac6e7a8a18d tempest-VolumesSnapshotTestJSON-1936633444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-15e3c1b7-9203-4158-a416-0df0c9b99998" returned: 0 in 0.840s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b553de7a-1e20-4cbc-8431-1ac6e7a8a18d tempest-VolumesSnapshotTestJSON-1936633444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-15e3c1b7-9203-4158-a416-0df0c9b99998,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-15e3c1b7-9203-4158-a416-0df0c9b99998.b442346e-3711-4e21-b63d-50fa1f8ecf5f 1G {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:16 devstack sudo[99739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-15e3c1b7-9203-4158-a416-0df0c9b99998,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-15e3c1b7-9203-4158-a416-0df0c9b99998.b442346e-3711-4e21-b63d-50fa1f8ecf5f 1G
Jul 03 01:17:16 devstack sudo[99739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:16 devstack sudo[99734]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bdad88fd-6716-432e-bc49-6b7c58381ac1 tempest-VolumesExtendTest-1472913743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a4090df1-dd84-4112-a16e-ed638334fd9a" returned: 0 in 0.844s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bdad88fd-6716-432e-bc49-6b7c58381ac1 tempest-VolumesExtendTest-1472913743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a4090df1-dd84-4112-a16e-ed638334fd9a {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:16 devstack sudo[99743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a4090df1-dd84-4112-a16e-ed638334fd9a
Jul 03 01:17:16 devstack sudo[99743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:16 devstack sudo[99739]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b553de7a-1e20-4cbc-8431-1ac6e7a8a18d tempest-VolumesSnapshotTestJSON-1936633444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-15e3c1b7-9203-4158-a416-0df0c9b99998,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-15e3c1b7-9203-4158-a416-0df0c9b99998.b442346e-3711-4e21-b63d-50fa1f8ecf5f 1G" returned: 0 in 0.866s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b553de7a-1e20-4cbc-8431-1ac6e7a8a18d tempest-VolumesSnapshotTestJSON-1936633444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15e3c1b7-9203-4158-a416-0df0c9b99998 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-15e3c1b7-9203-4158-a416-0df0c9b99998.b442346e-3711-4e21-b63d-50fa1f8ecf5f {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:17 devstack sudo[99749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15e3c1b7-9203-4158-a416-0df0c9b99998 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-15e3c1b7-9203-4158-a416-0df0c9b99998.b442346e-3711-4e21-b63d-50fa1f8ecf5f
Jul 03 01:17:17 devstack sudo[99749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:17 devstack sudo[99743]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bdad88fd-6716-432e-bc49-6b7c58381ac1 tempest-VolumesExtendTest-1472913743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a4090df1-dd84-4112-a16e-ed638334fd9a" returned: 1 in 0.843s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bdad88fd-6716-432e-bc49-6b7c58381ac1 tempest-VolumesExtendTest-1472913743 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a4090df1-dd84-4112-a16e-ed638334fd9a' failed. Not Retrying. {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 01:17:17 devstack cinder-volume[86891]: DEBUG cinder.volume.volume_utils [None req-bdad88fd-6716-432e-bc49-6b7c58381ac1 tempest-VolumesExtendTest-1472913743 None] Downloaded image 65cceacb-879b-4111-919c-966899666f55 ((None, [{'url': 'file:///opt/stack/data/glance/images/65cceacb-879b-4111-919c-966899666f55', 'metadata': {}}])) to volume a4090df1-dd84-4112-a16e-ed638334fd9a successfully. {{(pid=86891) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 03 01:17:17 devstack cinder-volume[86891]: DEBUG cinder.image.image_utils [None req-bdad88fd-6716-432e-bc49-6b7c58381ac1 tempest-VolumesExtendTest-1472913743 None] Temporary image 65cceacb-879b-4111-919c-966899666f55 for user f4d0653a66fd4e5092b980c352f1f03c is deleted. {{(pid=86891) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 03 01:17:17 devstack cinder-volume[86891]: DEBUG cinder.volume.volume_utils [None req-bdad88fd-6716-432e-bc49-6b7c58381ac1 tempest-VolumesExtendTest-1472913743 None] Marking volume a4090df1-dd84-4112-a16e-ed638334fd9a as bootable. {{(pid=86891) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 03 01:17:17 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdad88fd-6716-432e-bc49-6b7c58381ac1 tempest-VolumesExtendTest-1472913743 None] Copying metadata from image 65cceacb-879b-4111-919c-966899666f55 to a4090df1-dd84-4112-a16e-ed638334fd9a. {{(pid=86891) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 03 01:17:17 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdad88fd-6716-432e-bc49-6b7c58381ac1 tempest-VolumesExtendTest-1472913743 None] Creating volume glance metadata for volume a4090df1-dd84-4112-a16e-ed638334fd9a backed by image 65cceacb-879b-4111-919c-966899666f55 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '65cceacb-879b-4111-919c-966899666f55', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86891) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 03 01:17:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bdad88fd-6716-432e-bc49-6b7c58381ac1 tempest-VolumesExtendTest-1472913743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15d3180a-79a4-4a2e-a272-29b4e14f84e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4090df1-dd84-4112-a16e-ed638334fd9a', 'volume_size': 1, 'image_id': '65cceacb-879b-4111-919c-966899666f55', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/65cceacb-879b-4111-919c-966899666f55', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0d33e5361cf145ffa2791b827e46aea8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '65cceacb-879b-4111-919c-966899666f55', 'created_at': datetime.datetime(2026, 7, 2, 22, 57, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 22, 57, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/65cceacb-879b-4111-919c-966899666f55/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7c5b3531eff0>}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:17:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bdad88fd-6716-432e-bc49-6b7c58381ac1 tempest-VolumesExtendTest-1472913743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (554c44eb-fc9c-4cc0-93f7-fec773d1bbdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:17:17 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-bdad88fd-6716-432e-bc49-6b7c58381ac1 tempest-VolumesExtendTest-1472913743 None] Volume volume-a4090df1-dd84-4112-a16e-ed638334fd9a (a4090df1-dd84-4112-a16e-ed638334fd9a): created successfully
Jul 03 01:17:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bdad88fd-6716-432e-bc49-6b7c58381ac1 tempest-VolumesExtendTest-1472913743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (554c44eb-fc9c-4cc0-93f7-fec773d1bbdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:17:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bdad88fd-6716-432e-bc49-6b7c58381ac1 tempest-VolumesExtendTest-1472913743 None] Flow 'volume_create_manager' (6971db6d-7784-4690-9c08-8c41202bf89b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:17:17 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-bdad88fd-6716-432e-bc49-6b7c58381ac1 tempest-VolumesExtendTest-1472913743 None] Created volume successfully.
Jul 03 01:17:17 devstack sudo[99749]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b553de7a-1e20-4cbc-8431-1ac6e7a8a18d tempest-VolumesSnapshotTestJSON-1936633444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15e3c1b7-9203-4158-a416-0df0c9b99998 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-15e3c1b7-9203-4158-a416-0df0c9b99998.b442346e-3711-4e21-b63d-50fa1f8ecf5f" returned: 0 in 0.899s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:17 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-b553de7a-1e20-4cbc-8431-1ac6e7a8a18d tempest-VolumesSnapshotTestJSON-1936633444 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-15e3c1b7-9203-4158-a416-0df0c9b99998.b442346e-3711-4e21-b63d-50fa1f8ecf5f is being set with open permissions: ugo+rw
Jul 03 01:17:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b553de7a-1e20-4cbc-8431-1ac6e7a8a18d tempest-VolumesSnapshotTestJSON-1936633444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-15e3c1b7-9203-4158-a416-0df0c9b99998.b442346e-3711-4e21-b63d-50fa1f8ecf5f {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:17 devstack sudo[99758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-15e3c1b7-9203-4158-a416-0df0c9b99998.b442346e-3711-4e21-b63d-50fa1f8ecf5f
Jul 03 01:17:17 devstack sudo[99758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-03590596-219c-4626-ac9d-e1f80ac5332c tempest-VolumesExtendTest-1472913743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:17:18 devstack sudo[99758]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b553de7a-1e20-4cbc-8431-1ac6e7a8a18d tempest-VolumesSnapshotTestJSON-1936633444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-15e3c1b7-9203-4158-a416-0df0c9b99998.b442346e-3711-4e21-b63d-50fa1f8ecf5f" returned: 0 in 0.699s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b553de7a-1e20-4cbc-8431-1ac6e7a8a18d tempest-VolumesSnapshotTestJSON-1936633444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-15e3c1b7-9203-4158-a416-0df0c9b99998.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:18 devstack sudo[99763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-15e3c1b7-9203-4158-a416-0df0c9b99998.info
Jul 03 01:17:18 devstack sudo[99763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:19 devstack sudo[99763]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:19 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b553de7a-1e20-4cbc-8431-1ac6e7a8a18d tempest-VolumesSnapshotTestJSON-1936633444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-15e3c1b7-9203-4158-a416-0df0c9b99998.info" returned: 0 in 0.751s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:19 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-b553de7a-1e20-4cbc-8431-1ac6e7a8a18d tempest-VolumesSnapshotTestJSON-1936633444 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-15e3c1b7-9203-4158-a416-0df0c9b99998.info is being set with open permissions: ugo+rw
Jul 03 01:17:19 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b553de7a-1e20-4cbc-8431-1ac6e7a8a18d tempest-VolumesSnapshotTestJSON-1936633444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-15e3c1b7-9203-4158-a416-0df0c9b99998.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:19 devstack sudo[99767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-15e3c1b7-9203-4158-a416-0df0c9b99998.info
Jul 03 01:17:19 devstack sudo[99767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:19 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a992174-aa9f-4e99-9fac-47486ce930b8 tempest-VolumesNegativeTest-1087144029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:17:19 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3a992174-aa9f-4e99-9fac-47486ce930b8 tempest-VolumesNegativeTest-1087144029 None] Flow 'volume_create_manager' (07becd74-d593-4282-a261-1848fac84dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:17:19 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3a992174-aa9f-4e99-9fac-47486ce930b8 tempest-VolumesNegativeTest-1087144029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e935fca1-8e5e-4c94-877c-84d1ae016837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:17:19 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3a992174-aa9f-4e99-9fac-47486ce930b8 tempest-VolumesNegativeTest-1087144029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e935fca1-8e5e-4c94-877c-84d1ae016837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:17:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-606391489',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dc93584-057a-4e37-8ff0-709712e39a95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='530dcb4cc4e0412cae656820c1432068',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:17:20Z,use_quota=True,user_id='f009cb61e30b41dd957f11c87ed23aee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:17:19 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3a992174-aa9f-4e99-9fac-47486ce930b8 tempest-VolumesNegativeTest-1087144029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bd351cd-1164-4e13-a7e7-8be590af1b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:17:19 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3a992174-aa9f-4e99-9fac-47486ce930b8 tempest-VolumesNegativeTest-1087144029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bd351cd-1164-4e13-a7e7-8be590af1b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:17:19 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3a992174-aa9f-4e99-9fac-47486ce930b8 tempest-VolumesNegativeTest-1087144029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bf1c696-a65e-4c1f-8766-04a4693d9eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:17:19 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3a992174-aa9f-4e99-9fac-47486ce930b8 tempest-VolumesNegativeTest-1087144029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bf1c696-a65e-4c1f-8766-04a4693d9eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dc93584-057a-4e37-8ff0-709712e39a95', 'volume_name': 'volume-8dc93584-057a-4e37-8ff0-709712e39a95', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:17:19 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3a992174-aa9f-4e99-9fac-47486ce930b8 tempest-VolumesNegativeTest-1087144029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cdabf11-40a0-40ff-bb3e-c31a1160f76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:17:19 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3a992174-aa9f-4e99-9fac-47486ce930b8 tempest-VolumesNegativeTest-1087144029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cdabf11-40a0-40ff-bb3e-c31a1160f76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:17:19 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3a992174-aa9f-4e99-9fac-47486ce930b8 tempest-VolumesNegativeTest-1087144029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18e18489-4b47-41f3-a5d8-f5d16906f01a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:17:19 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-3a992174-aa9f-4e99-9fac-47486ce930b8 tempest-VolumesNegativeTest-1087144029 None] Volume 8dc93584-057a-4e37-8ff0-709712e39a95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dc93584-057a-4e37-8ff0-709712e39a95', 'volume_size': 1}
Jul 03 01:17:19 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-3a992174-aa9f-4e99-9fac-47486ce930b8 tempest-VolumesNegativeTest-1087144029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:17:20 devstack sudo[99767]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b553de7a-1e20-4cbc-8431-1ac6e7a8a18d tempest-VolumesSnapshotTestJSON-1936633444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-15e3c1b7-9203-4158-a416-0df0c9b99998.info" returned: 0 in 0.631s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b553de7a-1e20-4cbc-8431-1ac6e7a8a18d tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.780s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:17:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-03590596-219c-4626-ac9d-e1f80ac5332c tempest-VolumesExtendTest-1472913743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 2.064s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:17:20 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-b553de7a-1e20-4cbc-8431-1ac6e7a8a18d tempest-VolumesSnapshotTestJSON-1936633444 None] Create snapshot completed successfully
Jul 03 01:17:20 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3fa480c-ffe9-4bf6-9adf-9c2a7ce051d4]: (4, 'raw') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:17:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-03590596-219c-4626-ac9d-e1f80ac5332c tempest-VolumesExtendTest-1472913743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a4090df1-dd84-4112-a16e-ed638334fd9a {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:20 devstack sudo[99770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a4090df1-dd84-4112-a16e-ed638334fd9a
Jul 03 01:17:20 devstack sudo[99770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:20 devstack sudo[99770]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-03590596-219c-4626-ac9d-e1f80ac5332c tempest-VolumesExtendTest-1472913743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a4090df1-dd84-4112-a16e-ed638334fd9a" returned: 0 in 0.730s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-03590596-219c-4626-ac9d-e1f80ac5332c tempest-VolumesExtendTest-1472913743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a4090df1-dd84-4112-a16e-ed638334fd9a {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:20 devstack sudo[99776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a4090df1-dd84-4112-a16e-ed638334fd9a
Jul 03 01:17:20 devstack sudo[99776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:20 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-a71fd35b-1196-474e-a66e-b243f9dab36e tempest-VolumesSnapshotTestJSON-1936633444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:17:21 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a71fd35b-1196-474e-a66e-b243f9dab36e tempest-VolumesSnapshotTestJSON-1936633444 None] Flow 'volume_create_manager' (a0afd8ed-9501-4a3b-bba1-a4c7e9620784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:17:21 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a71fd35b-1196-474e-a66e-b243f9dab36e tempest-VolumesSnapshotTestJSON-1936633444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f557fbe-bfe6-43ef-824b-0530394feba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:17:21 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a71fd35b-1196-474e-a66e-b243f9dab36e tempest-VolumesSnapshotTestJSON-1936633444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f557fbe-bfe6-43ef-824b-0530394feba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2144319499',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9b9f5c1-5bc8-4e96-a1dd-ccaac1f3785c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='419a343cdaef48b4b9fe4a37c9cff5b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:17:21Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=b442346e-3711-4e21-b63d-50fa1f8ecf5f,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:17:21Z,use_quota=True,user_id='d621ec04955f45368862c149d3c33d00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:17:21 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a71fd35b-1196-474e-a66e-b243f9dab36e tempest-VolumesSnapshotTestJSON-1936633444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5421611d-a09b-4a2b-9302-6da3769d77ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:17:21 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a71fd35b-1196-474e-a66e-b243f9dab36e tempest-VolumesSnapshotTestJSON-1936633444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5421611d-a09b-4a2b-9302-6da3769d77ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:17:21 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a71fd35b-1196-474e-a66e-b243f9dab36e tempest-VolumesSnapshotTestJSON-1936633444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3919fc5b-b87e-4474-aff5-2b3f9db7d31f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:17:21 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a71fd35b-1196-474e-a66e-b243f9dab36e tempest-VolumesSnapshotTestJSON-1936633444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3919fc5b-b87e-4474-aff5-2b3f9db7d31f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f9b9f5c1-5bc8-4e96-a1dd-ccaac1f3785c', 'volume_name': 'volume-f9b9f5c1-5bc8-4e96-a1dd-ccaac1f3785c', 'volume_size': 2, 'snapshot_id': 'b442346e-3711-4e21-b63d-50fa1f8ecf5f'}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:17:21 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a71fd35b-1196-474e-a66e-b243f9dab36e tempest-VolumesSnapshotTestJSON-1936633444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8694e5ed-41a2-43b7-81db-cb0fea4c47cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:17:21 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a71fd35b-1196-474e-a66e-b243f9dab36e tempest-VolumesSnapshotTestJSON-1936633444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8694e5ed-41a2-43b7-81db-cb0fea4c47cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:17:21 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a71fd35b-1196-474e-a66e-b243f9dab36e tempest-VolumesSnapshotTestJSON-1936633444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6d80750-c3c9-4f96-8990-053da01f845c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:17:21 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-a71fd35b-1196-474e-a66e-b243f9dab36e tempest-VolumesSnapshotTestJSON-1936633444 None] Volume f9b9f5c1-5bc8-4e96-a1dd-ccaac1f3785c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f9b9f5c1-5bc8-4e96-a1dd-ccaac1f3785c', 'volume_size': 2, 'snapshot_id': 'b442346e-3711-4e21-b63d-50fa1f8ecf5f'}
Jul 03 01:17:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a71fd35b-1196-474e-a66e-b243f9dab36e tempest-VolumesSnapshotTestJSON-1936633444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:17:21 devstack sudo[99776]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-03590596-219c-4626-ac9d-e1f80ac5332c tempest-VolumesExtendTest-1472913743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a4090df1-dd84-4112-a16e-ed638334fd9a" returned: 1 in 0.732s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-03590596-219c-4626-ac9d-e1f80ac5332c tempest-VolumesExtendTest-1472913743 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a4090df1-dd84-4112-a16e-ed638334fd9a' failed. Not Retrying. {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 01:17:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-03590596-219c-4626-ac9d-e1f80ac5332c tempest-VolumesExtendTest-1472913743 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a4090df1-dd84-4112-a16e-ed638334fd9a 2G {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-03590596-219c-4626-ac9d-e1f80ac5332c tempest-VolumesExtendTest-1472913743 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a4090df1-dd84-4112-a16e-ed638334fd9a 2G" returned: 0 in 0.065s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-03590596-219c-4626-ac9d-e1f80ac5332c tempest-VolumesExtendTest-1472913743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.568s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:17:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-3a992174-aa9f-4e99-9fac-47486ce930b8 tempest-VolumesNegativeTest-1087144029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.614s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:17:21 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-3a992174-aa9f-4e99-9fac-47486ce930b8 tempest-VolumesNegativeTest-1087144029 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:17:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-606391489',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dc93584-057a-4e37-8ff0-709712e39a95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='530dcb4cc4e0412cae656820c1432068',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:17:20Z,use_quota=True,user_id='f009cb61e30b41dd957f11c87ed23aee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:17:21 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-3a992174-aa9f-4e99-9fac-47486ce930b8 tempest-VolumesNegativeTest-1087144029 None] Creating volume 8dc93584-057a-4e37-8ff0-709712e39a95 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:17:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-3a992174-aa9f-4e99-9fac-47486ce930b8 tempest-VolumesNegativeTest-1087144029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:17:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-3a992174-aa9f-4e99-9fac-47486ce930b8 tempest-VolumesNegativeTest-1087144029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:17:21 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-3a992174-aa9f-4e99-9fac-47486ce930b8 tempest-VolumesNegativeTest-1087144029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:17:21 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-3a992174-aa9f-4e99-9fac-47486ce930b8 tempest-VolumesNegativeTest-1087144029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:17:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-3a992174-aa9f-4e99-9fac-47486ce930b8 tempest-VolumesNegativeTest-1087144029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:17:21 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-3a992174-aa9f-4e99-9fac-47486ce930b8 tempest-VolumesNegativeTest-1087144029 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:17:21 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-3a992174-aa9f-4e99-9fac-47486ce930b8 tempest-VolumesNegativeTest-1087144029 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:17:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-3a992174-aa9f-4e99-9fac-47486ce930b8 tempest-VolumesNegativeTest-1087144029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8dc93584-057a-4e37-8ff0-709712e39a95 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:21 devstack sudo[99784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8dc93584-057a-4e37-8ff0-709712e39a95 1073741824
Jul 03 01:17:21 devstack sudo[99784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:21 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-03590596-219c-4626-ac9d-e1f80ac5332c tempest-VolumesExtendTest-1472913743 None] Extend volume completed successfully.
Jul 03 01:17:22 devstack sudo[99784]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:22 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-45c3e49d-2d41-42a3-b257-30a9cdea17f1 tempest-VolumesExtendTest-1472913743 None] Acquiring lock "cinder-a4090df1-dd84-4112-a16e-ed638334fd9a-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:17:22 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-3a992174-aa9f-4e99-9fac-47486ce930b8 tempest-VolumesNegativeTest-1087144029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8dc93584-057a-4e37-8ff0-709712e39a95 1073741824" returned: 0 in 0.871s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:22 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-45c3e49d-2d41-42a3-b257-30a9cdea17f1 tempest-VolumesExtendTest-1472913743 None] Lock "cinder-a4090df1-dd84-4112-a16e-ed638334fd9a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:17:22 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-3a992174-aa9f-4e99-9fac-47486ce930b8 tempest-VolumesNegativeTest-1087144029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8dc93584-057a-4e37-8ff0-709712e39a95 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:22 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-45c3e49d-2d41-42a3-b257-30a9cdea17f1 tempest-VolumesExtendTest-1472913743 None] Acquiring lock "cinder-quobyte-a4090df1-dd84-4112-a16e-ed638334fd9a" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:17:22 devstack sudo[99789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8dc93584-057a-4e37-8ff0-709712e39a95
Jul 03 01:17:22 devstack sudo[99789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:22 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-45c3e49d-2d41-42a3-b257-30a9cdea17f1 tempest-VolumesExtendTest-1472913743 None] Lock "cinder-quobyte-a4090df1-dd84-4112-a16e-ed638334fd9a" acquired by "delete_volume" :: waited 0.017s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:17:22 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d63f968-752e-4f1b-9585-a2437ac5d50e]: (4, 'raw') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:17:22 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-45c3e49d-2d41-42a3-b257-30a9cdea17f1 tempest-VolumesExtendTest-1472913743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a4090df1-dd84-4112-a16e-ed638334fd9a {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:22 devstack sudo[99791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a4090df1-dd84-4112-a16e-ed638334fd9a
Jul 03 01:17:22 devstack sudo[99791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:23 devstack sudo[99789]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-3a992174-aa9f-4e99-9fac-47486ce930b8 tempest-VolumesNegativeTest-1087144029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8dc93584-057a-4e37-8ff0-709712e39a95" returned: 0 in 0.663s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:23 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-3a992174-aa9f-4e99-9fac-47486ce930b8 tempest-VolumesNegativeTest-1087144029 None] <== create_volume: return (1588ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:17:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-3a992174-aa9f-4e99-9fac-47486ce930b8 tempest-VolumesNegativeTest-1087144029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.591s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:17:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a71fd35b-1196-474e-a66e-b243f9dab36e tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.097s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:17:23 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-a71fd35b-1196-474e-a66e-b243f9dab36e tempest-VolumesSnapshotTestJSON-1936633444 None] Acquiring lock "cinder-quobyte-b442346e-3711-4e21-b63d-50fa1f8ecf5f-f9b9f5c1-5bc8-4e96-a1dd-ccaac1f3785c" by "_create_volume_from_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:17:23 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3a992174-aa9f-4e99-9fac-47486ce930b8 tempest-VolumesNegativeTest-1087144029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18e18489-4b47-41f3-a5d8-f5d16906f01a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dc93584-057a-4e37-8ff0-709712e39a95', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:17:23 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3a992174-aa9f-4e99-9fac-47486ce930b8 tempest-VolumesNegativeTest-1087144029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (313b7009-3b8c-4c43-a150-8579e59d74dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:17:23 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-a71fd35b-1196-474e-a66e-b243f9dab36e tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "cinder-quobyte-b442346e-3711-4e21-b63d-50fa1f8ecf5f-f9b9f5c1-5bc8-4e96-a1dd-ccaac1f3785c" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:17:23 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-a71fd35b-1196-474e-a66e-b243f9dab36e tempest-VolumesSnapshotTestJSON-1936633444 None] Creating volume f9b9f5c1-5bc8-4e96-a1dd-ccaac1f3785c from snapshot b442346e-3711-4e21-b63d-50fa1f8ecf5f {{(pid=86891) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 03 01:17:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a71fd35b-1196-474e-a66e-b243f9dab36e tempest-VolumesSnapshotTestJSON-1936633444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:17:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a71fd35b-1196-474e-a66e-b243f9dab36e tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:17:23 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-a71fd35b-1196-474e-a66e-b243f9dab36e tempest-VolumesSnapshotTestJSON-1936633444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:17:23 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-a71fd35b-1196-474e-a66e-b243f9dab36e tempest-VolumesSnapshotTestJSON-1936633444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:17:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a71fd35b-1196-474e-a66e-b243f9dab36e tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:17:23 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-a71fd35b-1196-474e-a66e-b243f9dab36e tempest-VolumesSnapshotTestJSON-1936633444 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:17:23 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-a71fd35b-1196-474e-a66e-b243f9dab36e tempest-VolumesSnapshotTestJSON-1936633444 None] Acquiring lock "cinder-quobyte-f9b9f5c1-5bc8-4e96-a1dd-ccaac1f3785c" by "_copy_volume_from_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:17:23 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-3a992174-aa9f-4e99-9fac-47486ce930b8 tempest-VolumesNegativeTest-1087144029 None] Volume volume-8dc93584-057a-4e37-8ff0-709712e39a95 (8dc93584-057a-4e37-8ff0-709712e39a95): created successfully
Jul 03 01:17:23 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3a992174-aa9f-4e99-9fac-47486ce930b8 tempest-VolumesNegativeTest-1087144029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (313b7009-3b8c-4c43-a150-8579e59d74dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:17:23 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3a992174-aa9f-4e99-9fac-47486ce930b8 tempest-VolumesNegativeTest-1087144029 None] Flow 'volume_create_manager' (07becd74-d593-4282-a261-1848fac84dc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:17:23 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-a71fd35b-1196-474e-a66e-b243f9dab36e tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "cinder-quobyte-f9b9f5c1-5bc8-4e96-a1dd-ccaac1f3785c" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:17:23 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-a71fd35b-1196-474e-a66e-b243f9dab36e tempest-VolumesSnapshotTestJSON-1936633444 None] snapshot: b442346e-3711-4e21-b63d-50fa1f8ecf5f, volume: f9b9f5c1-5bc8-4e96-a1dd-ccaac1f3785c,  {{(pid=86891) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 03 01:17:23 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-3a992174-aa9f-4e99-9fac-47486ce930b8 tempest-VolumesNegativeTest-1087144029 None] Created volume successfully.
Jul 03 01:17:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a71fd35b-1196-474e-a66e-b243f9dab36e tempest-VolumesSnapshotTestJSON-1936633444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:17:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a71fd35b-1196-474e-a66e-b243f9dab36e tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:17:23 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-a71fd35b-1196-474e-a66e-b243f9dab36e tempest-VolumesSnapshotTestJSON-1936633444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:17:23 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-a71fd35b-1196-474e-a66e-b243f9dab36e tempest-VolumesSnapshotTestJSON-1936633444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:17:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a71fd35b-1196-474e-a66e-b243f9dab36e tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:17:23 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba2600a-8b1f-4146-a466-73efcd458933]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:17:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a71fd35b-1196-474e-a66e-b243f9dab36e tempest-VolumesSnapshotTestJSON-1936633444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-15e3c1b7-9203-4158-a416-0df0c9b99998.b442346e-3711-4e21-b63d-50fa1f8ecf5f {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:23 devstack sudo[99791]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-45c3e49d-2d41-42a3-b257-30a9cdea17f1 tempest-VolumesExtendTest-1472913743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a4090df1-dd84-4112-a16e-ed638334fd9a" returned: 0 in 0.792s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-45c3e49d-2d41-42a3-b257-30a9cdea17f1 tempest-VolumesExtendTest-1472913743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a4090df1-dd84-4112-a16e-ed638334fd9a {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:23 devstack sudo[99796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-15e3c1b7-9203-4158-a416-0df0c9b99998.b442346e-3711-4e21-b63d-50fa1f8ecf5f
Jul 03 01:17:23 devstack sudo[99796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:23 devstack sudo[99797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a4090df1-dd84-4112-a16e-ed638334fd9a
Jul 03 01:17:23 devstack sudo[99797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:24 devstack sudo[99796]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a71fd35b-1196-474e-a66e-b243f9dab36e tempest-VolumesSnapshotTestJSON-1936633444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-15e3c1b7-9203-4158-a416-0df0c9b99998.b442346e-3711-4e21-b63d-50fa1f8ecf5f" returned: 0 in 0.864s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:24 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-a71fd35b-1196-474e-a66e-b243f9dab36e tempest-VolumesSnapshotTestJSON-1936633444 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-15e3c1b7-9203-4158-a416-0df0c9b99998(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:17:24 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-a71fd35b-1196-474e-a66e-b243f9dab36e tempest-VolumesSnapshotTestJSON-1936633444 None] will copy from snapshot at /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-15e3c1b7-9203-4158-a416-0df0c9b99998 {{(pid=86891) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 03 01:17:24 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-a71fd35b-1196-474e-a66e-b243f9dab36e tempest-VolumesSnapshotTestJSON-1936633444 None] Creating direct copy from snapshot {{(pid=86891) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 03 01:17:24 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4cbf09-c195-49db-826c-6e4deec0777d]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:17:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a71fd35b-1196-474e-a66e-b243f9dab36e tempest-VolumesSnapshotTestJSON-1936633444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-15e3c1b7-9203-4158-a416-0df0c9b99998 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:24 devstack sudo[99797]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-45c3e49d-2d41-42a3-b257-30a9cdea17f1 tempest-VolumesExtendTest-1472913743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a4090df1-dd84-4112-a16e-ed638334fd9a" returned: 1 in 0.844s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-45c3e49d-2d41-42a3-b257-30a9cdea17f1 tempest-VolumesExtendTest-1472913743 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a4090df1-dd84-4112-a16e-ed638334fd9a' failed. Not Retrying. {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 01:17:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-45c3e49d-2d41-42a3-b257-30a9cdea17f1 tempest-VolumesExtendTest-1472913743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a4090df1-dd84-4112-a16e-ed638334fd9a {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:24 devstack sudo[99808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a4090df1-dd84-4112-a16e-ed638334fd9a
Jul 03 01:17:24 devstack sudo[99808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:24 devstack sudo[99807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-15e3c1b7-9203-4158-a416-0df0c9b99998
Jul 03 01:17:24 devstack sudo[99807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:24 devstack sudo[99808]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-45c3e49d-2d41-42a3-b257-30a9cdea17f1 tempest-VolumesExtendTest-1472913743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a4090df1-dd84-4112-a16e-ed638334fd9a" returned: 0 in 0.661s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:24 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-45c3e49d-2d41-42a3-b257-30a9cdea17f1 tempest-VolumesExtendTest-1472913743 None] Lock "cinder-quobyte-a4090df1-dd84-4112-a16e-ed638334fd9a" released by "delete_volume" :: held 2.364s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:17:24 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-45c3e49d-2d41-42a3-b257-30a9cdea17f1 tempest-VolumesExtendTest-1472913743 None] Created reservations ['3c2200af-d173-450c-81b5-7335e38f729e', '4b97ddc5-1ead-47cd-b15b-8f586333fbac', 'c2ca650c-6308-41f4-be5a-84f6fc4af1d8', '79808e2c-80c8-4a2d-bd7e-cca44135987a'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:17:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-45c3e49d-2d41-42a3-b257-30a9cdea17f1 tempest-VolumesExtendTest-1472913743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:17:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-45c3e49d-2d41-42a3-b257-30a9cdea17f1 tempest-VolumesExtendTest-1472913743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:17:25 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-45c3e49d-2d41-42a3-b257-30a9cdea17f1 tempest-VolumesExtendTest-1472913743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:17:25 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-45c3e49d-2d41-42a3-b257-30a9cdea17f1 tempest-VolumesExtendTest-1472913743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:17:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-45c3e49d-2d41-42a3-b257-30a9cdea17f1 tempest-VolumesExtendTest-1472913743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:17:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-45c3e49d-2d41-42a3-b257-30a9cdea17f1 tempest-VolumesExtendTest-1472913743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:25 devstack sudo[99818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:17:25 devstack sudo[99818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:25 devstack sudo[99807]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a71fd35b-1196-474e-a66e-b243f9dab36e tempest-VolumesSnapshotTestJSON-1936633444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-15e3c1b7-9203-4158-a416-0df0c9b99998" returned: 0 in 0.880s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:25 devstack cinder-volume[86891]: DEBUG cinder.utils [None req-a71fd35b-1196-474e-a66e-b243f9dab36e tempest-VolumesSnapshotTestJSON-1936633444 None] Path /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-f9b9f5c1-5bc8-4e96-a1dd-ccaac1f3785c not found in is_blk_device check {{(pid=86891) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 03 01:17:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a71fd35b-1196-474e-a66e-b243f9dab36e tempest-VolumesSnapshotTestJSON-1936633444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-15e3c1b7-9203-4158-a416-0df0c9b99998 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-f9b9f5c1-5bc8-4e96-a1dd-ccaac1f3785c {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:25 devstack sudo[99820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-15e3c1b7-9203-4158-a416-0df0c9b99998 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-f9b9f5c1-5bc8-4e96-a1dd-ccaac1f3785c
Jul 03 01:17:25 devstack sudo[99820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:25 devstack sudo[99818]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-45c3e49d-2d41-42a3-b257-30a9cdea17f1 tempest-VolumesExtendTest-1472913743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.692s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:25 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-45c3e49d-2d41-42a3-b257-30a9cdea17f1 tempest-VolumesExtendTest-1472913743 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:17:25 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-45c3e49d-2d41-42a3-b257-30a9cdea17f1 tempest-VolumesExtendTest-1472913743 None] Deleted volume successfully.
Jul 03 01:17:25 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-45c3e49d-2d41-42a3-b257-30a9cdea17f1 tempest-VolumesExtendTest-1472913743 None] Lock "cinder-a4090df1-dd84-4112-a16e-ed638334fd9a-delete_volume" released by "delete_volume" :: held 3.299s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:17:26 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-3aae43a9-d6bd-4605-b190-d10ee781d781 tempest-VolumesExtendTest-1472913743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:17:26 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3aae43a9-d6bd-4605-b190-d10ee781d781 tempest-VolumesExtendTest-1472913743 None] Flow 'volume_create_manager' (6288ef25-11ea-4e27-8a35-efc2bbed9c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:17:26 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3aae43a9-d6bd-4605-b190-d10ee781d781 tempest-VolumesExtendTest-1472913743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1028d705-57fa-40da-be92-f4bc1d7ed9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:17:26 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3aae43a9-d6bd-4605-b190-d10ee781d781 tempest-VolumesExtendTest-1472913743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1028d705-57fa-40da-be92-f4bc1d7ed9f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:17:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1814810555',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b78c023-d07a-4b9a-9aa6-5bd498624356,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ed70549c8914e1ba780dd2e50c6f7fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:17:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:17:27Z,use_quota=True,user_id='f4d0653a66fd4e5092b980c352f1f03c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:17:26 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3aae43a9-d6bd-4605-b190-d10ee781d781 tempest-VolumesExtendTest-1472913743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8e52907-689e-4304-b5f0-a7643a97ff80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:17:26 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3aae43a9-d6bd-4605-b190-d10ee781d781 tempest-VolumesExtendTest-1472913743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8e52907-689e-4304-b5f0-a7643a97ff80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:17:26 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3aae43a9-d6bd-4605-b190-d10ee781d781 tempest-VolumesExtendTest-1472913743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (534726e4-bcc7-47c4-845d-6b3c47ca6583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:17:26 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3aae43a9-d6bd-4605-b190-d10ee781d781 tempest-VolumesExtendTest-1472913743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (534726e4-bcc7-47c4-845d-6b3c47ca6583) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b78c023-d07a-4b9a-9aa6-5bd498624356', 'volume_name': 'volume-9b78c023-d07a-4b9a-9aa6-5bd498624356', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:17:26 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3aae43a9-d6bd-4605-b190-d10ee781d781 tempest-VolumesExtendTest-1472913743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5542403-4f25-412d-ab3b-88bf8e1faa0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:17:26 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3aae43a9-d6bd-4605-b190-d10ee781d781 tempest-VolumesExtendTest-1472913743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5542403-4f25-412d-ab3b-88bf8e1faa0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:17:26 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3aae43a9-d6bd-4605-b190-d10ee781d781 tempest-VolumesExtendTest-1472913743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05545f11-e151-46e7-a81b-4ca7b183f9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:17:26 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-3aae43a9-d6bd-4605-b190-d10ee781d781 tempest-VolumesExtendTest-1472913743 None] Volume 9b78c023-d07a-4b9a-9aa6-5bd498624356: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b78c023-d07a-4b9a-9aa6-5bd498624356', 'volume_size': 1}
Jul 03 01:17:26 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-3aae43a9-d6bd-4605-b190-d10ee781d781 tempest-VolumesExtendTest-1472913743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:17:30 devstack sudo[99820]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a71fd35b-1196-474e-a66e-b243f9dab36e tempest-VolumesSnapshotTestJSON-1936633444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-15e3c1b7-9203-4158-a416-0df0c9b99998 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-f9b9f5c1-5bc8-4e96-a1dd-ccaac1f3785c" returned: 0 in 5.287s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:30 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[7592b7f4-cdeb-454e-9532-65d714597b64]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:17:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a71fd35b-1196-474e-a66e-b243f9dab36e tempest-VolumesSnapshotTestJSON-1936633444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-15e3c1b7-9203-4158-a416-0df0c9b99998 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:30 devstack sudo[99871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-15e3c1b7-9203-4158-a416-0df0c9b99998
Jul 03 01:17:30 devstack sudo[99871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:31 devstack sudo[99871]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:31 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a71fd35b-1196-474e-a66e-b243f9dab36e tempest-VolumesSnapshotTestJSON-1936633444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-15e3c1b7-9203-4158-a416-0df0c9b99998" returned: 0 in 1.067s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:31 devstack cinder-volume[86891]: DEBUG cinder.image.image_utils [None req-a71fd35b-1196-474e-a66e-b243f9dab36e tempest-VolumesSnapshotTestJSON-1936633444 None] Image conversion details: src /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-15e3c1b7-9203-4158-a416-0df0c9b99998, size 1024.00 MB, duration 5.29 sec, destination /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-f9b9f5c1-5bc8-4e96-a1dd-ccaac1f3785c {{(pid=86891) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 03 01:17:31 devstack cinder-volume[86891]: INFO cinder.image.image_utils [None req-a71fd35b-1196-474e-a66e-b243f9dab36e tempest-VolumesSnapshotTestJSON-1936633444 None] Converted 1024.00 MB image at 193.64 MB/s
Jul 03 01:17:31 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-a71fd35b-1196-474e-a66e-b243f9dab36e tempest-VolumesSnapshotTestJSON-1936633444 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-f9b9f5c1-5bc8-4e96-a1dd-ccaac1f3785c is being set with open permissions: ugo+rw
Jul 03 01:17:31 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a71fd35b-1196-474e-a66e-b243f9dab36e tempest-VolumesSnapshotTestJSON-1936633444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-f9b9f5c1-5bc8-4e96-a1dd-ccaac1f3785c {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:31 devstack sudo[99876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-f9b9f5c1-5bc8-4e96-a1dd-ccaac1f3785c
Jul 03 01:17:31 devstack sudo[99876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:32 devstack sudo[99876]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a71fd35b-1196-474e-a66e-b243f9dab36e tempest-VolumesSnapshotTestJSON-1936633444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-f9b9f5c1-5bc8-4e96-a1dd-ccaac1f3785c" returned: 0 in 0.740s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:32 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-a71fd35b-1196-474e-a66e-b243f9dab36e tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "cinder-quobyte-f9b9f5c1-5bc8-4e96-a1dd-ccaac1f3785c" released by "_copy_volume_from_snapshot" :: held 8.952s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:17:32 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-a71fd35b-1196-474e-a66e-b243f9dab36e tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "cinder-quobyte-b442346e-3711-4e21-b63d-50fa1f8ecf5f-f9b9f5c1-5bc8-4e96-a1dd-ccaac1f3785c" released by "_create_volume_from_snapshot" :: held 9.007s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:17:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a71fd35b-1196-474e-a66e-b243f9dab36e tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.042s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:17:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-3aae43a9-d6bd-4605-b190-d10ee781d781 tempest-VolumesExtendTest-1472913743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.355s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:17:32 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-3aae43a9-d6bd-4605-b190-d10ee781d781 tempest-VolumesExtendTest-1472913743 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:17:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1814810555',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b78c023-d07a-4b9a-9aa6-5bd498624356,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ed70549c8914e1ba780dd2e50c6f7fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:17:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:17:27Z,use_quota=True,user_id='f4d0653a66fd4e5092b980c352f1f03c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:17:32 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-3aae43a9-d6bd-4605-b190-d10ee781d781 tempest-VolumesExtendTest-1472913743 None] Creating volume 9b78c023-d07a-4b9a-9aa6-5bd498624356 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:17:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-3aae43a9-d6bd-4605-b190-d10ee781d781 tempest-VolumesExtendTest-1472913743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:17:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-3aae43a9-d6bd-4605-b190-d10ee781d781 tempest-VolumesExtendTest-1472913743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:17:32 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-3aae43a9-d6bd-4605-b190-d10ee781d781 tempest-VolumesExtendTest-1472913743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:17:32 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-3aae43a9-d6bd-4605-b190-d10ee781d781 tempest-VolumesExtendTest-1472913743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:17:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-3aae43a9-d6bd-4605-b190-d10ee781d781 tempest-VolumesExtendTest-1472913743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:17:32 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-3aae43a9-d6bd-4605-b190-d10ee781d781 tempest-VolumesExtendTest-1472913743 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:17:32 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-3aae43a9-d6bd-4605-b190-d10ee781d781 tempest-VolumesExtendTest-1472913743 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:17:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-3aae43a9-d6bd-4605-b190-d10ee781d781 tempest-VolumesExtendTest-1472913743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9b78c023-d07a-4b9a-9aa6-5bd498624356 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:32 devstack sudo[99900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9b78c023-d07a-4b9a-9aa6-5bd498624356 1073741824
Jul 03 01:17:32 devstack sudo[99900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:32 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a71fd35b-1196-474e-a66e-b243f9dab36e tempest-VolumesSnapshotTestJSON-1936633444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6d80750-c3c9-4f96-8990-053da01f845c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9b9f5c1-5bc8-4e96-a1dd-ccaac1f3785c', 'volume_size': 2, 'snapshot_id': 'b442346e-3711-4e21-b63d-50fa1f8ecf5f'}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:17:32 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a71fd35b-1196-474e-a66e-b243f9dab36e tempest-VolumesSnapshotTestJSON-1936633444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (541a6553-d448-462b-8902-1aacc855f688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:17:32 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-a71fd35b-1196-474e-a66e-b243f9dab36e tempest-VolumesSnapshotTestJSON-1936633444 None] Volume volume-f9b9f5c1-5bc8-4e96-a1dd-ccaac1f3785c (f9b9f5c1-5bc8-4e96-a1dd-ccaac1f3785c): created successfully
Jul 03 01:17:32 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a71fd35b-1196-474e-a66e-b243f9dab36e tempest-VolumesSnapshotTestJSON-1936633444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (541a6553-d448-462b-8902-1aacc855f688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:17:32 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a71fd35b-1196-474e-a66e-b243f9dab36e tempest-VolumesSnapshotTestJSON-1936633444 None] Flow 'volume_create_manager' (a0afd8ed-9501-4a3b-bba1-a4c7e9620784) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:17:32 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-a71fd35b-1196-474e-a66e-b243f9dab36e tempest-VolumesSnapshotTestJSON-1936633444 None] Created volume successfully.
Jul 03 01:17:33 devstack sudo[99900]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-3aae43a9-d6bd-4605-b190-d10ee781d781 tempest-VolumesExtendTest-1472913743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9b78c023-d07a-4b9a-9aa6-5bd498624356 1073741824" returned: 0 in 0.842s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-3aae43a9-d6bd-4605-b190-d10ee781d781 tempest-VolumesExtendTest-1472913743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9b78c023-d07a-4b9a-9aa6-5bd498624356 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:33 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-2e882d71-1e09-42e0-88a1-7809a632e245 tempest-VolumesSnapshotTestJSON-1936633444 None] Acquiring lock "cinder-f9b9f5c1-5bc8-4e96-a1dd-ccaac1f3785c-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:17:33 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-2e882d71-1e09-42e0-88a1-7809a632e245 tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "cinder-f9b9f5c1-5bc8-4e96-a1dd-ccaac1f3785c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:17:33 devstack sudo[99907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9b78c023-d07a-4b9a-9aa6-5bd498624356
Jul 03 01:17:33 devstack sudo[99907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:33 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-2e882d71-1e09-42e0-88a1-7809a632e245 tempest-VolumesSnapshotTestJSON-1936633444 None] Acquiring lock "cinder-quobyte-f9b9f5c1-5bc8-4e96-a1dd-ccaac1f3785c" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:17:33 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-2e882d71-1e09-42e0-88a1-7809a632e245 tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "cinder-quobyte-f9b9f5c1-5bc8-4e96-a1dd-ccaac1f3785c" acquired by "delete_volume" :: waited 0.019s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:17:33 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[d88d6b77-1d53-444d-a4d4-e90b02274246]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:17:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-2e882d71-1e09-42e0-88a1-7809a632e245 tempest-VolumesSnapshotTestJSON-1936633444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-f9b9f5c1-5bc8-4e96-a1dd-ccaac1f3785c {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:33 devstack sudo[99909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-f9b9f5c1-5bc8-4e96-a1dd-ccaac1f3785c
Jul 03 01:17:33 devstack sudo[99909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:33 devstack sudo[99907]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-3aae43a9-d6bd-4605-b190-d10ee781d781 tempest-VolumesExtendTest-1472913743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9b78c023-d07a-4b9a-9aa6-5bd498624356" returned: 0 in 0.694s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:33 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-3aae43a9-d6bd-4605-b190-d10ee781d781 tempest-VolumesExtendTest-1472913743 None] <== create_volume: return (1588ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:17:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-3aae43a9-d6bd-4605-b190-d10ee781d781 tempest-VolumesExtendTest-1472913743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.592s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:17:33 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3aae43a9-d6bd-4605-b190-d10ee781d781 tempest-VolumesExtendTest-1472913743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05545f11-e151-46e7-a81b-4ca7b183f9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b78c023-d07a-4b9a-9aa6-5bd498624356', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:17:33 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3aae43a9-d6bd-4605-b190-d10ee781d781 tempest-VolumesExtendTest-1472913743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8389dbef-0b4b-4d3a-a377-9e13e15db105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:17:33 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-3aae43a9-d6bd-4605-b190-d10ee781d781 tempest-VolumesExtendTest-1472913743 None] Volume volume-9b78c023-d07a-4b9a-9aa6-5bd498624356 (9b78c023-d07a-4b9a-9aa6-5bd498624356): created successfully
Jul 03 01:17:33 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3aae43a9-d6bd-4605-b190-d10ee781d781 tempest-VolumesExtendTest-1472913743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8389dbef-0b4b-4d3a-a377-9e13e15db105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:17:33 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3aae43a9-d6bd-4605-b190-d10ee781d781 tempest-VolumesExtendTest-1472913743 None] Flow 'volume_create_manager' (6288ef25-11ea-4e27-8a35-efc2bbed9c92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:17:33 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-3aae43a9-d6bd-4605-b190-d10ee781d781 tempest-VolumesExtendTest-1472913743 None] Created volume successfully.
Jul 03 01:17:34 devstack sudo[99909]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-2e882d71-1e09-42e0-88a1-7809a632e245 tempest-VolumesSnapshotTestJSON-1936633444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-f9b9f5c1-5bc8-4e96-a1dd-ccaac1f3785c" returned: 0 in 0.776s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-2e882d71-1e09-42e0-88a1-7809a632e245 tempest-VolumesSnapshotTestJSON-1936633444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-f9b9f5c1-5bc8-4e96-a1dd-ccaac1f3785c {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:34 devstack sudo[99915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-f9b9f5c1-5bc8-4e96-a1dd-ccaac1f3785c
Jul 03 01:17:34 devstack sudo[99915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-31c6d554-395d-4ca0-b217-807304b3768b tempest-VolumesExtendTest-1472913743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:17:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-31c6d554-395d-4ca0-b217-807304b3768b tempest-VolumesExtendTest-1472913743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:17:34 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-31c6d554-395d-4ca0-b217-807304b3768b tempest-VolumesExtendTest-1472913743 None] Creating offline snapshot ff743f9c-fbb3-4268-bad8-0af73a23d2f0 of volume 9b78c023-d07a-4b9a-9aa6-5bd498624356 {{(pid=86891) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 01:17:34 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[02dff794-b312-4296-bdb5-826880f74df7]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:17:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-31c6d554-395d-4ca0-b217-807304b3768b tempest-VolumesExtendTest-1472913743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9b78c023-d07a-4b9a-9aa6-5bd498624356 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:34 devstack sudo[99917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9b78c023-d07a-4b9a-9aa6-5bd498624356
Jul 03 01:17:34 devstack sudo[99917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:34 devstack sudo[99915]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-2e882d71-1e09-42e0-88a1-7809a632e245 tempest-VolumesSnapshotTestJSON-1936633444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-f9b9f5c1-5bc8-4e96-a1dd-ccaac1f3785c" returned: 0 in 0.731s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:34 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-2e882d71-1e09-42e0-88a1-7809a632e245 tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "cinder-quobyte-f9b9f5c1-5bc8-4e96-a1dd-ccaac1f3785c" released by "delete_volume" :: held 1.564s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:17:34 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-2e882d71-1e09-42e0-88a1-7809a632e245 tempest-VolumesSnapshotTestJSON-1936633444 None] Created reservations ['833728e1-7f4c-4322-b8a6-18184418190f', 'cbc0fd4a-0861-4bce-bfa4-98f848586bd4', 'cf9b1da9-562d-4a81-b571-47be9698851c', 'e6d19da7-a11d-4917-af0e-94a40551b643'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:17:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-2e882d71-1e09-42e0-88a1-7809a632e245 tempest-VolumesSnapshotTestJSON-1936633444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:17:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-2e882d71-1e09-42e0-88a1-7809a632e245 tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:17:34 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-2e882d71-1e09-42e0-88a1-7809a632e245 tempest-VolumesSnapshotTestJSON-1936633444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:17:34 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-2e882d71-1e09-42e0-88a1-7809a632e245 tempest-VolumesSnapshotTestJSON-1936633444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:17:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-2e882d71-1e09-42e0-88a1-7809a632e245 tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:17:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-2e882d71-1e09-42e0-88a1-7809a632e245 tempest-VolumesSnapshotTestJSON-1936633444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:34 devstack sudo[99921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:17:34 devstack sudo[99921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:35 devstack sudo[99917]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-31c6d554-395d-4ca0-b217-807304b3768b tempest-VolumesExtendTest-1472913743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9b78c023-d07a-4b9a-9aa6-5bd498624356" returned: 0 in 0.780s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-31c6d554-395d-4ca0-b217-807304b3768b tempest-VolumesExtendTest-1472913743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9b78c023-d07a-4b9a-9aa6-5bd498624356,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9b78c023-d07a-4b9a-9aa6-5bd498624356.ff743f9c-fbb3-4268-bad8-0af73a23d2f0 1G {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:35 devstack sudo[99925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9b78c023-d07a-4b9a-9aa6-5bd498624356,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9b78c023-d07a-4b9a-9aa6-5bd498624356.ff743f9c-fbb3-4268-bad8-0af73a23d2f0 1G
Jul 03 01:17:35 devstack sudo[99925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:35 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-2f226956-411c-4664-b26d-b75a7b5e98e5 tempest-VolumesSnapshotTestJSON-1936633444 None] Acquiring lock "cinder-b442346e-3711-4e21-b63d-50fa1f8ecf5f-delete_snapshot" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:17:35 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-2f226956-411c-4664-b26d-b75a7b5e98e5 tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "cinder-b442346e-3711-4e21-b63d-50fa1f8ecf5f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:17:35 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-2f226956-411c-4664-b26d-b75a7b5e98e5 tempest-VolumesSnapshotTestJSON-1936633444 None] Acquiring lock "cinder-quobyte-15e3c1b7-9203-4158-a416-0df0c9b99998" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:17:35 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-2f226956-411c-4664-b26d-b75a7b5e98e5 tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "cinder-quobyte-15e3c1b7-9203-4158-a416-0df0c9b99998" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:17:35 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-2f226956-411c-4664-b26d-b75a7b5e98e5 tempest-VolumesSnapshotTestJSON-1936633444 None] Acquiring lock "cinder-quobyte-b442346e-3711-4e21-b63d-50fa1f8ecf5f" by "_delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:17:35 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-2f226956-411c-4664-b26d-b75a7b5e98e5 tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "cinder-quobyte-b442346e-3711-4e21-b63d-50fa1f8ecf5f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:17:35 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-2f226956-411c-4664-b26d-b75a7b5e98e5 tempest-VolumesSnapshotTestJSON-1936633444 None] Deleting offline snapshot b442346e-3711-4e21-b63d-50fa1f8ecf5f of volume 15e3c1b7-9203-4158-a416-0df0c9b99998 {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 01:17:35 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-2f226956-411c-4664-b26d-b75a7b5e98e5 tempest-VolumesSnapshotTestJSON-1936633444 None] snapshot_file for this snap is: volume-15e3c1b7-9203-4158-a416-0df0c9b99998.b442346e-3711-4e21-b63d-50fa1f8ecf5f {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 01:17:35 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae0f289-6a49-4e86-a2da-80854159e221]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:17:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-2f226956-411c-4664-b26d-b75a7b5e98e5 tempest-VolumesSnapshotTestJSON-1936633444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-15e3c1b7-9203-4158-a416-0df0c9b99998.b442346e-3711-4e21-b63d-50fa1f8ecf5f {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:35 devstack sudo[99921]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-2e882d71-1e09-42e0-88a1-7809a632e245 tempest-VolumesSnapshotTestJSON-1936633444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.667s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:35 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-2e882d71-1e09-42e0-88a1-7809a632e245 tempest-VolumesSnapshotTestJSON-1936633444 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:17:35 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-2e882d71-1e09-42e0-88a1-7809a632e245 tempest-VolumesSnapshotTestJSON-1936633444 None] Deleted volume successfully.
Jul 03 01:17:35 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-2e882d71-1e09-42e0-88a1-7809a632e245 tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "cinder-f9b9f5c1-5bc8-4e96-a1dd-ccaac1f3785c-delete_volume" released by "delete_volume" :: held 2.450s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:17:35 devstack sudo[99928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-15e3c1b7-9203-4158-a416-0df0c9b99998.b442346e-3711-4e21-b63d-50fa1f8ecf5f
Jul 03 01:17:35 devstack sudo[99928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:35 devstack sudo[99925]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-31c6d554-395d-4ca0-b217-807304b3768b tempest-VolumesExtendTest-1472913743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9b78c023-d07a-4b9a-9aa6-5bd498624356,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9b78c023-d07a-4b9a-9aa6-5bd498624356.ff743f9c-fbb3-4268-bad8-0af73a23d2f0 1G" returned: 0 in 0.916s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-31c6d554-395d-4ca0-b217-807304b3768b tempest-VolumesExtendTest-1472913743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b78c023-d07a-4b9a-9aa6-5bd498624356 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9b78c023-d07a-4b9a-9aa6-5bd498624356.ff743f9c-fbb3-4268-bad8-0af73a23d2f0 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:36 devstack sudo[99937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b78c023-d07a-4b9a-9aa6-5bd498624356 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9b78c023-d07a-4b9a-9aa6-5bd498624356.ff743f9c-fbb3-4268-bad8-0af73a23d2f0
Jul 03 01:17:36 devstack sudo[99937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:36 devstack sudo[99928]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-2f226956-411c-4664-b26d-b75a7b5e98e5 tempest-VolumesSnapshotTestJSON-1936633444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-15e3c1b7-9203-4158-a416-0df0c9b99998.b442346e-3711-4e21-b63d-50fa1f8ecf5f" returned: 0 in 0.845s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:36 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-2f226956-411c-4664-b26d-b75a7b5e98e5 tempest-VolumesSnapshotTestJSON-1936633444 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-15e3c1b7-9203-4158-a416-0df0c9b99998(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:17:36 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff57f1ed-10a2-4bb1-b84c-f414250458c1]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:17:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-2f226956-411c-4664-b26d-b75a7b5e98e5 tempest-VolumesSnapshotTestJSON-1936633444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-15e3c1b7-9203-4158-a416-0df0c9b99998 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:36 devstack sudo[99942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-15e3c1b7-9203-4158-a416-0df0c9b99998
Jul 03 01:17:36 devstack sudo[99942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:36 devstack sudo[99937]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-31c6d554-395d-4ca0-b217-807304b3768b tempest-VolumesExtendTest-1472913743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b78c023-d07a-4b9a-9aa6-5bd498624356 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9b78c023-d07a-4b9a-9aa6-5bd498624356.ff743f9c-fbb3-4268-bad8-0af73a23d2f0" returned: 0 in 0.699s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:36 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-31c6d554-395d-4ca0-b217-807304b3768b tempest-VolumesExtendTest-1472913743 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9b78c023-d07a-4b9a-9aa6-5bd498624356.ff743f9c-fbb3-4268-bad8-0af73a23d2f0 is being set with open permissions: ugo+rw
Jul 03 01:17:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-31c6d554-395d-4ca0-b217-807304b3768b tempest-VolumesExtendTest-1472913743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9b78c023-d07a-4b9a-9aa6-5bd498624356.ff743f9c-fbb3-4268-bad8-0af73a23d2f0 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:36 devstack sudo[99947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9b78c023-d07a-4b9a-9aa6-5bd498624356.ff743f9c-fbb3-4268-bad8-0af73a23d2f0
Jul 03 01:17:36 devstack sudo[99947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:37 devstack sudo[99942]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-2f226956-411c-4664-b26d-b75a7b5e98e5 tempest-VolumesSnapshotTestJSON-1936633444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-15e3c1b7-9203-4158-a416-0df0c9b99998" returned: 0 in 0.751s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-2f226956-411c-4664-b26d-b75a7b5e98e5 tempest-VolumesSnapshotTestJSON-1936633444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-15e3c1b7-9203-4158-a416-0df0c9b99998.b442346e-3711-4e21-b63d-50fa1f8ecf5f {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:37 devstack sudo[99952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-15e3c1b7-9203-4158-a416-0df0c9b99998.b442346e-3711-4e21-b63d-50fa1f8ecf5f
Jul 03 01:17:37 devstack sudo[99952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:37 devstack sudo[99947]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-31c6d554-395d-4ca0-b217-807304b3768b tempest-VolumesExtendTest-1472913743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9b78c023-d07a-4b9a-9aa6-5bd498624356.ff743f9c-fbb3-4268-bad8-0af73a23d2f0" returned: 0 in 0.646s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-31c6d554-395d-4ca0-b217-807304b3768b tempest-VolumesExtendTest-1472913743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9b78c023-d07a-4b9a-9aa6-5bd498624356.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:37 devstack sudo[99970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9b78c023-d07a-4b9a-9aa6-5bd498624356.info
Jul 03 01:17:37 devstack sudo[99970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:38 devstack sudo[99970]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-31c6d554-395d-4ca0-b217-807304b3768b tempest-VolumesExtendTest-1472913743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9b78c023-d07a-4b9a-9aa6-5bd498624356.info" returned: 0 in 1.068s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:38 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-31c6d554-395d-4ca0-b217-807304b3768b tempest-VolumesExtendTest-1472913743 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9b78c023-d07a-4b9a-9aa6-5bd498624356.info is being set with open permissions: ugo+rw
Jul 03 01:17:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-31c6d554-395d-4ca0-b217-807304b3768b tempest-VolumesExtendTest-1472913743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9b78c023-d07a-4b9a-9aa6-5bd498624356.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:38 devstack sudo[100026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9b78c023-d07a-4b9a-9aa6-5bd498624356.info
Jul 03 01:17:38 devstack sudo[100026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:38 devstack sudo[99952]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-2f226956-411c-4664-b26d-b75a7b5e98e5 tempest-VolumesSnapshotTestJSON-1936633444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-15e3c1b7-9203-4158-a416-0df0c9b99998.b442346e-3711-4e21-b63d-50fa1f8ecf5f" returned: 0 in 1.361s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-2f226956-411c-4664-b26d-b75a7b5e98e5 tempest-VolumesSnapshotTestJSON-1936633444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-15e3c1b7-9203-4158-a416-0df0c9b99998.b442346e-3711-4e21-b63d-50fa1f8ecf5f {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:38 devstack sudo[100030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-15e3c1b7-9203-4158-a416-0df0c9b99998.b442346e-3711-4e21-b63d-50fa1f8ecf5f
Jul 03 01:17:38 devstack sudo[100030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:39 devstack sudo[100026]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-31c6d554-395d-4ca0-b217-807304b3768b tempest-VolumesExtendTest-1472913743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9b78c023-d07a-4b9a-9aa6-5bd498624356.info" returned: 0 in 0.721s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-31c6d554-395d-4ca0-b217-807304b3768b tempest-VolumesExtendTest-1472913743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.965s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:17:39 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-31c6d554-395d-4ca0-b217-807304b3768b tempest-VolumesExtendTest-1472913743 None] Create snapshot completed successfully
Jul 03 01:17:39 devstack sudo[100030]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-2f226956-411c-4664-b26d-b75a7b5e98e5 tempest-VolumesSnapshotTestJSON-1936633444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-15e3c1b7-9203-4158-a416-0df0c9b99998.b442346e-3711-4e21-b63d-50fa1f8ecf5f" returned: 0 in 0.725s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:39 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-2f226956-411c-4664-b26d-b75a7b5e98e5 tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "cinder-quobyte-b442346e-3711-4e21-b63d-50fa1f8ecf5f" released by "_delete_snapshot" :: held 3.793s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:17:39 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-2f226956-411c-4664-b26d-b75a7b5e98e5 tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "cinder-quobyte-15e3c1b7-9203-4158-a416-0df0c9b99998" released by "delete_snapshot" :: held 3.819s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:17:39 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-2f226956-411c-4664-b26d-b75a7b5e98e5 tempest-VolumesSnapshotTestJSON-1936633444 None] Created reservations ['b1349c30-0fe8-4d69-ae04-8cbd9fa5eacd', '445ba9d8-f10c-4683-b4a7-16df22f3cad6', '1e77f49f-8564-45b9-b65c-c34f0569e7d9', 'cdc28bcb-d622-449b-acdb-8dabe274fdf1'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:17:39 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-2f226956-411c-4664-b26d-b75a7b5e98e5 tempest-VolumesSnapshotTestJSON-1936633444 None] Delete snapshot completed successfully.
Jul 03 01:17:39 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-2f226956-411c-4664-b26d-b75a7b5e98e5 tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "cinder-b442346e-3711-4e21-b63d-50fa1f8ecf5f-delete_snapshot" released by "delete_snapshot" :: held 3.956s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:17:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f3b722c6-e97b-4454-8f3c-2280dc5a4964 tempest-VolumesExtendTest-1472913743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:17:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f3b722c6-e97b-4454-8f3c-2280dc5a4964 tempest-VolumesExtendTest-1472913743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:17:39 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e13e51-665a-4842-82b0-ee916fbc95ab]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:17:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f3b722c6-e97b-4454-8f3c-2280dc5a4964 tempest-VolumesExtendTest-1472913743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9b78c023-d07a-4b9a-9aa6-5bd498624356 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:39 devstack sudo[100036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9b78c023-d07a-4b9a-9aa6-5bd498624356
Jul 03 01:17:39 devstack sudo[100036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:39 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-a82e90e6-631b-4759-8033-f9afaf94786d tempest-VolumesSnapshotTestJSON-1936633444 None] Acquiring lock "cinder-15e3c1b7-9203-4158-a416-0df0c9b99998-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:17:39 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-a82e90e6-631b-4759-8033-f9afaf94786d tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "cinder-15e3c1b7-9203-4158-a416-0df0c9b99998-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:17:39 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-a82e90e6-631b-4759-8033-f9afaf94786d tempest-VolumesSnapshotTestJSON-1936633444 None] Acquiring lock "cinder-quobyte-15e3c1b7-9203-4158-a416-0df0c9b99998" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:17:40 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-a82e90e6-631b-4759-8033-f9afaf94786d tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "cinder-quobyte-15e3c1b7-9203-4158-a416-0df0c9b99998" acquired by "delete_volume" :: waited 0.030s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:17:40 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdde3f9b-eba6-41c7-bfa9-5afbe02164d0]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:17:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a82e90e6-631b-4759-8033-f9afaf94786d tempest-VolumesSnapshotTestJSON-1936633444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-15e3c1b7-9203-4158-a416-0df0c9b99998 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:40 devstack sudo[100039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-15e3c1b7-9203-4158-a416-0df0c9b99998
Jul 03 01:17:40 devstack sudo[100039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:40 devstack sudo[100036]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f3b722c6-e97b-4454-8f3c-2280dc5a4964 tempest-VolumesExtendTest-1472913743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9b78c023-d07a-4b9a-9aa6-5bd498624356" returned: 0 in 1.245s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f3b722c6-e97b-4454-8f3c-2280dc5a4964 tempest-VolumesExtendTest-1472913743 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9b78c023-d07a-4b9a-9aa6-5bd498624356.ff743f9c-fbb3-4268-bad8-0af73a23d2f0 2G {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:41 devstack sudo[100039]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a82e90e6-631b-4759-8033-f9afaf94786d tempest-VolumesSnapshotTestJSON-1936633444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-15e3c1b7-9203-4158-a416-0df0c9b99998" returned: 0 in 0.987s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a82e90e6-631b-4759-8033-f9afaf94786d tempest-VolumesSnapshotTestJSON-1936633444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-15e3c1b7-9203-4158-a416-0df0c9b99998 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f3b722c6-e97b-4454-8f3c-2280dc5a4964 tempest-VolumesExtendTest-1472913743 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9b78c023-d07a-4b9a-9aa6-5bd498624356.ff743f9c-fbb3-4268-bad8-0af73a23d2f0 2G" returned: 0 in 0.173s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f3b722c6-e97b-4454-8f3c-2280dc5a4964 tempest-VolumesExtendTest-1472913743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.471s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:17:41 devstack sudo[100056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-15e3c1b7-9203-4158-a416-0df0c9b99998
Jul 03 01:17:41 devstack sudo[100056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:41 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-f3b722c6-e97b-4454-8f3c-2280dc5a4964 tempest-VolumesExtendTest-1472913743 None] Extend volume completed successfully.
Jul 03 01:17:41 devstack sudo[100056]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a82e90e6-631b-4759-8033-f9afaf94786d tempest-VolumesSnapshotTestJSON-1936633444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-15e3c1b7-9203-4158-a416-0df0c9b99998" returned: 0 in 0.764s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:41 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-a82e90e6-631b-4759-8033-f9afaf94786d tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "cinder-quobyte-15e3c1b7-9203-4158-a416-0df0c9b99998" released by "delete_volume" :: held 1.853s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:17:41 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-a82e90e6-631b-4759-8033-f9afaf94786d tempest-VolumesSnapshotTestJSON-1936633444 None] Created reservations ['5297482a-4ea1-49dc-b842-2dd07c5e7848', '82ebfb62-4a02-4bce-8514-57ffc9971375', 'f3caa796-8e04-448e-b283-960fa4767179', '44179f2b-82b7-4ae0-adab-c0cd9935f5f1'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:17:42 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d1c5fcab-3af0-43db-807b-1ddfeb4dbd1a tempest-VolumesExtendTest-1472913743 None] Acquiring lock "cinder-ff743f9c-fbb3-4268-bad8-0af73a23d2f0-delete_snapshot" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:17:42 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d1c5fcab-3af0-43db-807b-1ddfeb4dbd1a tempest-VolumesExtendTest-1472913743 None] Lock "cinder-ff743f9c-fbb3-4268-bad8-0af73a23d2f0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.060s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:17:42 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d1c5fcab-3af0-43db-807b-1ddfeb4dbd1a tempest-VolumesExtendTest-1472913743 None] Acquiring lock "cinder-quobyte-9b78c023-d07a-4b9a-9aa6-5bd498624356" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:17:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a82e90e6-631b-4759-8033-f9afaf94786d tempest-VolumesSnapshotTestJSON-1936633444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:17:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a82e90e6-631b-4759-8033-f9afaf94786d tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:17:42 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-a82e90e6-631b-4759-8033-f9afaf94786d tempest-VolumesSnapshotTestJSON-1936633444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:17:42 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-a82e90e6-631b-4759-8033-f9afaf94786d tempest-VolumesSnapshotTestJSON-1936633444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:17:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a82e90e6-631b-4759-8033-f9afaf94786d tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:17:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a82e90e6-631b-4759-8033-f9afaf94786d tempest-VolumesSnapshotTestJSON-1936633444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:42 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d1c5fcab-3af0-43db-807b-1ddfeb4dbd1a tempest-VolumesExtendTest-1472913743 None] Lock "cinder-quobyte-9b78c023-d07a-4b9a-9aa6-5bd498624356" acquired by "delete_snapshot" :: waited 0.054s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:17:42 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d1c5fcab-3af0-43db-807b-1ddfeb4dbd1a tempest-VolumesExtendTest-1472913743 None] Acquiring lock "cinder-quobyte-ff743f9c-fbb3-4268-bad8-0af73a23d2f0" by "_delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:17:42 devstack sudo[100099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:17:42 devstack sudo[100099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:42 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d1c5fcab-3af0-43db-807b-1ddfeb4dbd1a tempest-VolumesExtendTest-1472913743 None] Lock "cinder-quobyte-ff743f9c-fbb3-4268-bad8-0af73a23d2f0" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:17:42 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-d1c5fcab-3af0-43db-807b-1ddfeb4dbd1a tempest-VolumesExtendTest-1472913743 None] Deleting offline snapshot ff743f9c-fbb3-4268-bad8-0af73a23d2f0 of volume 9b78c023-d07a-4b9a-9aa6-5bd498624356 {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 01:17:42 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-d1c5fcab-3af0-43db-807b-1ddfeb4dbd1a tempest-VolumesExtendTest-1472913743 None] snapshot_file for this snap is: volume-9b78c023-d07a-4b9a-9aa6-5bd498624356.ff743f9c-fbb3-4268-bad8-0af73a23d2f0 {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 01:17:42 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8fb5ef-3dfa-4521-babe-4a8b2681bef2]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:17:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d1c5fcab-3af0-43db-807b-1ddfeb4dbd1a tempest-VolumesExtendTest-1472913743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9b78c023-d07a-4b9a-9aa6-5bd498624356.ff743f9c-fbb3-4268-bad8-0af73a23d2f0 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:42 devstack sudo[100102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9b78c023-d07a-4b9a-9aa6-5bd498624356.ff743f9c-fbb3-4268-bad8-0af73a23d2f0
Jul 03 01:17:42 devstack sudo[100102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:42 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-98231f12-0e46-437e-834f-cc0dec5ff78b tempest-VolumesSnapshotTestJSON-1936633444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:17:42 devstack sudo[100099]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:42 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-98231f12-0e46-437e-834f-cc0dec5ff78b tempest-VolumesSnapshotTestJSON-1936633444 None] Flow 'volume_create_manager' (ac5704c0-6977-4010-a7c1-6219a5f14215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:17:42 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-98231f12-0e46-437e-834f-cc0dec5ff78b tempest-VolumesSnapshotTestJSON-1936633444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64bb27e9-0bdd-4879-a3c7-2688ab86cca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:17:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a82e90e6-631b-4759-8033-f9afaf94786d tempest-VolumesSnapshotTestJSON-1936633444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.790s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:42 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-a82e90e6-631b-4759-8033-f9afaf94786d tempest-VolumesSnapshotTestJSON-1936633444 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:17:42 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-a82e90e6-631b-4759-8033-f9afaf94786d tempest-VolumesSnapshotTestJSON-1936633444 None] Deleted volume successfully.
Jul 03 01:17:42 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-98231f12-0e46-437e-834f-cc0dec5ff78b tempest-VolumesSnapshotTestJSON-1936633444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64bb27e9-0bdd-4879-a3c7-2688ab86cca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:17:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2144260393',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='419a343cdaef48b4b9fe4a37c9cff5b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:17:43Z,use_quota=True,user_id='d621ec04955f45368862c149d3c33d00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:17:42 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-98231f12-0e46-437e-834f-cc0dec5ff78b tempest-VolumesSnapshotTestJSON-1936633444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0098f1e-3a18-440d-9cbd-4ed91730ce04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:17:42 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-98231f12-0e46-437e-834f-cc0dec5ff78b tempest-VolumesSnapshotTestJSON-1936633444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0098f1e-3a18-440d-9cbd-4ed91730ce04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:17:42 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-98231f12-0e46-437e-834f-cc0dec5ff78b tempest-VolumesSnapshotTestJSON-1936633444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26a7838f-7a57-4ab7-8e91-25937f5240bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:17:42 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-98231f12-0e46-437e-834f-cc0dec5ff78b tempest-VolumesSnapshotTestJSON-1936633444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26a7838f-7a57-4ab7-8e91-25937f5240bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9', 'volume_name': 'volume-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:17:42 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-98231f12-0e46-437e-834f-cc0dec5ff78b tempest-VolumesSnapshotTestJSON-1936633444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f667e498-234a-4687-8b3c-c2d1bb79a4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:17:42 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-98231f12-0e46-437e-834f-cc0dec5ff78b tempest-VolumesSnapshotTestJSON-1936633444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f667e498-234a-4687-8b3c-c2d1bb79a4e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:17:42 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-98231f12-0e46-437e-834f-cc0dec5ff78b tempest-VolumesSnapshotTestJSON-1936633444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d8d7ffb-36ba-4212-9ee3-6a5d7a5289fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:17:42 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-98231f12-0e46-437e-834f-cc0dec5ff78b tempest-VolumesSnapshotTestJSON-1936633444 None] Volume a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9', 'volume_size': 1}
Jul 03 01:17:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-98231f12-0e46-437e-834f-cc0dec5ff78b tempest-VolumesSnapshotTestJSON-1936633444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:17:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-98231f12-0e46-437e-834f-cc0dec5ff78b tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:17:42 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-98231f12-0e46-437e-834f-cc0dec5ff78b tempest-VolumesSnapshotTestJSON-1936633444 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:17:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2144260393',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='419a343cdaef48b4b9fe4a37c9cff5b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:17:43Z,use_quota=True,user_id='d621ec04955f45368862c149d3c33d00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:17:42 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-98231f12-0e46-437e-834f-cc0dec5ff78b tempest-VolumesSnapshotTestJSON-1936633444 None] Creating volume a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:17:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-98231f12-0e46-437e-834f-cc0dec5ff78b tempest-VolumesSnapshotTestJSON-1936633444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:17:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-98231f12-0e46-437e-834f-cc0dec5ff78b tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:17:42 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-98231f12-0e46-437e-834f-cc0dec5ff78b tempest-VolumesSnapshotTestJSON-1936633444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:17:42 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-98231f12-0e46-437e-834f-cc0dec5ff78b tempest-VolumesSnapshotTestJSON-1936633444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:17:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-98231f12-0e46-437e-834f-cc0dec5ff78b tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:17:42 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-98231f12-0e46-437e-834f-cc0dec5ff78b tempest-VolumesSnapshotTestJSON-1936633444 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:17:42 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-98231f12-0e46-437e-834f-cc0dec5ff78b tempest-VolumesSnapshotTestJSON-1936633444 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:17:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-98231f12-0e46-437e-834f-cc0dec5ff78b tempest-VolumesSnapshotTestJSON-1936633444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:43 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-a82e90e6-631b-4759-8033-f9afaf94786d tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "cinder-15e3c1b7-9203-4158-a416-0df0c9b99998-delete_volume" released by "delete_volume" :: held 3.108s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:17:43 devstack sudo[100108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9 1073741824
Jul 03 01:17:43 devstack sudo[100108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:43 devstack sudo[100102]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d1c5fcab-3af0-43db-807b-1ddfeb4dbd1a tempest-VolumesExtendTest-1472913743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9b78c023-d07a-4b9a-9aa6-5bd498624356.ff743f9c-fbb3-4268-bad8-0af73a23d2f0" returned: 0 in 0.928s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:43 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-d1c5fcab-3af0-43db-807b-1ddfeb4dbd1a tempest-VolumesExtendTest-1472913743 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b78c023-d07a-4b9a-9aa6-5bd498624356(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:17:43 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[c759aa25-c779-4562-a1c9-7161859bc3e2]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:17:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d1c5fcab-3af0-43db-807b-1ddfeb4dbd1a tempest-VolumesExtendTest-1472913743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9b78c023-d07a-4b9a-9aa6-5bd498624356 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:43 devstack sudo[100111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9b78c023-d07a-4b9a-9aa6-5bd498624356
Jul 03 01:17:43 devstack sudo[100111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:43 devstack sudo[100108]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-98231f12-0e46-437e-834f-cc0dec5ff78b tempest-VolumesSnapshotTestJSON-1936633444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9 1073741824" returned: 0 in 1.017s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-98231f12-0e46-437e-834f-cc0dec5ff78b tempest-VolumesSnapshotTestJSON-1936633444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:44 devstack sudo[100122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9
Jul 03 01:17:44 devstack sudo[100122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:44 devstack sudo[100111]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d1c5fcab-3af0-43db-807b-1ddfeb4dbd1a tempest-VolumesExtendTest-1472913743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9b78c023-d07a-4b9a-9aa6-5bd498624356" returned: 0 in 0.858s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d1c5fcab-3af0-43db-807b-1ddfeb4dbd1a tempest-VolumesExtendTest-1472913743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9b78c023-d07a-4b9a-9aa6-5bd498624356.ff743f9c-fbb3-4268-bad8-0af73a23d2f0 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:44 devstack sudo[100124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9b78c023-d07a-4b9a-9aa6-5bd498624356.ff743f9c-fbb3-4268-bad8-0af73a23d2f0
Jul 03 01:17:44 devstack sudo[100124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:44 devstack sudo[100122]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-98231f12-0e46-437e-834f-cc0dec5ff78b tempest-VolumesSnapshotTestJSON-1936633444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9" returned: 0 in 0.709s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:44 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-98231f12-0e46-437e-834f-cc0dec5ff78b tempest-VolumesSnapshotTestJSON-1936633444 None] <== create_volume: return (1778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:17:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-98231f12-0e46-437e-834f-cc0dec5ff78b tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.782s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:17:44 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-98231f12-0e46-437e-834f-cc0dec5ff78b tempest-VolumesSnapshotTestJSON-1936633444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d8d7ffb-36ba-4212-9ee3-6a5d7a5289fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:17:44 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-98231f12-0e46-437e-834f-cc0dec5ff78b tempest-VolumesSnapshotTestJSON-1936633444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (490f9fca-3187-47f4-98a0-5490116ac887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:17:44 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-98231f12-0e46-437e-834f-cc0dec5ff78b tempest-VolumesSnapshotTestJSON-1936633444 None] Volume volume-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9 (a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9): created successfully
Jul 03 01:17:44 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-98231f12-0e46-437e-834f-cc0dec5ff78b tempest-VolumesSnapshotTestJSON-1936633444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (490f9fca-3187-47f4-98a0-5490116ac887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:17:44 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-98231f12-0e46-437e-834f-cc0dec5ff78b tempest-VolumesSnapshotTestJSON-1936633444 None] Flow 'volume_create_manager' (ac5704c0-6977-4010-a7c1-6219a5f14215) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:17:44 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-98231f12-0e46-437e-834f-cc0dec5ff78b tempest-VolumesSnapshotTestJSON-1936633444 None] Created volume successfully.
Jul 03 01:17:44 devstack sudo[100124]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d1c5fcab-3af0-43db-807b-1ddfeb4dbd1a tempest-VolumesExtendTest-1472913743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9b78c023-d07a-4b9a-9aa6-5bd498624356.ff743f9c-fbb3-4268-bad8-0af73a23d2f0" returned: 0 in 0.872s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d1c5fcab-3af0-43db-807b-1ddfeb4dbd1a tempest-VolumesExtendTest-1472913743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9b78c023-d07a-4b9a-9aa6-5bd498624356.ff743f9c-fbb3-4268-bad8-0af73a23d2f0 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:44 devstack sudo[100130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9b78c023-d07a-4b9a-9aa6-5bd498624356.ff743f9c-fbb3-4268-bad8-0af73a23d2f0
Jul 03 01:17:44 devstack sudo[100130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-9b2b6530-3b7c-4a00-ae6e-3f0c515a75b4 tempest-VolumesSnapshotTestJSON-1936633444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:17:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-9b2b6530-3b7c-4a00-ae6e-3f0c515a75b4 tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:17:45 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-9b2b6530-3b7c-4a00-ae6e-3f0c515a75b4 tempest-VolumesSnapshotTestJSON-1936633444 None] Creating offline snapshot aa9e2442-cbba-4711-8773-fba6ac11d928 of volume a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9 {{(pid=86891) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 01:17:45 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bba4195-55a2-4321-b2f4-139017ffa30a]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:17:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9b2b6530-3b7c-4a00-ae6e-3f0c515a75b4 tempest-VolumesSnapshotTestJSON-1936633444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:45 devstack sudo[100132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9
Jul 03 01:17:45 devstack sudo[100132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:45 devstack sudo[100130]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d1c5fcab-3af0-43db-807b-1ddfeb4dbd1a tempest-VolumesExtendTest-1472913743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9b78c023-d07a-4b9a-9aa6-5bd498624356.ff743f9c-fbb3-4268-bad8-0af73a23d2f0" returned: 0 in 0.725s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:45 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d1c5fcab-3af0-43db-807b-1ddfeb4dbd1a tempest-VolumesExtendTest-1472913743 None] Lock "cinder-quobyte-ff743f9c-fbb3-4268-bad8-0af73a23d2f0" released by "_delete_snapshot" :: held 3.554s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:17:45 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d1c5fcab-3af0-43db-807b-1ddfeb4dbd1a tempest-VolumesExtendTest-1472913743 None] Lock "cinder-quobyte-9b78c023-d07a-4b9a-9aa6-5bd498624356" released by "delete_snapshot" :: held 3.612s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:17:45 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-d1c5fcab-3af0-43db-807b-1ddfeb4dbd1a tempest-VolumesExtendTest-1472913743 None] Created reservations ['9c51e6ce-1ab9-422d-a0f5-d52a22eb6a1d', 'af62ed16-e2ae-42f3-bf77-0930e54f4ab3', 'fe013221-39af-47ab-b32a-3bb75cff59d9', '17b604f5-dc3b-43c1-bfbe-d54286c7b45a'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:17:45 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-d1c5fcab-3af0-43db-807b-1ddfeb4dbd1a tempest-VolumesExtendTest-1472913743 None] Delete snapshot completed successfully.
Jul 03 01:17:45 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d1c5fcab-3af0-43db-807b-1ddfeb4dbd1a tempest-VolumesExtendTest-1472913743 None] Lock "cinder-ff743f9c-fbb3-4268-bad8-0af73a23d2f0-delete_snapshot" released by "delete_snapshot" :: held 3.810s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:17:45 devstack sudo[100132]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9b2b6530-3b7c-4a00-ae6e-3f0c515a75b4 tempest-VolumesSnapshotTestJSON-1936633444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9" returned: 0 in 0.769s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9b2b6530-3b7c-4a00-ae6e-3f0c515a75b4 tempest-VolumesSnapshotTestJSON-1936633444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9.aa9e2442-cbba-4711-8773-fba6ac11d928 1G {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:45 devstack sudo[100138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9.aa9e2442-cbba-4711-8773-fba6ac11d928 1G
Jul 03 01:17:45 devstack sudo[100138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:46 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-4efe10c8-0cb2-4c4c-8b5d-c32f3165b3d0 tempest-VolumesExtendTest-1472913743 None] Acquiring lock "cinder-9b78c023-d07a-4b9a-9aa6-5bd498624356-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:17:46 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-4efe10c8-0cb2-4c4c-8b5d-c32f3165b3d0 tempest-VolumesExtendTest-1472913743 None] Lock "cinder-9b78c023-d07a-4b9a-9aa6-5bd498624356-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:17:46 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-4efe10c8-0cb2-4c4c-8b5d-c32f3165b3d0 tempest-VolumesExtendTest-1472913743 None] Acquiring lock "cinder-quobyte-9b78c023-d07a-4b9a-9aa6-5bd498624356" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:17:46 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-4efe10c8-0cb2-4c4c-8b5d-c32f3165b3d0 tempest-VolumesExtendTest-1472913743 None] Lock "cinder-quobyte-9b78c023-d07a-4b9a-9aa6-5bd498624356" acquired by "delete_volume" :: waited 0.012s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:17:46 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b24669-2495-4005-af51-2512536abd11]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:17:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-4efe10c8-0cb2-4c4c-8b5d-c32f3165b3d0 tempest-VolumesExtendTest-1472913743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9b78c023-d07a-4b9a-9aa6-5bd498624356 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:46 devstack sudo[100140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9b78c023-d07a-4b9a-9aa6-5bd498624356
Jul 03 01:17:46 devstack sudo[100140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:46 devstack sudo[100138]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9b2b6530-3b7c-4a00-ae6e-3f0c515a75b4 tempest-VolumesSnapshotTestJSON-1936633444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9.aa9e2442-cbba-4711-8773-fba6ac11d928 1G" returned: 0 in 0.820s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9b2b6530-3b7c-4a00-ae6e-3f0c515a75b4 tempest-VolumesSnapshotTestJSON-1936633444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9.aa9e2442-cbba-4711-8773-fba6ac11d928 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:46 devstack sudo[100145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9.aa9e2442-cbba-4711-8773-fba6ac11d928
Jul 03 01:17:46 devstack sudo[100145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:47 devstack sudo[100140]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-4efe10c8-0cb2-4c4c-8b5d-c32f3165b3d0 tempest-VolumesExtendTest-1472913743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9b78c023-d07a-4b9a-9aa6-5bd498624356" returned: 0 in 0.767s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-4efe10c8-0cb2-4c4c-8b5d-c32f3165b3d0 tempest-VolumesExtendTest-1472913743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9b78c023-d07a-4b9a-9aa6-5bd498624356 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:47 devstack sudo[100151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9b78c023-d07a-4b9a-9aa6-5bd498624356
Jul 03 01:17:47 devstack sudo[100151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:47 devstack sudo[100145]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9b2b6530-3b7c-4a00-ae6e-3f0c515a75b4 tempest-VolumesSnapshotTestJSON-1936633444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9.aa9e2442-cbba-4711-8773-fba6ac11d928" returned: 0 in 0.692s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:47 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-9b2b6530-3b7c-4a00-ae6e-3f0c515a75b4 tempest-VolumesSnapshotTestJSON-1936633444 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9.aa9e2442-cbba-4711-8773-fba6ac11d928 is being set with open permissions: ugo+rw
Jul 03 01:17:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9b2b6530-3b7c-4a00-ae6e-3f0c515a75b4 tempest-VolumesSnapshotTestJSON-1936633444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9.aa9e2442-cbba-4711-8773-fba6ac11d928 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:47 devstack sudo[100156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9.aa9e2442-cbba-4711-8773-fba6ac11d928
Jul 03 01:17:47 devstack sudo[100156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:47 devstack sudo[100151]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-4efe10c8-0cb2-4c4c-8b5d-c32f3165b3d0 tempest-VolumesExtendTest-1472913743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9b78c023-d07a-4b9a-9aa6-5bd498624356" returned: 0 in 0.687s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:47 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-4efe10c8-0cb2-4c4c-8b5d-c32f3165b3d0 tempest-VolumesExtendTest-1472913743 None] Lock "cinder-quobyte-9b78c023-d07a-4b9a-9aa6-5bd498624356" released by "delete_volume" :: held 1.512s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:17:47 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-4efe10c8-0cb2-4c4c-8b5d-c32f3165b3d0 tempest-VolumesExtendTest-1472913743 None] Created reservations ['2bfb5edc-fb2e-44c8-af68-671d62b8a7da', '3e963742-a679-4123-8344-30d40263ea94', '6625774b-2c7e-4a21-ba61-90d2609c8324', '20e04640-c614-464b-aa15-d3643a9271de'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:17:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-4efe10c8-0cb2-4c4c-8b5d-c32f3165b3d0 tempest-VolumesExtendTest-1472913743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:17:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-4efe10c8-0cb2-4c4c-8b5d-c32f3165b3d0 tempest-VolumesExtendTest-1472913743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:17:48 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-4efe10c8-0cb2-4c4c-8b5d-c32f3165b3d0 tempest-VolumesExtendTest-1472913743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:17:48 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-4efe10c8-0cb2-4c4c-8b5d-c32f3165b3d0 tempest-VolumesExtendTest-1472913743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:17:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-4efe10c8-0cb2-4c4c-8b5d-c32f3165b3d0 tempest-VolumesExtendTest-1472913743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:17:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-4efe10c8-0cb2-4c4c-8b5d-c32f3165b3d0 tempest-VolumesExtendTest-1472913743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:48 devstack sudo[100160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:17:48 devstack sudo[100160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:48 devstack sudo[100156]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9b2b6530-3b7c-4a00-ae6e-3f0c515a75b4 tempest-VolumesSnapshotTestJSON-1936633444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9.aa9e2442-cbba-4711-8773-fba6ac11d928" returned: 0 in 0.672s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9b2b6530-3b7c-4a00-ae6e-3f0c515a75b4 tempest-VolumesSnapshotTestJSON-1936633444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:48 devstack sudo[100162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9.info
Jul 03 01:17:48 devstack sudo[100162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:48 devstack sudo[100160]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-4efe10c8-0cb2-4c4c-8b5d-c32f3165b3d0 tempest-VolumesExtendTest-1472913743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.757s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:48 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-4efe10c8-0cb2-4c4c-8b5d-c32f3165b3d0 tempest-VolumesExtendTest-1472913743 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:17:48 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-4efe10c8-0cb2-4c4c-8b5d-c32f3165b3d0 tempest-VolumesExtendTest-1472913743 None] Deleted volume successfully.
Jul 03 01:17:48 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-4efe10c8-0cb2-4c4c-8b5d-c32f3165b3d0 tempest-VolumesExtendTest-1472913743 None] Lock "cinder-9b78c023-d07a-4b9a-9aa6-5bd498624356-delete_volume" released by "delete_volume" :: held 2.499s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:17:48 devstack sudo[100162]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9b2b6530-3b7c-4a00-ae6e-3f0c515a75b4 tempest-VolumesSnapshotTestJSON-1936633444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9.info" returned: 0 in 0.735s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:48 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-9b2b6530-3b7c-4a00-ae6e-3f0c515a75b4 tempest-VolumesSnapshotTestJSON-1936633444 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9.info is being set with open permissions: ugo+rw
Jul 03 01:17:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9b2b6530-3b7c-4a00-ae6e-3f0c515a75b4 tempest-VolumesSnapshotTestJSON-1936633444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:48 devstack sudo[100167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9.info
Jul 03 01:17:48 devstack sudo[100167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:49 devstack sudo[100167]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9b2b6530-3b7c-4a00-ae6e-3f0c515a75b4 tempest-VolumesSnapshotTestJSON-1936633444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9.info" returned: 0 in 0.710s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-9b2b6530-3b7c-4a00-ae6e-3f0c515a75b4 tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.509s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:17:49 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-9b2b6530-3b7c-4a00-ae6e-3f0c515a75b4 tempest-VolumesSnapshotTestJSON-1936633444 None] Create snapshot completed successfully
Jul 03 01:17:50 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c53f793-09dd-4916-9caa-354aaf1dc55f tempest-VolumesSnapshotTestJSON-1936633444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:17:50 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-4c53f793-09dd-4916-9caa-354aaf1dc55f tempest-VolumesSnapshotTestJSON-1936633444 None] Flow 'volume_create_manager' (6c848c08-7ebf-41fb-a79c-2e7a4e3fd87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:17:50 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-4c53f793-09dd-4916-9caa-354aaf1dc55f tempest-VolumesSnapshotTestJSON-1936633444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef19e0de-7f41-4a82-86f1-29d331d2c4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:17:51 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-4c53f793-09dd-4916-9caa-354aaf1dc55f tempest-VolumesSnapshotTestJSON-1936633444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef19e0de-7f41-4a82-86f1-29d331d2c4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:17:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1377790183',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa5938d9-1f61-40a3-9a52-a71eb4f5289a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='419a343cdaef48b4b9fe4a37c9cff5b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=aa9e2442-cbba-4711-8773-fba6ac11d928,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:17:51Z,use_quota=True,user_id='d621ec04955f45368862c149d3c33d00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:17:51 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-4c53f793-09dd-4916-9caa-354aaf1dc55f tempest-VolumesSnapshotTestJSON-1936633444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9318464-3ebe-412b-bb2e-113f8c97e0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:17:51 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-4c53f793-09dd-4916-9caa-354aaf1dc55f tempest-VolumesSnapshotTestJSON-1936633444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9318464-3ebe-412b-bb2e-113f8c97e0d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:17:51 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-4c53f793-09dd-4916-9caa-354aaf1dc55f tempest-VolumesSnapshotTestJSON-1936633444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (def1c386-a786-414d-92d2-ac26d9a64f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:17:51 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-4c53f793-09dd-4916-9caa-354aaf1dc55f tempest-VolumesSnapshotTestJSON-1936633444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (def1c386-a786-414d-92d2-ac26d9a64f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fa5938d9-1f61-40a3-9a52-a71eb4f5289a', 'volume_name': 'volume-fa5938d9-1f61-40a3-9a52-a71eb4f5289a', 'volume_size': 1, 'snapshot_id': 'aa9e2442-cbba-4711-8773-fba6ac11d928'}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:17:51 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-4c53f793-09dd-4916-9caa-354aaf1dc55f tempest-VolumesSnapshotTestJSON-1936633444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (167c206e-9c73-4c93-9538-eadc39f24f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:17:51 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-4c53f793-09dd-4916-9caa-354aaf1dc55f tempest-VolumesSnapshotTestJSON-1936633444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (167c206e-9c73-4c93-9538-eadc39f24f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:17:51 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-4c53f793-09dd-4916-9caa-354aaf1dc55f tempest-VolumesSnapshotTestJSON-1936633444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (381fbf28-2991-4c1e-a932-0dd09225d962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:17:51 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-4c53f793-09dd-4916-9caa-354aaf1dc55f tempest-VolumesSnapshotTestJSON-1936633444 None] Volume fa5938d9-1f61-40a3-9a52-a71eb4f5289a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fa5938d9-1f61-40a3-9a52-a71eb4f5289a', 'volume_size': 1, 'snapshot_id': 'aa9e2442-cbba-4711-8773-fba6ac11d928'}
Jul 03 01:17:51 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-4c53f793-09dd-4916-9caa-354aaf1dc55f tempest-VolumesSnapshotTestJSON-1936633444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:17:51 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-4c53f793-09dd-4916-9caa-354aaf1dc55f tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:17:51 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-4c53f793-09dd-4916-9caa-354aaf1dc55f tempest-VolumesSnapshotTestJSON-1936633444 None] Acquiring lock "cinder-quobyte-aa9e2442-cbba-4711-8773-fba6ac11d928-fa5938d9-1f61-40a3-9a52-a71eb4f5289a" by "_create_volume_from_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:17:51 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-4c53f793-09dd-4916-9caa-354aaf1dc55f tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "cinder-quobyte-aa9e2442-cbba-4711-8773-fba6ac11d928-fa5938d9-1f61-40a3-9a52-a71eb4f5289a" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:17:51 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-4c53f793-09dd-4916-9caa-354aaf1dc55f tempest-VolumesSnapshotTestJSON-1936633444 None] Creating volume fa5938d9-1f61-40a3-9a52-a71eb4f5289a from snapshot aa9e2442-cbba-4711-8773-fba6ac11d928 {{(pid=86891) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 03 01:17:51 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-4c53f793-09dd-4916-9caa-354aaf1dc55f tempest-VolumesSnapshotTestJSON-1936633444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:17:51 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-4c53f793-09dd-4916-9caa-354aaf1dc55f tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:17:51 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-4c53f793-09dd-4916-9caa-354aaf1dc55f tempest-VolumesSnapshotTestJSON-1936633444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:17:51 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-4c53f793-09dd-4916-9caa-354aaf1dc55f tempest-VolumesSnapshotTestJSON-1936633444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:17:51 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-4c53f793-09dd-4916-9caa-354aaf1dc55f tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:17:51 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-4c53f793-09dd-4916-9caa-354aaf1dc55f tempest-VolumesSnapshotTestJSON-1936633444 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:17:51 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-4c53f793-09dd-4916-9caa-354aaf1dc55f tempest-VolumesSnapshotTestJSON-1936633444 None] Acquiring lock "cinder-quobyte-fa5938d9-1f61-40a3-9a52-a71eb4f5289a" by "_copy_volume_from_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:17:51 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-4c53f793-09dd-4916-9caa-354aaf1dc55f tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "cinder-quobyte-fa5938d9-1f61-40a3-9a52-a71eb4f5289a" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:17:51 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-4c53f793-09dd-4916-9caa-354aaf1dc55f tempest-VolumesSnapshotTestJSON-1936633444 None] snapshot: aa9e2442-cbba-4711-8773-fba6ac11d928, volume: fa5938d9-1f61-40a3-9a52-a71eb4f5289a,  {{(pid=86891) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 03 01:17:51 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-4c53f793-09dd-4916-9caa-354aaf1dc55f tempest-VolumesSnapshotTestJSON-1936633444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:17:51 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-4c53f793-09dd-4916-9caa-354aaf1dc55f tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:17:51 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-4c53f793-09dd-4916-9caa-354aaf1dc55f tempest-VolumesSnapshotTestJSON-1936633444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:17:51 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-4c53f793-09dd-4916-9caa-354aaf1dc55f tempest-VolumesSnapshotTestJSON-1936633444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:17:51 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-4c53f793-09dd-4916-9caa-354aaf1dc55f tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:17:51 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[8034b8a1-ac27-4734-b778-3426651cfe12]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:17:51 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-4c53f793-09dd-4916-9caa-354aaf1dc55f tempest-VolumesSnapshotTestJSON-1936633444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9.aa9e2442-cbba-4711-8773-fba6ac11d928 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:51 devstack sudo[100172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9.aa9e2442-cbba-4711-8773-fba6ac11d928
Jul 03 01:17:51 devstack sudo[100172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:52 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a31b6b7-e94c-49d2-a6b0-e6fe9a65d2b0 tempest-VolumesListTestJSON-57852208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:17:52 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7a31b6b7-e94c-49d2-a6b0-e6fe9a65d2b0 tempest-VolumesListTestJSON-57852208 None] Flow 'volume_create_manager' (e09296b6-5e89-49b4-810c-c463db0a7c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:17:52 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7a31b6b7-e94c-49d2-a6b0-e6fe9a65d2b0 tempest-VolumesListTestJSON-57852208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65d5637b-876f-4c84-9f60-ae1994121504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:17:52 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7a31b6b7-e94c-49d2-a6b0-e6fe9a65d2b0 tempest-VolumesListTestJSON-57852208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65d5637b-876f-4c84-9f60-ae1994121504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1259027843',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0625fbaa-33c0-472a-8aba-526998b79f43,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='56d1ba692a9c4904ab931d6768f2280c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:17:52Z,use_quota=True,user_id='ff5bffa2d2324298a47e5ff0cf912bb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:17:52 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7a31b6b7-e94c-49d2-a6b0-e6fe9a65d2b0 tempest-VolumesListTestJSON-57852208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c410a74-f27a-47a2-ae44-4a3d52f23101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:17:52 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7a31b6b7-e94c-49d2-a6b0-e6fe9a65d2b0 tempest-VolumesListTestJSON-57852208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c410a74-f27a-47a2-ae44-4a3d52f23101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:17:52 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7a31b6b7-e94c-49d2-a6b0-e6fe9a65d2b0 tempest-VolumesListTestJSON-57852208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f7b62c9-e151-44b0-a402-3272b5c63e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:17:52 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7a31b6b7-e94c-49d2-a6b0-e6fe9a65d2b0 tempest-VolumesListTestJSON-57852208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f7b62c9-e151-44b0-a402-3272b5c63e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0625fbaa-33c0-472a-8aba-526998b79f43', 'volume_name': 'volume-0625fbaa-33c0-472a-8aba-526998b79f43', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:17:52 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7a31b6b7-e94c-49d2-a6b0-e6fe9a65d2b0 tempest-VolumesListTestJSON-57852208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a55749b8-2d5f-4fb3-87bc-21adbe08a799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:17:52 devstack sudo[100172]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:52 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7a31b6b7-e94c-49d2-a6b0-e6fe9a65d2b0 tempest-VolumesListTestJSON-57852208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a55749b8-2d5f-4fb3-87bc-21adbe08a799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:17:52 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7a31b6b7-e94c-49d2-a6b0-e6fe9a65d2b0 tempest-VolumesListTestJSON-57852208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93835eae-f55e-4fcf-bffd-ab8ec4d0ba8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:17:52 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-7a31b6b7-e94c-49d2-a6b0-e6fe9a65d2b0 tempest-VolumesListTestJSON-57852208 None] Volume 0625fbaa-33c0-472a-8aba-526998b79f43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0625fbaa-33c0-472a-8aba-526998b79f43', 'volume_size': 1}
Jul 03 01:17:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-7a31b6b7-e94c-49d2-a6b0-e6fe9a65d2b0 tempest-VolumesListTestJSON-57852208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:17:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-4c53f793-09dd-4916-9caa-354aaf1dc55f tempest-VolumesSnapshotTestJSON-1936633444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9.aa9e2442-cbba-4711-8773-fba6ac11d928" returned: 0 in 0.960s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:52 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-4c53f793-09dd-4916-9caa-354aaf1dc55f tempest-VolumesSnapshotTestJSON-1936633444 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:17:52 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-4c53f793-09dd-4916-9caa-354aaf1dc55f tempest-VolumesSnapshotTestJSON-1936633444 None] will copy from snapshot at /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9 {{(pid=86891) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 03 01:17:52 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-4c53f793-09dd-4916-9caa-354aaf1dc55f tempest-VolumesSnapshotTestJSON-1936633444 None] Creating direct copy from snapshot {{(pid=86891) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 03 01:17:52 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd08f83-924d-4c07-bec5-4bada151e114]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:17:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-4c53f793-09dd-4916-9caa-354aaf1dc55f tempest-VolumesSnapshotTestJSON-1936633444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:52 devstack sudo[100177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9
Jul 03 01:17:52 devstack sudo[100177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:52 devstack sudo[100177]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-4c53f793-09dd-4916-9caa-354aaf1dc55f tempest-VolumesSnapshotTestJSON-1936633444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9" returned: 0 in 0.765s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:52 devstack cinder-volume[86891]: DEBUG cinder.utils [None req-4c53f793-09dd-4916-9caa-354aaf1dc55f tempest-VolumesSnapshotTestJSON-1936633444 None] Path /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-fa5938d9-1f61-40a3-9a52-a71eb4f5289a not found in is_blk_device check {{(pid=86891) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 03 01:17:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-4c53f793-09dd-4916-9caa-354aaf1dc55f tempest-VolumesSnapshotTestJSON-1936633444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-fa5938d9-1f61-40a3-9a52-a71eb4f5289a {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:52 devstack sudo[100182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-fa5938d9-1f61-40a3-9a52-a71eb4f5289a
Jul 03 01:17:52 devstack sudo[100182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:54 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-285774a8-0fb6-4637-a4bb-90981f156346 tempest-VolumesNegativeTest-1087144029 None] Acquiring lock "cinder-8dc93584-057a-4e37-8ff0-709712e39a95-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:17:55 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-285774a8-0fb6-4637-a4bb-90981f156346 tempest-VolumesNegativeTest-1087144029 None] Lock "cinder-8dc93584-057a-4e37-8ff0-709712e39a95-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:17:55 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-285774a8-0fb6-4637-a4bb-90981f156346 tempest-VolumesNegativeTest-1087144029 None] Acquiring lock "cinder-quobyte-8dc93584-057a-4e37-8ff0-709712e39a95" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:17:55 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-285774a8-0fb6-4637-a4bb-90981f156346 tempest-VolumesNegativeTest-1087144029 None] Lock "cinder-quobyte-8dc93584-057a-4e37-8ff0-709712e39a95" acquired by "delete_volume" :: waited 0.038s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:17:55 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e4f56b-2dd7-498d-b3c4-3aac6fad26cc]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:17:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-285774a8-0fb6-4637-a4bb-90981f156346 tempest-VolumesNegativeTest-1087144029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8dc93584-057a-4e37-8ff0-709712e39a95 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:55 devstack sudo[100194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8dc93584-057a-4e37-8ff0-709712e39a95
Jul 03 01:17:55 devstack sudo[100194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:57 devstack sudo[100194]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-285774a8-0fb6-4637-a4bb-90981f156346 tempest-VolumesNegativeTest-1087144029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8dc93584-057a-4e37-8ff0-709712e39a95" returned: 0 in 1.769s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-285774a8-0fb6-4637-a4bb-90981f156346 tempest-VolumesNegativeTest-1087144029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8dc93584-057a-4e37-8ff0-709712e39a95 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:57 devstack sudo[100200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8dc93584-057a-4e37-8ff0-709712e39a95
Jul 03 01:17:57 devstack sudo[100200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:58 devstack sudo[100200]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-285774a8-0fb6-4637-a4bb-90981f156346 tempest-VolumesNegativeTest-1087144029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8dc93584-057a-4e37-8ff0-709712e39a95" returned: 0 in 1.150s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:58 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-285774a8-0fb6-4637-a4bb-90981f156346 tempest-VolumesNegativeTest-1087144029 None] Lock "cinder-quobyte-8dc93584-057a-4e37-8ff0-709712e39a95" released by "delete_volume" :: held 3.017s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:17:58 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-285774a8-0fb6-4637-a4bb-90981f156346 tempest-VolumesNegativeTest-1087144029 None] Created reservations ['1ef87070-c09f-4724-9ba9-6280ef337d4e', '0399029b-c9e0-4b41-a067-5805707c542c', 'b757a30a-66ab-43d9-9780-f8d57ce2c0fb', 'f5e77baf-fbd7-4558-a070-27bb94e351a3'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:17:58 devstack sudo[100182]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-4c53f793-09dd-4916-9caa-354aaf1dc55f tempest-VolumesSnapshotTestJSON-1936633444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-fa5938d9-1f61-40a3-9a52-a71eb4f5289a" returned: 0 in 5.339s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:58 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[856d83f2-db96-4994-afe9-ea8848967fd6]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:17:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-4c53f793-09dd-4916-9caa-354aaf1dc55f tempest-VolumesSnapshotTestJSON-1936633444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-285774a8-0fb6-4637-a4bb-90981f156346 tempest-VolumesNegativeTest-1087144029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:17:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-285774a8-0fb6-4637-a4bb-90981f156346 tempest-VolumesNegativeTest-1087144029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:17:58 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-285774a8-0fb6-4637-a4bb-90981f156346 tempest-VolumesNegativeTest-1087144029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:17:58 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-285774a8-0fb6-4637-a4bb-90981f156346 tempest-VolumesNegativeTest-1087144029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:17:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-285774a8-0fb6-4637-a4bb-90981f156346 tempest-VolumesNegativeTest-1087144029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:17:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-285774a8-0fb6-4637-a4bb-90981f156346 tempest-VolumesNegativeTest-1087144029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:58 devstack sudo[100204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:17:58 devstack sudo[100204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:58 devstack sudo[100203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9
Jul 03 01:17:58 devstack sudo[100203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:58 devstack sudo[100204]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-285774a8-0fb6-4637-a4bb-90981f156346 tempest-VolumesNegativeTest-1087144029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.664s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:58 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-285774a8-0fb6-4637-a4bb-90981f156346 tempest-VolumesNegativeTest-1087144029 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:17:58 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-285774a8-0fb6-4637-a4bb-90981f156346 tempest-VolumesNegativeTest-1087144029 None] Deleted volume successfully.
Jul 03 01:17:59 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-285774a8-0fb6-4637-a4bb-90981f156346 tempest-VolumesNegativeTest-1087144029 None] Lock "cinder-8dc93584-057a-4e37-8ff0-709712e39a95-delete_volume" released by "delete_volume" :: held 3.975s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:17:59 devstack sudo[100203]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-4c53f793-09dd-4916-9caa-354aaf1dc55f tempest-VolumesSnapshotTestJSON-1936633444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9" returned: 0 in 0.959s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:59 devstack cinder-volume[86891]: DEBUG cinder.image.image_utils [None req-4c53f793-09dd-4916-9caa-354aaf1dc55f tempest-VolumesSnapshotTestJSON-1936633444 None] Image conversion details: src /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9, size 1024.00 MB, duration 5.34 sec, destination /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-fa5938d9-1f61-40a3-9a52-a71eb4f5289a {{(pid=86891) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 03 01:17:59 devstack cinder-volume[86891]: INFO cinder.image.image_utils [None req-4c53f793-09dd-4916-9caa-354aaf1dc55f tempest-VolumesSnapshotTestJSON-1936633444 None] Converted 1024.00 MB image at 191.64 MB/s
Jul 03 01:17:59 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-4c53f793-09dd-4916-9caa-354aaf1dc55f tempest-VolumesSnapshotTestJSON-1936633444 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-fa5938d9-1f61-40a3-9a52-a71eb4f5289a is being set with open permissions: ugo+rw
Jul 03 01:17:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-4c53f793-09dd-4916-9caa-354aaf1dc55f tempest-VolumesSnapshotTestJSON-1936633444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-fa5938d9-1f61-40a3-9a52-a71eb4f5289a {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:59 devstack sudo[100212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-fa5938d9-1f61-40a3-9a52-a71eb4f5289a
Jul 03 01:17:59 devstack sudo[100212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:59 devstack sudo[100212]: pam_unix(sudo:session): session closed for user root
Jul 03 01:17:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-4c53f793-09dd-4916-9caa-354aaf1dc55f tempest-VolumesSnapshotTestJSON-1936633444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-fa5938d9-1f61-40a3-9a52-a71eb4f5289a" returned: 0 in 0.670s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:17:59 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-4c53f793-09dd-4916-9caa-354aaf1dc55f tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "cinder-quobyte-fa5938d9-1f61-40a3-9a52-a71eb4f5289a" released by "_copy_volume_from_snapshot" :: held 8.817s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:17:59 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-4c53f793-09dd-4916-9caa-354aaf1dc55f tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "cinder-quobyte-aa9e2442-cbba-4711-8773-fba6ac11d928-fa5938d9-1f61-40a3-9a52-a71eb4f5289a" released by "_create_volume_from_snapshot" :: held 8.856s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:17:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-4c53f793-09dd-4916-9caa-354aaf1dc55f tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.875s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:17:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-7a31b6b7-e94c-49d2-a6b0-e6fe9a65d2b0 tempest-VolumesListTestJSON-57852208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.805s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:17:59 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-7a31b6b7-e94c-49d2-a6b0-e6fe9a65d2b0 tempest-VolumesListTestJSON-57852208 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1259027843',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0625fbaa-33c0-472a-8aba-526998b79f43,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='56d1ba692a9c4904ab931d6768f2280c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:17:52Z,use_quota=True,user_id='ff5bffa2d2324298a47e5ff0cf912bb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:17:59 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-7a31b6b7-e94c-49d2-a6b0-e6fe9a65d2b0 tempest-VolumesListTestJSON-57852208 None] Creating volume 0625fbaa-33c0-472a-8aba-526998b79f43 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:17:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-7a31b6b7-e94c-49d2-a6b0-e6fe9a65d2b0 tempest-VolumesListTestJSON-57852208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:17:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-7a31b6b7-e94c-49d2-a6b0-e6fe9a65d2b0 tempest-VolumesListTestJSON-57852208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:17:59 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-7a31b6b7-e94c-49d2-a6b0-e6fe9a65d2b0 tempest-VolumesListTestJSON-57852208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:17:59 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-7a31b6b7-e94c-49d2-a6b0-e6fe9a65d2b0 tempest-VolumesListTestJSON-57852208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:17:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-7a31b6b7-e94c-49d2-a6b0-e6fe9a65d2b0 tempest-VolumesListTestJSON-57852208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:17:59 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-7a31b6b7-e94c-49d2-a6b0-e6fe9a65d2b0 tempest-VolumesListTestJSON-57852208 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:17:59 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-7a31b6b7-e94c-49d2-a6b0-e6fe9a65d2b0 tempest-VolumesListTestJSON-57852208 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:17:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-7a31b6b7-e94c-49d2-a6b0-e6fe9a65d2b0 tempest-VolumesListTestJSON-57852208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0625fbaa-33c0-472a-8aba-526998b79f43 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:17:59 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:UPDATE=129,cinder:SELECT=110,cinder:INSERT=34,cinder:DELETE=8 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:17:59 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:SELECT=109,cinder:INSERT=38,cinder:UPDATE=121,cinder:DELETE=13 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:17:59 devstack sudo[100215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0625fbaa-33c0-472a-8aba-526998b79f43 1073741824
Jul 03 01:17:59 devstack sudo[100215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:17:59 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-4c53f793-09dd-4916-9caa-354aaf1dc55f tempest-VolumesSnapshotTestJSON-1936633444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (381fbf28-2991-4c1e-a932-0dd09225d962) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa5938d9-1f61-40a3-9a52-a71eb4f5289a', 'volume_size': 1, 'snapshot_id': 'aa9e2442-cbba-4711-8773-fba6ac11d928'}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:17:59 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-4c53f793-09dd-4916-9caa-354aaf1dc55f tempest-VolumesSnapshotTestJSON-1936633444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a9315d3-9d2e-40b6-8c64-1c44867762af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:18:00 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-4c53f793-09dd-4916-9caa-354aaf1dc55f tempest-VolumesSnapshotTestJSON-1936633444 None] Volume volume-fa5938d9-1f61-40a3-9a52-a71eb4f5289a (fa5938d9-1f61-40a3-9a52-a71eb4f5289a): created successfully
Jul 03 01:18:00 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-4c53f793-09dd-4916-9caa-354aaf1dc55f tempest-VolumesSnapshotTestJSON-1936633444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a9315d3-9d2e-40b6-8c64-1c44867762af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:18:00 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-4c53f793-09dd-4916-9caa-354aaf1dc55f tempest-VolumesSnapshotTestJSON-1936633444 None] Flow 'volume_create_manager' (6c848c08-7ebf-41fb-a79c-2e7a4e3fd87c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:18:00 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-4c53f793-09dd-4916-9caa-354aaf1dc55f tempest-VolumesSnapshotTestJSON-1936633444 None] Created volume successfully.
Jul 03 01:18:00 devstack sudo[100215]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:00 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-7a31b6b7-e94c-49d2-a6b0-e6fe9a65d2b0 tempest-VolumesListTestJSON-57852208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0625fbaa-33c0-472a-8aba-526998b79f43 1073741824" returned: 0 in 0.994s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:00 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-93c0bc1c-ef30-47ff-b180-76dc8b1f775d tempest-VolumesSnapshotTestJSON-1936633444 None] Acquiring lock "cinder-fa5938d9-1f61-40a3-9a52-a71eb4f5289a-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:18:00 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-7a31b6b7-e94c-49d2-a6b0-e6fe9a65d2b0 tempest-VolumesListTestJSON-57852208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0625fbaa-33c0-472a-8aba-526998b79f43 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:01 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-93c0bc1c-ef30-47ff-b180-76dc8b1f775d tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "cinder-fa5938d9-1f61-40a3-9a52-a71eb4f5289a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:18:01 devstack sudo[100220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0625fbaa-33c0-472a-8aba-526998b79f43
Jul 03 01:18:01 devstack sudo[100220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:01 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-93c0bc1c-ef30-47ff-b180-76dc8b1f775d tempest-VolumesSnapshotTestJSON-1936633444 None] Acquiring lock "cinder-quobyte-fa5938d9-1f61-40a3-9a52-a71eb4f5289a" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:18:01 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-93c0bc1c-ef30-47ff-b180-76dc8b1f775d tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "cinder-quobyte-fa5938d9-1f61-40a3-9a52-a71eb4f5289a" acquired by "delete_volume" :: waited 0.015s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:18:01 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb894065-395f-40cc-b65f-3be733c177a9]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:18:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-93c0bc1c-ef30-47ff-b180-76dc8b1f775d tempest-VolumesSnapshotTestJSON-1936633444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-fa5938d9-1f61-40a3-9a52-a71eb4f5289a {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:01 devstack sudo[100222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-fa5938d9-1f61-40a3-9a52-a71eb4f5289a
Jul 03 01:18:01 devstack sudo[100222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:01 devstack sudo[100220]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-7a31b6b7-e94c-49d2-a6b0-e6fe9a65d2b0 tempest-VolumesListTestJSON-57852208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0625fbaa-33c0-472a-8aba-526998b79f43" returned: 0 in 0.708s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-7a31b6b7-e94c-49d2-a6b0-e6fe9a65d2b0 tempest-VolumesListTestJSON-57852208 None] <== create_volume: return (1762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:18:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-7a31b6b7-e94c-49d2-a6b0-e6fe9a65d2b0 tempest-VolumesListTestJSON-57852208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.767s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:18:01 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7a31b6b7-e94c-49d2-a6b0-e6fe9a65d2b0 tempest-VolumesListTestJSON-57852208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93835eae-f55e-4fcf-bffd-ab8ec4d0ba8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0625fbaa-33c0-472a-8aba-526998b79f43', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:18:01 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7a31b6b7-e94c-49d2-a6b0-e6fe9a65d2b0 tempest-VolumesListTestJSON-57852208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc8bf4da-5110-443a-98b5-f023a6f7212a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:18:01 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-7a31b6b7-e94c-49d2-a6b0-e6fe9a65d2b0 tempest-VolumesListTestJSON-57852208 None] Volume volume-0625fbaa-33c0-472a-8aba-526998b79f43 (0625fbaa-33c0-472a-8aba-526998b79f43): created successfully
Jul 03 01:18:01 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7a31b6b7-e94c-49d2-a6b0-e6fe9a65d2b0 tempest-VolumesListTestJSON-57852208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc8bf4da-5110-443a-98b5-f023a6f7212a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:18:01 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7a31b6b7-e94c-49d2-a6b0-e6fe9a65d2b0 tempest-VolumesListTestJSON-57852208 None] Flow 'volume_create_manager' (e09296b6-5e89-49b4-810c-c463db0a7c37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:18:01 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-7a31b6b7-e94c-49d2-a6b0-e6fe9a65d2b0 tempest-VolumesListTestJSON-57852208 None] Created volume successfully.
Jul 03 01:18:01 devstack sudo[100222]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-93c0bc1c-ef30-47ff-b180-76dc8b1f775d tempest-VolumesSnapshotTestJSON-1936633444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-fa5938d9-1f61-40a3-9a52-a71eb4f5289a" returned: 0 in 0.812s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-93c0bc1c-ef30-47ff-b180-76dc8b1f775d tempest-VolumesSnapshotTestJSON-1936633444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-fa5938d9-1f61-40a3-9a52-a71eb4f5289a {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:01 devstack cinder-volume[86891]: DEBUG oslo_service.periodic_task [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86891) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 01:18:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:18:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:18:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:18:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:18:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:18:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:01 devstack sudo[100228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-fa5938d9-1f61-40a3-9a52-a71eb4f5289a
Jul 03 01:18:01 devstack sudo[100228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:01 devstack sudo[100230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:18:01 devstack sudo[100230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:02 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-920f4e5e-279f-4162-b6c2-608d22e1f6ef tempest-VolumesListTestJSON-57852208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:18:02 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-920f4e5e-279f-4162-b6c2-608d22e1f6ef tempest-VolumesListTestJSON-57852208 None] Flow 'volume_create_manager' (8ad328cf-8089-4830-86e5-4599af4a87e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:18:02 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-920f4e5e-279f-4162-b6c2-608d22e1f6ef tempest-VolumesListTestJSON-57852208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b7ac6e8-2498-46c6-a17e-0fb273b41bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:18:02 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-920f4e5e-279f-4162-b6c2-608d22e1f6ef tempest-VolumesListTestJSON-57852208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b7ac6e8-2498-46c6-a17e-0fb273b41bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:18:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-312327998',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa988035-8a5a-42b1-9c49-36bf735d65f3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='56d1ba692a9c4904ab931d6768f2280c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:18:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:18:03Z,use_quota=True,user_id='ff5bffa2d2324298a47e5ff0cf912bb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:18:02 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-920f4e5e-279f-4162-b6c2-608d22e1f6ef tempest-VolumesListTestJSON-57852208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4118b73b-f327-43be-a04c-a417a5f0c5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:18:02 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-920f4e5e-279f-4162-b6c2-608d22e1f6ef tempest-VolumesListTestJSON-57852208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4118b73b-f327-43be-a04c-a417a5f0c5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:18:02 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-920f4e5e-279f-4162-b6c2-608d22e1f6ef tempest-VolumesListTestJSON-57852208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c375e6e-0de0-4b9a-ae87-90932b53dcc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:18:02 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-920f4e5e-279f-4162-b6c2-608d22e1f6ef tempest-VolumesListTestJSON-57852208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c375e6e-0de0-4b9a-ae87-90932b53dcc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa988035-8a5a-42b1-9c49-36bf735d65f3', 'volume_name': 'volume-fa988035-8a5a-42b1-9c49-36bf735d65f3', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:18:02 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-920f4e5e-279f-4162-b6c2-608d22e1f6ef tempest-VolumesListTestJSON-57852208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28c389ae-dd7c-4392-b7f4-f9cede2cf888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:18:02 devstack sudo[100228]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:02 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-920f4e5e-279f-4162-b6c2-608d22e1f6ef tempest-VolumesListTestJSON-57852208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28c389ae-dd7c-4392-b7f4-f9cede2cf888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:18:02 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-920f4e5e-279f-4162-b6c2-608d22e1f6ef tempest-VolumesListTestJSON-57852208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (335de504-7649-4546-a581-c7821cbe4491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:18:02 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-920f4e5e-279f-4162-b6c2-608d22e1f6ef tempest-VolumesListTestJSON-57852208 None] Volume fa988035-8a5a-42b1-9c49-36bf735d65f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa988035-8a5a-42b1-9c49-36bf735d65f3', 'volume_size': 1}
Jul 03 01:18:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-920f4e5e-279f-4162-b6c2-608d22e1f6ef tempest-VolumesListTestJSON-57852208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:18:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-920f4e5e-279f-4162-b6c2-608d22e1f6ef tempest-VolumesListTestJSON-57852208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:18:02 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-920f4e5e-279f-4162-b6c2-608d22e1f6ef tempest-VolumesListTestJSON-57852208 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:18:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-312327998',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa988035-8a5a-42b1-9c49-36bf735d65f3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='56d1ba692a9c4904ab931d6768f2280c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:18:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:18:03Z,use_quota=True,user_id='ff5bffa2d2324298a47e5ff0cf912bb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:18:02 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-920f4e5e-279f-4162-b6c2-608d22e1f6ef tempest-VolumesListTestJSON-57852208 None] Creating volume fa988035-8a5a-42b1-9c49-36bf735d65f3 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:18:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-920f4e5e-279f-4162-b6c2-608d22e1f6ef tempest-VolumesListTestJSON-57852208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:18:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-920f4e5e-279f-4162-b6c2-608d22e1f6ef tempest-VolumesListTestJSON-57852208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:18:02 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-920f4e5e-279f-4162-b6c2-608d22e1f6ef tempest-VolumesListTestJSON-57852208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:18:02 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-920f4e5e-279f-4162-b6c2-608d22e1f6ef tempest-VolumesListTestJSON-57852208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:18:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-920f4e5e-279f-4162-b6c2-608d22e1f6ef tempest-VolumesListTestJSON-57852208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:18:02 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-920f4e5e-279f-4162-b6c2-608d22e1f6ef tempest-VolumesListTestJSON-57852208 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:18:02 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-920f4e5e-279f-4162-b6c2-608d22e1f6ef tempest-VolumesListTestJSON-57852208 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:18:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-920f4e5e-279f-4162-b6c2-608d22e1f6ef tempest-VolumesListTestJSON-57852208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-fa988035-8a5a-42b1-9c49-36bf735d65f3 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-93c0bc1c-ef30-47ff-b180-76dc8b1f775d tempest-VolumesSnapshotTestJSON-1936633444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-fa5938d9-1f61-40a3-9a52-a71eb4f5289a" returned: 0 in 0.850s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:02 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-93c0bc1c-ef30-47ff-b180-76dc8b1f775d tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "cinder-quobyte-fa5938d9-1f61-40a3-9a52-a71eb4f5289a" released by "delete_volume" :: held 1.718s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:18:02 devstack sudo[100234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-fa988035-8a5a-42b1-9c49-36bf735d65f3 1073741824
Jul 03 01:18:02 devstack sudo[100234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:02 devstack sudo[100230]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.902s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:02 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:18:02 devstack cinder-volume[86891]: DEBUG oslo_service.periodic_task [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running periodic task VolumeManager._thread_info {{(pid=86891) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 01:18:02 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] thread count: 28 {{(pid=86891) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 01:18:02 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] thread info: [<_MainThread(MainThread, started 136731296534656)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136731184953280)>, <Thread(Thread-3 (stat_writer), started daemon 136731184058816)>, <Thread(Rabbit-heartbeat, started daemon 136731184846080)>, <Thread(Thread-5 (_runner), started daemon 136731182936576)>, <Thread(Thread-7 (_runner), started daemon 136731182954944)>, <Thread(fd_logger, started daemon 136731181916416)>, <Thread(privsep_reader, started daemon 136731180942208)>, <Thread(tpool_thread_0, started daemon 136731172161216)>, <Thread(tpool_thread_1, started daemon 136731163768512)>, <Thread(tpool_thread_2, started daemon 136731155375808)>, <Thread(tpool_thread_3, started daemon 136731146983104)>, <Thread(tpool_thread_4, started daemon 136731138590400)>, <Thread(tpool_thread_5, started daemon 136731130197696)>, <Thread(tpool_thread_6, started daemon 136731121804992)>, <Thread(tpool_thread_7, started daemon 136731113412288)>, <Thread(tpool_thread_8, started daemon 136731105003200)>, <Thread(tpool_thread_9, started daemon 136731096594112)>, <Thread(tpool_thread_10, started daemon 136731088185024)>, <Thread(tpool_thread_11, started daemon 136731079775936)>, <Thread(tpool_thread_12, started daemon 136731071366848)>, <Thread(tpool_thread_13, started daemon 136731062957760)>, <Thread(tpool_thread_14, started daemon 136731054548672)>, <Thread(tpool_thread_15, started daemon 136731046139584)>, <Thread(tpool_thread_16, started daemon 136731037730496)>, <Thread(tpool_thread_17, started daemon 136731029321408)>, <Thread(tpool_thread_18, started daemon 136731020912320)>, <Thread(tpool_thread_19, started daemon 136731012503232)>] {{(pid=86891) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 01:18:02 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-93c0bc1c-ef30-47ff-b180-76dc8b1f775d tempest-VolumesSnapshotTestJSON-1936633444 None] Created reservations ['33a70e70-762d-4fcd-ad2a-5ea19062d311', 'bfc42573-7d6c-4a87-bd88-cf98e6010e78', '680aa188-9d55-4917-8c24-d8f306a31313', 'dcfa06c1-1ec0-425c-8114-eae6d7ab61a5'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:18:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-93c0bc1c-ef30-47ff-b180-76dc8b1f775d tempest-VolumesSnapshotTestJSON-1936633444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:18:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-93c0bc1c-ef30-47ff-b180-76dc8b1f775d tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:18:02 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-93c0bc1c-ef30-47ff-b180-76dc8b1f775d tempest-VolumesSnapshotTestJSON-1936633444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:18:02 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-93c0bc1c-ef30-47ff-b180-76dc8b1f775d tempest-VolumesSnapshotTestJSON-1936633444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:18:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-93c0bc1c-ef30-47ff-b180-76dc8b1f775d tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:18:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-93c0bc1c-ef30-47ff-b180-76dc8b1f775d tempest-VolumesSnapshotTestJSON-1936633444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:02 devstack sudo[100236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:18:02 devstack sudo[100236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:03 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8da907b6-707e-48ba-9c96-00680b52453c tempest-VolumesSnapshotTestJSON-1936633444 None] Acquiring lock "cinder-aa9e2442-cbba-4711-8773-fba6ac11d928-delete_snapshot" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:18:03 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8da907b6-707e-48ba-9c96-00680b52453c tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "cinder-aa9e2442-cbba-4711-8773-fba6ac11d928-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:18:03 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8da907b6-707e-48ba-9c96-00680b52453c tempest-VolumesSnapshotTestJSON-1936633444 None] Acquiring lock "cinder-quobyte-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:18:03 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8da907b6-707e-48ba-9c96-00680b52453c tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "cinder-quobyte-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:18:03 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8da907b6-707e-48ba-9c96-00680b52453c tempest-VolumesSnapshotTestJSON-1936633444 None] Acquiring lock "cinder-quobyte-aa9e2442-cbba-4711-8773-fba6ac11d928" by "_delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:18:03 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8da907b6-707e-48ba-9c96-00680b52453c tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "cinder-quobyte-aa9e2442-cbba-4711-8773-fba6ac11d928" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:18:03 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-8da907b6-707e-48ba-9c96-00680b52453c tempest-VolumesSnapshotTestJSON-1936633444 None] Deleting offline snapshot aa9e2442-cbba-4711-8773-fba6ac11d928 of volume a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9 {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 01:18:03 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-8da907b6-707e-48ba-9c96-00680b52453c tempest-VolumesSnapshotTestJSON-1936633444 None] snapshot_file for this snap is: volume-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9.aa9e2442-cbba-4711-8773-fba6ac11d928 {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 01:18:03 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b77094-139c-4673-b72b-90c7d921fb16]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:18:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8da907b6-707e-48ba-9c96-00680b52453c tempest-VolumesSnapshotTestJSON-1936633444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9.aa9e2442-cbba-4711-8773-fba6ac11d928 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:03 devstack sudo[100240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9.aa9e2442-cbba-4711-8773-fba6ac11d928
Jul 03 01:18:03 devstack sudo[100240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:03 devstack sudo[100236]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-93c0bc1c-ef30-47ff-b180-76dc8b1f775d tempest-VolumesSnapshotTestJSON-1936633444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.820s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:03 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-93c0bc1c-ef30-47ff-b180-76dc8b1f775d tempest-VolumesSnapshotTestJSON-1936633444 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:18:03 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-93c0bc1c-ef30-47ff-b180-76dc8b1f775d tempest-VolumesSnapshotTestJSON-1936633444 None] Deleted volume successfully.
Jul 03 01:18:03 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-93c0bc1c-ef30-47ff-b180-76dc8b1f775d tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "cinder-fa5938d9-1f61-40a3-9a52-a71eb4f5289a-delete_volume" released by "delete_volume" :: held 2.813s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:18:03 devstack sudo[100234]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-920f4e5e-279f-4162-b6c2-608d22e1f6ef tempest-VolumesListTestJSON-57852208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-fa988035-8a5a-42b1-9c49-36bf735d65f3 1073741824" returned: 0 in 1.130s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-920f4e5e-279f-4162-b6c2-608d22e1f6ef tempest-VolumesListTestJSON-57852208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-fa988035-8a5a-42b1-9c49-36bf735d65f3 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:03 devstack sudo[100245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-fa988035-8a5a-42b1-9c49-36bf735d65f3
Jul 03 01:18:03 devstack sudo[100245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:04 devstack sudo[100240]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8da907b6-707e-48ba-9c96-00680b52453c tempest-VolumesSnapshotTestJSON-1936633444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9.aa9e2442-cbba-4711-8773-fba6ac11d928" returned: 0 in 0.974s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:04 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-8da907b6-707e-48ba-9c96-00680b52453c tempest-VolumesSnapshotTestJSON-1936633444 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:18:04 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[51707342-dd69-4516-9539-2ff848bcdc13]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:18:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8da907b6-707e-48ba-9c96-00680b52453c tempest-VolumesSnapshotTestJSON-1936633444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:04 devstack sudo[100245]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-920f4e5e-279f-4162-b6c2-608d22e1f6ef tempest-VolumesListTestJSON-57852208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-fa988035-8a5a-42b1-9c49-36bf735d65f3" returned: 0 in 0.662s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:04 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-920f4e5e-279f-4162-b6c2-608d22e1f6ef tempest-VolumesListTestJSON-57852208 None] <== create_volume: return (1841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:18:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-920f4e5e-279f-4162-b6c2-608d22e1f6ef tempest-VolumesListTestJSON-57852208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.843s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:18:04 devstack sudo[100251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9
Jul 03 01:18:04 devstack sudo[100251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:04 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-920f4e5e-279f-4162-b6c2-608d22e1f6ef tempest-VolumesListTestJSON-57852208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (335de504-7649-4546-a581-c7821cbe4491) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa988035-8a5a-42b1-9c49-36bf735d65f3', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:18:04 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-920f4e5e-279f-4162-b6c2-608d22e1f6ef tempest-VolumesListTestJSON-57852208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25359843-e3ce-461a-b48f-d2465720b7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:18:04 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-920f4e5e-279f-4162-b6c2-608d22e1f6ef tempest-VolumesListTestJSON-57852208 None] Volume volume-fa988035-8a5a-42b1-9c49-36bf735d65f3 (fa988035-8a5a-42b1-9c49-36bf735d65f3): created successfully
Jul 03 01:18:04 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-920f4e5e-279f-4162-b6c2-608d22e1f6ef tempest-VolumesListTestJSON-57852208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25359843-e3ce-461a-b48f-d2465720b7ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:18:04 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-920f4e5e-279f-4162-b6c2-608d22e1f6ef tempest-VolumesListTestJSON-57852208 None] Flow 'volume_create_manager' (8ad328cf-8089-4830-86e5-4599af4a87e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:18:04 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-920f4e5e-279f-4162-b6c2-608d22e1f6ef tempest-VolumesListTestJSON-57852208 None] Created volume successfully.
Jul 03 01:18:05 devstack sudo[100251]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:05 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8da907b6-707e-48ba-9c96-00680b52453c tempest-VolumesSnapshotTestJSON-1936633444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9" returned: 0 in 0.835s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:05 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8da907b6-707e-48ba-9c96-00680b52453c tempest-VolumesSnapshotTestJSON-1936633444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9.aa9e2442-cbba-4711-8773-fba6ac11d928 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:05 devstack sudo[100256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9.aa9e2442-cbba-4711-8773-fba6ac11d928
Jul 03 01:18:05 devstack sudo[100256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:05 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:18:05 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Flow 'volume_create_manager' (12879ad8-b13d-468e-878f-7d3dddec3c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:18:05 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47c4da0b-02c7-4f4e-9855-7102b14688ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:18:05 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47c4da0b-02c7-4f4e-9855-7102b14688ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:18:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f6fdcec-f65c-479b-a6bb-566f36dc1526,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82dbef87ba054ddd9a9ecd69cecab124',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:18:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:18:05Z,use_quota=True,user_id='11e935dc4dee4fafab43d9eb577f2653',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55b5680f-e325-4d0c-b6ab-06dda1e60724),volume_type_id=55b5680f-e325-4d0c-b6ab-06dda1e60724)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:18:05 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52019215-df26-47d4-b4c1-567aa8d5195e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:18:05 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52019215-df26-47d4-b4c1-567aa8d5195e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:18:05 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (719e6ea4-8748-4a9f-94b4-b823cdbf5401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:18:05 devstack cinder-volume[86891]: DEBUG cinder.image.glance [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Creating Keystone auth plugin from conf {{(pid=86891) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 03 01:18:05 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-b64610a3-98e3-4d90-abf8-2740a7e6d266 tempest-VolumesListTestJSON-57852208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:18:05 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b64610a3-98e3-4d90-abf8-2740a7e6d266 tempest-VolumesListTestJSON-57852208 None] Flow 'volume_create_manager' (f341e3c4-b632-4985-944a-92f044c29780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:18:05 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b64610a3-98e3-4d90-abf8-2740a7e6d266 tempest-VolumesListTestJSON-57852208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e70f75a0-3800-40d6-8d0a-b0e0afc21527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:18:05 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b64610a3-98e3-4d90-abf8-2740a7e6d266 tempest-VolumesListTestJSON-57852208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e70f75a0-3800-40d6-8d0a-b0e0afc21527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:18:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1806675865',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69b362bf-3455-41b4-986e-f2eb3cb96a24,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='56d1ba692a9c4904ab931d6768f2280c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:18:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:18:06Z,use_quota=True,user_id='ff5bffa2d2324298a47e5ff0cf912bb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:18:05 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b64610a3-98e3-4d90-abf8-2740a7e6d266 tempest-VolumesListTestJSON-57852208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28f28a52-e2bc-4bcb-8ba5-8e8e250bfef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:18:05 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b64610a3-98e3-4d90-abf8-2740a7e6d266 tempest-VolumesListTestJSON-57852208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28f28a52-e2bc-4bcb-8ba5-8e8e250bfef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:18:05 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b64610a3-98e3-4d90-abf8-2740a7e6d266 tempest-VolumesListTestJSON-57852208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a026d98f-0bf1-4af7-a77a-285a559fb0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:18:05 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b64610a3-98e3-4d90-abf8-2740a7e6d266 tempest-VolumesListTestJSON-57852208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a026d98f-0bf1-4af7-a77a-285a559fb0a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69b362bf-3455-41b4-986e-f2eb3cb96a24', 'volume_name': 'volume-69b362bf-3455-41b4-986e-f2eb3cb96a24', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:18:05 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b64610a3-98e3-4d90-abf8-2740a7e6d266 tempest-VolumesListTestJSON-57852208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe9cf4a3-dda8-425b-97a6-c87873443b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:18:05 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b64610a3-98e3-4d90-abf8-2740a7e6d266 tempest-VolumesListTestJSON-57852208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe9cf4a3-dda8-425b-97a6-c87873443b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:18:05 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b64610a3-98e3-4d90-abf8-2740a7e6d266 tempest-VolumesListTestJSON-57852208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d636f3c-8c67-4023-a48f-6407bce1fe59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:18:05 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-b64610a3-98e3-4d90-abf8-2740a7e6d266 tempest-VolumesListTestJSON-57852208 None] Volume 69b362bf-3455-41b4-986e-f2eb3cb96a24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69b362bf-3455-41b4-986e-f2eb3cb96a24', 'volume_size': 1}
Jul 03 01:18:05 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b64610a3-98e3-4d90-abf8-2740a7e6d266 tempest-VolumesListTestJSON-57852208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:18:05 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b64610a3-98e3-4d90-abf8-2740a7e6d266 tempest-VolumesListTestJSON-57852208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:18:05 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-b64610a3-98e3-4d90-abf8-2740a7e6d266 tempest-VolumesListTestJSON-57852208 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:18:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1806675865',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69b362bf-3455-41b4-986e-f2eb3cb96a24,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='56d1ba692a9c4904ab931d6768f2280c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:18:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:18:06Z,use_quota=True,user_id='ff5bffa2d2324298a47e5ff0cf912bb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:18:05 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-b64610a3-98e3-4d90-abf8-2740a7e6d266 tempest-VolumesListTestJSON-57852208 None] Creating volume 69b362bf-3455-41b4-986e-f2eb3cb96a24 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:18:05 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b64610a3-98e3-4d90-abf8-2740a7e6d266 tempest-VolumesListTestJSON-57852208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:18:05 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b64610a3-98e3-4d90-abf8-2740a7e6d266 tempest-VolumesListTestJSON-57852208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:18:05 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-b64610a3-98e3-4d90-abf8-2740a7e6d266 tempest-VolumesListTestJSON-57852208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:18:05 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-b64610a3-98e3-4d90-abf8-2740a7e6d266 tempest-VolumesListTestJSON-57852208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:18:05 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b64610a3-98e3-4d90-abf8-2740a7e6d266 tempest-VolumesListTestJSON-57852208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:18:05 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-b64610a3-98e3-4d90-abf8-2740a7e6d266 tempest-VolumesListTestJSON-57852208 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:18:05 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-b64610a3-98e3-4d90-abf8-2740a7e6d266 tempest-VolumesListTestJSON-57852208 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:18:05 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b64610a3-98e3-4d90-abf8-2740a7e6d266 tempest-VolumesListTestJSON-57852208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-69b362bf-3455-41b4-986e-f2eb3cb96a24 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:05 devstack sudo[100258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-69b362bf-3455-41b4-986e-f2eb3cb96a24 1073741824
Jul 03 01:18:05 devstack sudo[100258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:05 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (719e6ea4-8748-4a9f-94b4-b823cdbf5401) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3f6fdcec-f65c-479b-a6bb-566f36dc1526', 'volume_name': 'volume-3f6fdcec-f65c-479b-a6bb-566f36dc1526', 'volume_size': 1, 'image_id': '7c007b72-4636-4c6f-95ea-83453222cee3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7c007b72-4636-4c6f-95ea-83453222cee3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '44e53b015dc1936b4517404861f6cba3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '82dbef87ba054ddd9a9ecd69cecab124', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '05512864c8453614ddb25c83ef4f87aef0ca084a740853a2ef0ab6860c0d73dfc8788309d4b698c39c0ac868ce1c92f0e600bbfdf8599d918e3a8e231ccb50d0', 'id': '7c007b72-4636-4c6f-95ea-83453222cee3', 'created_at': datetime.datetime(2026, 7, 2, 23, 18, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 23, 18, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7c007b72-4636-4c6f-95ea-83453222cee3/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7c5b35220d10>}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:18:05 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e1363bc-a5a4-4359-997b-278ef8527f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:18:05 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e1363bc-a5a4-4359-997b-278ef8527f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:18:05 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (014fcee2-5b0b-44e4-a4eb-47716fb43c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:18:05 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Volume 3f6fdcec-f65c-479b-a6bb-566f36dc1526: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3f6fdcec-f65c-479b-a6bb-566f36dc1526', 'volume_size': 1, 'image_id': '7c007b72-4636-4c6f-95ea-83453222cee3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7c007b72-4636-4c6f-95ea-83453222cee3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '44e53b015dc1936b4517404861f6cba3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '82dbef87ba054ddd9a9ecd69cecab124', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '05512864c8453614ddb25c83ef4f87aef0ca084a740853a2ef0ab6860c0d73dfc8788309d4b698c39c0ac868ce1c92f0e600bbfdf8599d918e3a8e231ccb50d0', 'id': '7c007b72-4636-4c6f-95ea-83453222cee3', 'created_at': datetime.datetime(2026, 7, 2, 23, 18, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 23, 18, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7c007b72-4636-4c6f-95ea-83453222cee3/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7c5b35220d10>}
Jul 03 01:18:05 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Trying to clone 3f6fdcec-f65c-479b-a6bb-566f36dc1526 from image 7c007b72-4636-4c6f-95ea-83453222cee3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7c007b72-4636-4c6f-95ea-83453222cee3', 'metadata': {}}]). {{(pid=86891) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 03 01:18:06 devstack cinder-volume[86891]: DEBUG cinder.image.image_utils [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7c007b72-4636-4c6f-95ea-83453222cee3_s98mtfvndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86891) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 03 01:18:06 devstack cinder-volume[86891]: INFO cinder.image.image_utils [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Image download 0.00 MB at 0.00 MB/s
Jul 03 01:18:06 devstack sudo[100256]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8da907b6-707e-48ba-9c96-00680b52453c tempest-VolumesSnapshotTestJSON-1936633444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9.aa9e2442-cbba-4711-8773-fba6ac11d928" returned: 0 in 0.776s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8da907b6-707e-48ba-9c96-00680b52453c tempest-VolumesSnapshotTestJSON-1936633444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9.aa9e2442-cbba-4711-8773-fba6ac11d928 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:06 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b79a24-ba61-4646-aac3-e3edd51f8718]: (4, 'raw') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:18:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7c007b72-4636-4c6f-95ea-83453222cee3_s98mtfvndevstack@QuobyteHD {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:06 devstack sudo[100264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9.aa9e2442-cbba-4711-8773-fba6ac11d928
Jul 03 01:18:06 devstack sudo[100264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:06 devstack sudo[100265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7c007b72-4636-4c6f-95ea-83453222cee3_s98mtfvndevstack@QuobyteHD
Jul 03 01:18:06 devstack sudo[100265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:06 devstack sudo[100258]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b64610a3-98e3-4d90-abf8-2740a7e6d266 tempest-VolumesListTestJSON-57852208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-69b362bf-3455-41b4-986e-f2eb3cb96a24 1073741824" returned: 0 in 1.005s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b64610a3-98e3-4d90-abf8-2740a7e6d266 tempest-VolumesListTestJSON-57852208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-69b362bf-3455-41b4-986e-f2eb3cb96a24 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:06 devstack sudo[100264]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8da907b6-707e-48ba-9c96-00680b52453c tempest-VolumesSnapshotTestJSON-1936633444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9.aa9e2442-cbba-4711-8773-fba6ac11d928" returned: 0 in 0.689s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:06 devstack sudo[100272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-69b362bf-3455-41b4-986e-f2eb3cb96a24
Jul 03 01:18:06 devstack sudo[100272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:06 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8da907b6-707e-48ba-9c96-00680b52453c tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "cinder-quobyte-aa9e2442-cbba-4711-8773-fba6ac11d928" released by "_delete_snapshot" :: held 3.418s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:18:06 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8da907b6-707e-48ba-9c96-00680b52453c tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "cinder-quobyte-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9" released by "delete_snapshot" :: held 3.456s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:18:06 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-8da907b6-707e-48ba-9c96-00680b52453c tempest-VolumesSnapshotTestJSON-1936633444 None] Created reservations ['b9894f6a-db4a-4c05-8260-de4cfba60f30', '7df31e02-b5b9-4e7b-83df-3e4d6d59d1b4', 'b8501012-773a-40ca-87be-bcaadb59c69e', '28f11ded-9f14-4c4f-9ac9-5c8856de120c'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:18:06 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-8da907b6-707e-48ba-9c96-00680b52453c tempest-VolumesSnapshotTestJSON-1936633444 None] Delete snapshot completed successfully.
Jul 03 01:18:06 devstack sudo[100265]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:06 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8da907b6-707e-48ba-9c96-00680b52453c tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "cinder-aa9e2442-cbba-4711-8773-fba6ac11d928-delete_snapshot" released by "delete_snapshot" :: held 3.620s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:18:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7c007b72-4636-4c6f-95ea-83453222cee3_s98mtfvndevstack@QuobyteHD" returned: 0 in 0.854s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7c007b72-4636-4c6f-95ea-83453222cee3_s98mtfvndevstack@QuobyteHD {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:07 devstack sudo[100276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7c007b72-4636-4c6f-95ea-83453222cee3_s98mtfvndevstack@QuobyteHD
Jul 03 01:18:07 devstack sudo[100276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:07 devstack sudo[100272]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:07 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b64610a3-98e3-4d90-abf8-2740a7e6d266 tempest-VolumesListTestJSON-57852208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-69b362bf-3455-41b4-986e-f2eb3cb96a24" returned: 0 in 0.660s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:07 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-b64610a3-98e3-4d90-abf8-2740a7e6d266 tempest-VolumesListTestJSON-57852208 None] <== create_volume: return (1713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:18:07 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b64610a3-98e3-4d90-abf8-2740a7e6d266 tempest-VolumesListTestJSON-57852208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.716s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:18:07 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b64610a3-98e3-4d90-abf8-2740a7e6d266 tempest-VolumesListTestJSON-57852208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d636f3c-8c67-4023-a48f-6407bce1fe59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69b362bf-3455-41b4-986e-f2eb3cb96a24', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:18:07 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b64610a3-98e3-4d90-abf8-2740a7e6d266 tempest-VolumesListTestJSON-57852208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31bceb66-3d9f-4e98-a45f-2618733d1035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:18:07 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-b64610a3-98e3-4d90-abf8-2740a7e6d266 tempest-VolumesListTestJSON-57852208 None] Volume volume-69b362bf-3455-41b4-986e-f2eb3cb96a24 (69b362bf-3455-41b4-986e-f2eb3cb96a24): created successfully
Jul 03 01:18:07 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b64610a3-98e3-4d90-abf8-2740a7e6d266 tempest-VolumesListTestJSON-57852208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31bceb66-3d9f-4e98-a45f-2618733d1035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:18:07 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b64610a3-98e3-4d90-abf8-2740a7e6d266 tempest-VolumesListTestJSON-57852208 None] Flow 'volume_create_manager' (f341e3c4-b632-4985-944a-92f044c29780) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:18:07 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-b64610a3-98e3-4d90-abf8-2740a7e6d266 tempest-VolumesListTestJSON-57852208 None] Created volume successfully.
Jul 03 01:18:07 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-002f4f69-e6b1-4124-a4e1-1af59c1eadb1 tempest-VolumesSnapshotTestJSON-1936633444 None] Acquiring lock "cinder-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:18:07 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-002f4f69-e6b1-4124-a4e1-1af59c1eadb1 tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "cinder-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:18:07 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-002f4f69-e6b1-4124-a4e1-1af59c1eadb1 tempest-VolumesSnapshotTestJSON-1936633444 None] Acquiring lock "cinder-quobyte-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:18:07 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-002f4f69-e6b1-4124-a4e1-1af59c1eadb1 tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "cinder-quobyte-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9" acquired by "delete_volume" :: waited 0.016s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:18:07 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[feff53e1-a502-4a98-a557-11be30ec5442]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:18:07 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-002f4f69-e6b1-4124-a4e1-1af59c1eadb1 tempest-VolumesSnapshotTestJSON-1936633444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:07 devstack sudo[100276]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:07 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7c007b72-4636-4c6f-95ea-83453222cee3_s98mtfvndevstack@QuobyteHD" returned: 1 in 0.880s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:07 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7c007b72-4636-4c6f-95ea-83453222cee3_s98mtfvndevstack@QuobyteHD' failed. Not Retrying. {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 01:18:07 devstack cinder-volume[86891]: DEBUG cinder.image.image_utils [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Temporary image 7c007b72-4636-4c6f-95ea-83453222cee3 is fetched for user 11e935dc4dee4fafab43d9eb577f2653. {{(pid=86891) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 03 01:18:07 devstack sudo[100284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9
Jul 03 01:18:07 devstack sudo[100284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:07 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a8a859-0550-41bb-9b7f-942af3e994e7]: (4, 'raw') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:18:07 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7c007b72-4636-4c6f-95ea-83453222cee3_s98mtfvndevstack@QuobyteHD {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:08 devstack sudo[100286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7c007b72-4636-4c6f-95ea-83453222cee3_s98mtfvndevstack@QuobyteHD
Jul 03 01:18:08 devstack sudo[100286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:08 devstack sudo[100284]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:08 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-002f4f69-e6b1-4124-a4e1-1af59c1eadb1 tempest-VolumesSnapshotTestJSON-1936633444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9" returned: 0 in 0.846s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:08 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-002f4f69-e6b1-4124-a4e1-1af59c1eadb1 tempest-VolumesSnapshotTestJSON-1936633444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:08 devstack sudo[100286]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:08 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7c007b72-4636-4c6f-95ea-83453222cee3_s98mtfvndevstack@QuobyteHD" returned: 0 in 0.729s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:08 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7c007b72-4636-4c6f-95ea-83453222cee3_s98mtfvndevstack@QuobyteHD {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:08 devstack sudo[100294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9
Jul 03 01:18:08 devstack sudo[100294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:08 devstack sudo[100295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7c007b72-4636-4c6f-95ea-83453222cee3_s98mtfvndevstack@QuobyteHD
Jul 03 01:18:08 devstack sudo[100295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:09 devstack sudo[100294]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-002f4f69-e6b1-4124-a4e1-1af59c1eadb1 tempest-VolumesSnapshotTestJSON-1936633444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9" returned: 0 in 0.710s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:09 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-002f4f69-e6b1-4124-a4e1-1af59c1eadb1 tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "cinder-quobyte-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9" released by "delete_volume" :: held 1.645s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:18:09 devstack sudo[100295]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7c007b72-4636-4c6f-95ea-83453222cee3_s98mtfvndevstack@QuobyteHD" returned: 1 in 0.740s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7c007b72-4636-4c6f-95ea-83453222cee3_s98mtfvndevstack@QuobyteHD' failed. Not Retrying. {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 01:18:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:18:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:18:09 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:18:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f6fdcec-f65c-479b-a6bb-566f36dc1526,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82dbef87ba054ddd9a9ecd69cecab124',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:18:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:18:05Z,use_quota=True,user_id='11e935dc4dee4fafab43d9eb577f2653',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55b5680f-e325-4d0c-b6ab-06dda1e60724),volume_type_id=55b5680f-e325-4d0c-b6ab-06dda1e60724)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:18:09 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Creating volume 3f6fdcec-f65c-479b-a6bb-566f36dc1526 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:18:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:18:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:18:09 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:18:09 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:18:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:18:09 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:18:09 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:18:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3f6fdcec-f65c-479b-a6bb-566f36dc1526 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:09 devstack sudo[100302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3f6fdcec-f65c-479b-a6bb-566f36dc1526 1073741824
Jul 03 01:18:09 devstack sudo[100302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:09 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-002f4f69-e6b1-4124-a4e1-1af59c1eadb1 tempest-VolumesSnapshotTestJSON-1936633444 None] Created reservations ['9341bc53-2fa3-4117-bbff-4a0b8ee18323', '8b73ea15-1f1b-4ec7-a4db-f6899745f734', '11bcf3e3-a766-473b-a303-750c8eb71ac5', 'bd478b34-d540-4a97-80fe-308c48cdc5c0'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:18:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-002f4f69-e6b1-4124-a4e1-1af59c1eadb1 tempest-VolumesSnapshotTestJSON-1936633444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:18:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-002f4f69-e6b1-4124-a4e1-1af59c1eadb1 tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:18:09 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-002f4f69-e6b1-4124-a4e1-1af59c1eadb1 tempest-VolumesSnapshotTestJSON-1936633444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:18:09 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-002f4f69-e6b1-4124-a4e1-1af59c1eadb1 tempest-VolumesSnapshotTestJSON-1936633444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:18:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-002f4f69-e6b1-4124-a4e1-1af59c1eadb1 tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:18:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-002f4f69-e6b1-4124-a4e1-1af59c1eadb1 tempest-VolumesSnapshotTestJSON-1936633444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:09 devstack sudo[100304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:18:09 devstack sudo[100304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:09 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-4b0f7da9-7ec7-4d7d-9731-a073610efa1c tempest-VolumesSnapshotTestJSON-1936633444 None] Acquiring lock "cinder-de77010b-5740-4b6c-bc34-f6923b0c848b-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:18:10 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-4b0f7da9-7ec7-4d7d-9731-a073610efa1c tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "cinder-de77010b-5740-4b6c-bc34-f6923b0c848b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:18:10 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-4b0f7da9-7ec7-4d7d-9731-a073610efa1c tempest-VolumesSnapshotTestJSON-1936633444 None] Acquiring lock "cinder-quobyte-de77010b-5740-4b6c-bc34-f6923b0c848b" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:18:10 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-4b0f7da9-7ec7-4d7d-9731-a073610efa1c tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "cinder-quobyte-de77010b-5740-4b6c-bc34-f6923b0c848b" acquired by "delete_volume" :: waited 0.020s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:18:10 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c63f285-bf80-4652-b154-edd3975b2dae]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:18:10 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-4b0f7da9-7ec7-4d7d-9731-a073610efa1c tempest-VolumesSnapshotTestJSON-1936633444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-de77010b-5740-4b6c-bc34-f6923b0c848b {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:10 devstack sudo[100308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-de77010b-5740-4b6c-bc34-f6923b0c848b
Jul 03 01:18:10 devstack sudo[100308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:10 devstack sudo[100304]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:10 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-002f4f69-e6b1-4124-a4e1-1af59c1eadb1 tempest-VolumesSnapshotTestJSON-1936633444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.815s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:10 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-002f4f69-e6b1-4124-a4e1-1af59c1eadb1 tempest-VolumesSnapshotTestJSON-1936633444 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:18:10 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-002f4f69-e6b1-4124-a4e1-1af59c1eadb1 tempest-VolumesSnapshotTestJSON-1936633444 None] Deleted volume successfully.
Jul 03 01:18:10 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-002f4f69-e6b1-4124-a4e1-1af59c1eadb1 tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "cinder-a91fc6e7-b3ac-402f-9b2c-e69b999b5aa9-delete_volume" released by "delete_volume" :: held 2.769s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:18:10 devstack sudo[100302]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:10 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3f6fdcec-f65c-479b-a6bb-566f36dc1526 1073741824" returned: 0 in 1.098s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:10 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3f6fdcec-f65c-479b-a6bb-566f36dc1526 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:10 devstack sudo[100313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3f6fdcec-f65c-479b-a6bb-566f36dc1526
Jul 03 01:18:10 devstack sudo[100313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:11 devstack sudo[100308]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:11 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-4b0f7da9-7ec7-4d7d-9731-a073610efa1c tempest-VolumesSnapshotTestJSON-1936633444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-de77010b-5740-4b6c-bc34-f6923b0c848b" returned: 0 in 0.907s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:11 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-4b0f7da9-7ec7-4d7d-9731-a073610efa1c tempest-VolumesSnapshotTestJSON-1936633444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-de77010b-5740-4b6c-bc34-f6923b0c848b {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:11 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8eec97bd-788d-4b84-9bf1-d9358a11d248 tempest-VolumesListTestJSON-57852208 None] Acquiring lock "cinder-69b362bf-3455-41b4-986e-f2eb3cb96a24-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:18:11 devstack sudo[100318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-de77010b-5740-4b6c-bc34-f6923b0c848b
Jul 03 01:18:11 devstack sudo[100318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:11 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8eec97bd-788d-4b84-9bf1-d9358a11d248 tempest-VolumesListTestJSON-57852208 None] Lock "cinder-69b362bf-3455-41b4-986e-f2eb3cb96a24-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:18:11 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8eec97bd-788d-4b84-9bf1-d9358a11d248 tempest-VolumesListTestJSON-57852208 None] Acquiring lock "cinder-quobyte-69b362bf-3455-41b4-986e-f2eb3cb96a24" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:18:11 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8eec97bd-788d-4b84-9bf1-d9358a11d248 tempest-VolumesListTestJSON-57852208 None] Lock "cinder-quobyte-69b362bf-3455-41b4-986e-f2eb3cb96a24" acquired by "delete_volume" :: waited 0.018s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:18:11 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f84a89a-8d21-4501-9d74-d0c4271fb578]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:18:11 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8eec97bd-788d-4b84-9bf1-d9358a11d248 tempest-VolumesListTestJSON-57852208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-69b362bf-3455-41b4-986e-f2eb3cb96a24 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:11 devstack sudo[100313]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:11 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3f6fdcec-f65c-479b-a6bb-566f36dc1526" returned: 0 in 0.710s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:11 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] <== create_volume: return (1870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:18:11 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.874s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:18:11 devstack cinder-volume[86891]: DEBUG cinder.volume.volume_utils [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Attempting download of 7c007b72-4636-4c6f-95ea-83453222cee3 ((None, [{'url': 'file:///opt/stack/data/glance/images/7c007b72-4636-4c6f-95ea-83453222cee3', 'metadata': {}}])) to volume 3f6fdcec-f65c-479b-a6bb-566f36dc1526. {{(pid=86891) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 03 01:18:11 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[66fde25f-10fa-4add-842d-0d07a8e5c42e]: (4, 'raw') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:18:11 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7c007b72-4636-4c6f-95ea-83453222cee3_wfevnf7m {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:11 devstack sudo[100321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-69b362bf-3455-41b4-986e-f2eb3cb96a24
Jul 03 01:18:11 devstack sudo[100321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:11 devstack sudo[100322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7c007b72-4636-4c6f-95ea-83453222cee3_wfevnf7m
Jul 03 01:18:11 devstack sudo[100322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:11 devstack sudo[100318]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:11 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-4b0f7da9-7ec7-4d7d-9731-a073610efa1c tempest-VolumesSnapshotTestJSON-1936633444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-de77010b-5740-4b6c-bc34-f6923b0c848b" returned: 0 in 0.751s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:11 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-4b0f7da9-7ec7-4d7d-9731-a073610efa1c tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "cinder-quobyte-de77010b-5740-4b6c-bc34-f6923b0c848b" released by "delete_volume" :: held 1.737s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:18:11 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-4b0f7da9-7ec7-4d7d-9731-a073610efa1c tempest-VolumesSnapshotTestJSON-1936633444 None] Created reservations ['96df7f1f-6389-45db-aa52-b34ca21d18a0', '1f59925e-160c-4fa5-8d1a-445608e1dc40', 'ac8c06e0-b194-477c-a601-47df3877e0ca', 'fd073346-022c-43e3-a3b2-673cdb3f6b22'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:18:11 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-4b0f7da9-7ec7-4d7d-9731-a073610efa1c tempest-VolumesSnapshotTestJSON-1936633444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:18:11 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-4b0f7da9-7ec7-4d7d-9731-a073610efa1c tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:18:11 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-4b0f7da9-7ec7-4d7d-9731-a073610efa1c tempest-VolumesSnapshotTestJSON-1936633444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:18:11 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-4b0f7da9-7ec7-4d7d-9731-a073610efa1c tempest-VolumesSnapshotTestJSON-1936633444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:18:11 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-4b0f7da9-7ec7-4d7d-9731-a073610efa1c tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:18:11 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-4b0f7da9-7ec7-4d7d-9731-a073610efa1c tempest-VolumesSnapshotTestJSON-1936633444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:12 devstack sudo[100329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:18:12 devstack sudo[100329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:12 devstack sudo[100321]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8eec97bd-788d-4b84-9bf1-d9358a11d248 tempest-VolumesListTestJSON-57852208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-69b362bf-3455-41b4-986e-f2eb3cb96a24" returned: 0 in 0.846s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8eec97bd-788d-4b84-9bf1-d9358a11d248 tempest-VolumesListTestJSON-57852208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-69b362bf-3455-41b4-986e-f2eb3cb96a24 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:12 devstack sudo[100322]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7c007b72-4636-4c6f-95ea-83453222cee3_wfevnf7m" returned: 0 in 0.769s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c007b72-4636-4c6f-95ea-83453222cee3_wfevnf7m {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:12 devstack sudo[100333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-69b362bf-3455-41b4-986e-f2eb3cb96a24
Jul 03 01:18:12 devstack sudo[100333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:12 devstack sudo[100335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c007b72-4636-4c6f-95ea-83453222cee3_wfevnf7m
Jul 03 01:18:12 devstack sudo[100335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:12 devstack sudo[100329]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-4b0f7da9-7ec7-4d7d-9731-a073610efa1c tempest-VolumesSnapshotTestJSON-1936633444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.836s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:12 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-4b0f7da9-7ec7-4d7d-9731-a073610efa1c tempest-VolumesSnapshotTestJSON-1936633444 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:18:12 devstack sudo[100333]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8eec97bd-788d-4b84-9bf1-d9358a11d248 tempest-VolumesListTestJSON-57852208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-69b362bf-3455-41b4-986e-f2eb3cb96a24" returned: 0 in 0.747s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:12 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-4b0f7da9-7ec7-4d7d-9731-a073610efa1c tempest-VolumesSnapshotTestJSON-1936633444 None] Deleted volume successfully.
Jul 03 01:18:12 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8eec97bd-788d-4b84-9bf1-d9358a11d248 tempest-VolumesListTestJSON-57852208 None] Lock "cinder-quobyte-69b362bf-3455-41b4-986e-f2eb3cb96a24" released by "delete_volume" :: held 1.650s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:18:12 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-4b0f7da9-7ec7-4d7d-9731-a073610efa1c tempest-VolumesSnapshotTestJSON-1936633444 None] Lock "cinder-de77010b-5740-4b6c-bc34-f6923b0c848b-delete_volume" released by "delete_volume" :: held 2.878s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:18:12 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-8eec97bd-788d-4b84-9bf1-d9358a11d248 tempest-VolumesListTestJSON-57852208 None] Created reservations ['f9e1b892-8e54-4824-94b2-8fc00b5fd97c', 'c0b9d58f-ff3c-4b6e-a205-9196aed72526', 'dd706d93-881d-44d3-882d-fc527012c1de', '55e0d179-9f4b-4def-b4ee-c7a25aff28a6'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:18:12 devstack sudo[100335]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c007b72-4636-4c6f-95ea-83453222cee3_wfevnf7m" returned: 1 in 0.824s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c007b72-4636-4c6f-95ea-83453222cee3_wfevnf7m' failed. Not Retrying. {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 01:18:12 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8835917-ee12-4122-9aa5-1279390d8c54]: (4, 'raw') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:18:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7c007b72-4636-4c6f-95ea-83453222cee3_s98mtfvndevstack@QuobyteHD {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-8eec97bd-788d-4b84-9bf1-d9358a11d248 tempest-VolumesListTestJSON-57852208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:18:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-8eec97bd-788d-4b84-9bf1-d9358a11d248 tempest-VolumesListTestJSON-57852208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:18:13 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-8eec97bd-788d-4b84-9bf1-d9358a11d248 tempest-VolumesListTestJSON-57852208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:18:13 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-8eec97bd-788d-4b84-9bf1-d9358a11d248 tempest-VolumesListTestJSON-57852208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:18:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-8eec97bd-788d-4b84-9bf1-d9358a11d248 tempest-VolumesListTestJSON-57852208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:18:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8eec97bd-788d-4b84-9bf1-d9358a11d248 tempest-VolumesListTestJSON-57852208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:13 devstack sudo[100342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:18:13 devstack sudo[100342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:13 devstack sudo[100341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7c007b72-4636-4c6f-95ea-83453222cee3_s98mtfvndevstack@QuobyteHD
Jul 03 01:18:13 devstack sudo[100341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:13 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-66970bed-2d61-4784-bb98-838970409aba tempest-VolumesListTestJSON-57852208 None] Acquiring lock "cinder-fa988035-8a5a-42b1-9c49-36bf735d65f3-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:18:13 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-66970bed-2d61-4784-bb98-838970409aba tempest-VolumesListTestJSON-57852208 None] Lock "cinder-fa988035-8a5a-42b1-9c49-36bf735d65f3-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:18:13 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-66970bed-2d61-4784-bb98-838970409aba tempest-VolumesListTestJSON-57852208 None] Acquiring lock "cinder-quobyte-fa988035-8a5a-42b1-9c49-36bf735d65f3" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:18:13 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-66970bed-2d61-4784-bb98-838970409aba tempest-VolumesListTestJSON-57852208 None] Lock "cinder-quobyte-fa988035-8a5a-42b1-9c49-36bf735d65f3" acquired by "delete_volume" :: waited 0.017s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:18:13 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09fafeb-d784-4e40-8e10-1237071b094d]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:18:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-66970bed-2d61-4784-bb98-838970409aba tempest-VolumesListTestJSON-57852208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-fa988035-8a5a-42b1-9c49-36bf735d65f3 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:13 devstack sudo[100345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-fa988035-8a5a-42b1-9c49-36bf735d65f3
Jul 03 01:18:13 devstack sudo[100345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:13 devstack sudo[100342]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8eec97bd-788d-4b84-9bf1-d9358a11d248 tempest-VolumesListTestJSON-57852208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.762s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:13 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-8eec97bd-788d-4b84-9bf1-d9358a11d248 tempest-VolumesListTestJSON-57852208 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:18:13 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-8eec97bd-788d-4b84-9bf1-d9358a11d248 tempest-VolumesListTestJSON-57852208 None] Deleted volume successfully.
Jul 03 01:18:13 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8eec97bd-788d-4b84-9bf1-d9358a11d248 tempest-VolumesListTestJSON-57852208 None] Lock "cinder-69b362bf-3455-41b4-986e-f2eb3cb96a24-delete_volume" released by "delete_volume" :: held 2.718s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:18:13 devstack sudo[100341]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7c007b72-4636-4c6f-95ea-83453222cee3_s98mtfvndevstack@QuobyteHD" returned: 0 in 0.926s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7c007b72-4636-4c6f-95ea-83453222cee3_s98mtfvndevstack@QuobyteHD {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:14 devstack sudo[100351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7c007b72-4636-4c6f-95ea-83453222cee3_s98mtfvndevstack@QuobyteHD
Jul 03 01:18:14 devstack sudo[100351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:14 devstack sudo[100345]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-66970bed-2d61-4784-bb98-838970409aba tempest-VolumesListTestJSON-57852208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-fa988035-8a5a-42b1-9c49-36bf735d65f3" returned: 0 in 0.898s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-66970bed-2d61-4784-bb98-838970409aba tempest-VolumesListTestJSON-57852208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-fa988035-8a5a-42b1-9c49-36bf735d65f3 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:14 devstack sudo[100356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-fa988035-8a5a-42b1-9c49-36bf735d65f3
Jul 03 01:18:14 devstack sudo[100356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:14 devstack sudo[100351]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7c007b72-4636-4c6f-95ea-83453222cee3_s98mtfvndevstack@QuobyteHD" returned: 1 in 0.872s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7c007b72-4636-4c6f-95ea-83453222cee3_s98mtfvndevstack@QuobyteHD' failed. Not Retrying. {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 01:18:14 devstack cinder-volume[86891]: DEBUG cinder.image.image_utils [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] 7c007b72-4636-4c6f-95ea-83453222cee3 was raw, converting to raw {{(pid=86891) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 03 01:18:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_7c007b72-4636-4c6f-95ea-83453222cee3_s98mtfvndevstack@QuobyteHD /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3f6fdcec-f65c-479b-a6bb-566f36dc1526 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:14 devstack sudo[100361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_7c007b72-4636-4c6f-95ea-83453222cee3_s98mtfvndevstack@QuobyteHD /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3f6fdcec-f65c-479b-a6bb-566f36dc1526
Jul 03 01:18:14 devstack sudo[100361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:15 devstack sudo[100356]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-66970bed-2d61-4784-bb98-838970409aba tempest-VolumesListTestJSON-57852208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-fa988035-8a5a-42b1-9c49-36bf735d65f3" returned: 0 in 0.733s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:15 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-66970bed-2d61-4784-bb98-838970409aba tempest-VolumesListTestJSON-57852208 None] Lock "cinder-quobyte-fa988035-8a5a-42b1-9c49-36bf735d65f3" released by "delete_volume" :: held 1.692s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:18:15 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-66970bed-2d61-4784-bb98-838970409aba tempest-VolumesListTestJSON-57852208 None] Created reservations ['7b72472f-d81e-4bea-a138-3f64eeecb2ec', 'f9cd4903-60dd-4b3a-98f3-82b6cfc0656e', 'e1bd328a-b401-4ab5-8825-a3b9ab50aa18', 'b5a898cb-ff3f-48b9-b086-09cdcb645291'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:18:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-66970bed-2d61-4784-bb98-838970409aba tempest-VolumesListTestJSON-57852208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:18:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-66970bed-2d61-4784-bb98-838970409aba tempest-VolumesListTestJSON-57852208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:18:15 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-66970bed-2d61-4784-bb98-838970409aba tempest-VolumesListTestJSON-57852208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:18:15 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-66970bed-2d61-4784-bb98-838970409aba tempest-VolumesListTestJSON-57852208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:18:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-66970bed-2d61-4784-bb98-838970409aba tempest-VolumesListTestJSON-57852208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:18:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-66970bed-2d61-4784-bb98-838970409aba tempest-VolumesListTestJSON-57852208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:15 devstack sudo[100367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:18:15 devstack sudo[100367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:15 devstack sudo[100361]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_7c007b72-4636-4c6f-95ea-83453222cee3_s98mtfvndevstack@QuobyteHD /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3f6fdcec-f65c-479b-a6bb-566f36dc1526" returned: 0 in 0.931s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:15 devstack cinder-volume[86891]: DEBUG cinder.image.image_utils [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7c007b72-4636-4c6f-95ea-83453222cee3_s98mtfvndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3f6fdcec-f65c-479b-a6bb-566f36dc1526 {{(pid=86891) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 03 01:18:15 devstack cinder-volume[86891]: INFO cinder.image.image_utils [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Converted 0.00 MB image at 0.00 MB/s
Jul 03 01:18:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3f6fdcec-f65c-479b-a6bb-566f36dc1526 1G {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:15 devstack sudo[100369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3f6fdcec-f65c-479b-a6bb-566f36dc1526 1G
Jul 03 01:18:15 devstack sudo[100369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:15 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-582f5190-adbc-435c-9baf-fa447d16f781 tempest-VolumesListTestJSON-57852208 None] Acquiring lock "cinder-0625fbaa-33c0-472a-8aba-526998b79f43-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:18:15 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-582f5190-adbc-435c-9baf-fa447d16f781 tempest-VolumesListTestJSON-57852208 None] Lock "cinder-0625fbaa-33c0-472a-8aba-526998b79f43-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:18:15 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-582f5190-adbc-435c-9baf-fa447d16f781 tempest-VolumesListTestJSON-57852208 None] Acquiring lock "cinder-quobyte-0625fbaa-33c0-472a-8aba-526998b79f43" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:18:15 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-582f5190-adbc-435c-9baf-fa447d16f781 tempest-VolumesListTestJSON-57852208 None] Lock "cinder-quobyte-0625fbaa-33c0-472a-8aba-526998b79f43" acquired by "delete_volume" :: waited 0.020s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:18:16 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ef199f-911a-44d0-9c52-37894ec7000c]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:18:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-582f5190-adbc-435c-9baf-fa447d16f781 tempest-VolumesListTestJSON-57852208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0625fbaa-33c0-472a-8aba-526998b79f43 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:16 devstack sudo[100371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0625fbaa-33c0-472a-8aba-526998b79f43
Jul 03 01:18:16 devstack sudo[100371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:16 devstack sudo[100367]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-66970bed-2d61-4784-bb98-838970409aba tempest-VolumesListTestJSON-57852208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.894s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:16 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-66970bed-2d61-4784-bb98-838970409aba tempest-VolumesListTestJSON-57852208 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:18:16 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-66970bed-2d61-4784-bb98-838970409aba tempest-VolumesListTestJSON-57852208 None] Deleted volume successfully.
Jul 03 01:18:16 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-66970bed-2d61-4784-bb98-838970409aba tempest-VolumesListTestJSON-57852208 None] Lock "cinder-fa988035-8a5a-42b1-9c49-36bf735d65f3-delete_volume" released by "delete_volume" :: held 2.960s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:18:16 devstack sudo[100369]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3f6fdcec-f65c-479b-a6bb-566f36dc1526 1G" returned: 0 in 0.963s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:16 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[508b5ff2-1c64-4b4b-a329-dbca55c8fea9]: (4, 'raw') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:18:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3f6fdcec-f65c-479b-a6bb-566f36dc1526 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:16 devstack sudo[100378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3f6fdcec-f65c-479b-a6bb-566f36dc1526
Jul 03 01:18:16 devstack sudo[100378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:16 devstack sudo[100371]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-582f5190-adbc-435c-9baf-fa447d16f781 tempest-VolumesListTestJSON-57852208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0625fbaa-33c0-472a-8aba-526998b79f43" returned: 0 in 0.930s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-582f5190-adbc-435c-9baf-fa447d16f781 tempest-VolumesListTestJSON-57852208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0625fbaa-33c0-472a-8aba-526998b79f43 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:16 devstack sudo[100383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0625fbaa-33c0-472a-8aba-526998b79f43
Jul 03 01:18:16 devstack sudo[100383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:17 devstack sudo[100378]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3f6fdcec-f65c-479b-a6bb-566f36dc1526" returned: 0 in 0.812s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3f6fdcec-f65c-479b-a6bb-566f36dc1526 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:17 devstack sudo[100387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3f6fdcec-f65c-479b-a6bb-566f36dc1526
Jul 03 01:18:17 devstack sudo[100387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:17 devstack sudo[100383]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-582f5190-adbc-435c-9baf-fa447d16f781 tempest-VolumesListTestJSON-57852208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0625fbaa-33c0-472a-8aba-526998b79f43" returned: 0 in 0.730s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:17 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-582f5190-adbc-435c-9baf-fa447d16f781 tempest-VolumesListTestJSON-57852208 None] Lock "cinder-quobyte-0625fbaa-33c0-472a-8aba-526998b79f43" released by "delete_volume" :: held 1.724s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:18:17 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-582f5190-adbc-435c-9baf-fa447d16f781 tempest-VolumesListTestJSON-57852208 None] Created reservations ['ada7c226-16bd-4f34-bde4-9a5a1a702e60', 'd4b8d26f-819c-4e61-8db8-336a0ffbc03e', 'ff988ba6-bc9a-4966-8223-363099aed0eb', '26997034-3834-47d7-9602-9c58b1870e9e'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:18:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-582f5190-adbc-435c-9baf-fa447d16f781 tempest-VolumesListTestJSON-57852208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:18:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-582f5190-adbc-435c-9baf-fa447d16f781 tempest-VolumesListTestJSON-57852208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:18:17 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-582f5190-adbc-435c-9baf-fa447d16f781 tempest-VolumesListTestJSON-57852208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:18:17 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-582f5190-adbc-435c-9baf-fa447d16f781 tempest-VolumesListTestJSON-57852208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:18:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-582f5190-adbc-435c-9baf-fa447d16f781 tempest-VolumesListTestJSON-57852208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:18:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-582f5190-adbc-435c-9baf-fa447d16f781 tempest-VolumesListTestJSON-57852208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:17 devstack sudo[100390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:18:17 devstack sudo[100390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:18 devstack sudo[100387]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3f6fdcec-f65c-479b-a6bb-566f36dc1526" returned: 1 in 0.882s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3f6fdcec-f65c-479b-a6bb-566f36dc1526' failed. Not Retrying. {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 01:18:18 devstack cinder-volume[86891]: DEBUG cinder.volume.volume_utils [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Downloaded image 7c007b72-4636-4c6f-95ea-83453222cee3 ((None, [{'url': 'file:///opt/stack/data/glance/images/7c007b72-4636-4c6f-95ea-83453222cee3', 'metadata': {}}])) to volume 3f6fdcec-f65c-479b-a6bb-566f36dc1526 successfully. {{(pid=86891) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 03 01:18:18 devstack cinder-volume[86891]: DEBUG cinder.image.image_utils [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Temporary image 7c007b72-4636-4c6f-95ea-83453222cee3 for user 11e935dc4dee4fafab43d9eb577f2653 is deleted. {{(pid=86891) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 03 01:18:18 devstack cinder-volume[86891]: DEBUG cinder.volume.volume_utils [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Marking volume 3f6fdcec-f65c-479b-a6bb-566f36dc1526 as bootable. {{(pid=86891) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 03 01:18:18 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Copying metadata from image 7c007b72-4636-4c6f-95ea-83453222cee3 to 3f6fdcec-f65c-479b-a6bb-566f36dc1526. {{(pid=86891) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 03 01:18:18 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Creating volume glance metadata for volume 3f6fdcec-f65c-479b-a6bb-566f36dc1526 backed by image 7c007b72-4636-4c6f-95ea-83453222cee3 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '7c007b72-4636-4c6f-95ea-83453222cee3', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '44e53b015dc1936b4517404861f6cba3', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86891) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 03 01:18:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (014fcee2-5b0b-44e4-a4eb-47716fb43c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f6fdcec-f65c-479b-a6bb-566f36dc1526', 'volume_size': 1, 'image_id': '7c007b72-4636-4c6f-95ea-83453222cee3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7c007b72-4636-4c6f-95ea-83453222cee3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '44e53b015dc1936b4517404861f6cba3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '82dbef87ba054ddd9a9ecd69cecab124', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '05512864c8453614ddb25c83ef4f87aef0ca084a740853a2ef0ab6860c0d73dfc8788309d4b698c39c0ac868ce1c92f0e600bbfdf8599d918e3a8e231ccb50d0', 'id': '7c007b72-4636-4c6f-95ea-83453222cee3', 'created_at': datetime.datetime(2026, 7, 2, 23, 18, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 23, 18, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7c007b72-4636-4c6f-95ea-83453222cee3/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7c5b35220d10>}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:18:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1494012d-6af8-4179-af13-bdd835aa8932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:18:18 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Volume volume-3f6fdcec-f65c-479b-a6bb-566f36dc1526 (3f6fdcec-f65c-479b-a6bb-566f36dc1526): created successfully
Jul 03 01:18:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1494012d-6af8-4179-af13-bdd835aa8932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:18:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Flow 'volume_create_manager' (12879ad8-b13d-468e-878f-7d3dddec3c33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:18:18 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-e945270e-6861-4d12-a2e8-b48bcb669fc7 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Created volume successfully.
Jul 03 01:18:18 devstack sudo[100390]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-582f5190-adbc-435c-9baf-fa447d16f781 tempest-VolumesListTestJSON-57852208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.721s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:18 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-582f5190-adbc-435c-9baf-fa447d16f781 tempest-VolumesListTestJSON-57852208 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:18:18 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-582f5190-adbc-435c-9baf-fa447d16f781 tempest-VolumesListTestJSON-57852208 None] Deleted volume successfully.
Jul 03 01:18:18 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-582f5190-adbc-435c-9baf-fa447d16f781 tempest-VolumesListTestJSON-57852208 None] Lock "cinder-0625fbaa-33c0-472a-8aba-526998b79f43-delete_volume" released by "delete_volume" :: held 2.706s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:18:19 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d8a6dff2-05cc-4560-8339-bac148addcf2 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Acquiring lock "cinder-3f6fdcec-f65c-479b-a6bb-566f36dc1526-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:18:19 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d8a6dff2-05cc-4560-8339-bac148addcf2 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Lock "cinder-3f6fdcec-f65c-479b-a6bb-566f36dc1526-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:18:19 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d8a6dff2-05cc-4560-8339-bac148addcf2 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Acquiring lock "cinder-quobyte-3f6fdcec-f65c-479b-a6bb-566f36dc1526" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:18:19 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d8a6dff2-05cc-4560-8339-bac148addcf2 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Lock "cinder-quobyte-3f6fdcec-f65c-479b-a6bb-566f36dc1526" acquired by "delete_volume" :: waited 0.016s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:18:19 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[a062943c-481d-486e-a7eb-c9a74948178e]: (4, 'raw') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:18:19 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d8a6dff2-05cc-4560-8339-bac148addcf2 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3f6fdcec-f65c-479b-a6bb-566f36dc1526 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:19 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b1f7247-47ae-4638-9589-437b54a8ad52 tempest-VolumesSnapshotListTestJSON-20190602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:18:19 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3b1f7247-47ae-4638-9589-437b54a8ad52 tempest-VolumesSnapshotListTestJSON-20190602 None] Flow 'volume_create_manager' (08316117-424b-46d2-8612-74dec0d6bafd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:18:19 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3b1f7247-47ae-4638-9589-437b54a8ad52 tempest-VolumesSnapshotListTestJSON-20190602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb9c8edd-8026-4578-8dcb-83bd3599df87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:18:19 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3b1f7247-47ae-4638-9589-437b54a8ad52 tempest-VolumesSnapshotListTestJSON-20190602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb9c8edd-8026-4578-8dcb-83bd3599df87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:18:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-694369314',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b81f63ec-41cd-4e5b-8f7a-a481f718b424,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa3a2b62bd684e33a591a48c373e0b38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:18:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:18:20Z,use_quota=True,user_id='7e916d0893ea4b81bff18bb761fa96eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:18:19 devstack sudo[100399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3f6fdcec-f65c-479b-a6bb-566f36dc1526
Jul 03 01:18:19 devstack sudo[100399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:19 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3b1f7247-47ae-4638-9589-437b54a8ad52 tempest-VolumesSnapshotListTestJSON-20190602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3218ff1-cff5-4c7d-9dd6-db2300572020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:18:19 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3b1f7247-47ae-4638-9589-437b54a8ad52 tempest-VolumesSnapshotListTestJSON-20190602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3218ff1-cff5-4c7d-9dd6-db2300572020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:18:19 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3b1f7247-47ae-4638-9589-437b54a8ad52 tempest-VolumesSnapshotListTestJSON-20190602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef6a97ef-b489-4c66-a5b5-1be3618469c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:18:19 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3b1f7247-47ae-4638-9589-437b54a8ad52 tempest-VolumesSnapshotListTestJSON-20190602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef6a97ef-b489-4c66-a5b5-1be3618469c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b81f63ec-41cd-4e5b-8f7a-a481f718b424', 'volume_name': 'volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:18:19 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3b1f7247-47ae-4638-9589-437b54a8ad52 tempest-VolumesSnapshotListTestJSON-20190602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f939c79b-65ec-4fab-97f5-3f9e65364098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:18:19 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3b1f7247-47ae-4638-9589-437b54a8ad52 tempest-VolumesSnapshotListTestJSON-20190602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f939c79b-65ec-4fab-97f5-3f9e65364098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:18:19 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3b1f7247-47ae-4638-9589-437b54a8ad52 tempest-VolumesSnapshotListTestJSON-20190602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4680660e-fe28-4d1c-a923-ffd95a77de78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:18:19 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-3b1f7247-47ae-4638-9589-437b54a8ad52 tempest-VolumesSnapshotListTestJSON-20190602 None] Volume b81f63ec-41cd-4e5b-8f7a-a481f718b424: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424', 'volume_size': 1}
Jul 03 01:18:19 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-3b1f7247-47ae-4638-9589-437b54a8ad52 tempest-VolumesSnapshotListTestJSON-20190602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:18:19 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-3b1f7247-47ae-4638-9589-437b54a8ad52 tempest-VolumesSnapshotListTestJSON-20190602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:18:19 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-3b1f7247-47ae-4638-9589-437b54a8ad52 tempest-VolumesSnapshotListTestJSON-20190602 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:18:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-694369314',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b81f63ec-41cd-4e5b-8f7a-a481f718b424,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa3a2b62bd684e33a591a48c373e0b38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:18:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:18:20Z,use_quota=True,user_id='7e916d0893ea4b81bff18bb761fa96eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:18:19 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-3b1f7247-47ae-4638-9589-437b54a8ad52 tempest-VolumesSnapshotListTestJSON-20190602 None] Creating volume b81f63ec-41cd-4e5b-8f7a-a481f718b424 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:18:19 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-3b1f7247-47ae-4638-9589-437b54a8ad52 tempest-VolumesSnapshotListTestJSON-20190602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:18:19 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-3b1f7247-47ae-4638-9589-437b54a8ad52 tempest-VolumesSnapshotListTestJSON-20190602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:18:19 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-3b1f7247-47ae-4638-9589-437b54a8ad52 tempest-VolumesSnapshotListTestJSON-20190602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:18:19 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-3b1f7247-47ae-4638-9589-437b54a8ad52 tempest-VolumesSnapshotListTestJSON-20190602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:18:19 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-3b1f7247-47ae-4638-9589-437b54a8ad52 tempest-VolumesSnapshotListTestJSON-20190602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:18:19 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-3b1f7247-47ae-4638-9589-437b54a8ad52 tempest-VolumesSnapshotListTestJSON-20190602 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:18:19 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-3b1f7247-47ae-4638-9589-437b54a8ad52 tempest-VolumesSnapshotListTestJSON-20190602 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:18:19 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-3b1f7247-47ae-4638-9589-437b54a8ad52 tempest-VolumesSnapshotListTestJSON-20190602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:19 devstack sudo[100401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424 1073741824
Jul 03 01:18:19 devstack sudo[100401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:20 devstack sudo[100399]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d8a6dff2-05cc-4560-8339-bac148addcf2 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3f6fdcec-f65c-479b-a6bb-566f36dc1526" returned: 0 in 0.824s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d8a6dff2-05cc-4560-8339-bac148addcf2 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3f6fdcec-f65c-479b-a6bb-566f36dc1526 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:20 devstack sudo[100410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3f6fdcec-f65c-479b-a6bb-566f36dc1526
Jul 03 01:18:20 devstack sudo[100410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:20 devstack sudo[100401]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-3b1f7247-47ae-4638-9589-437b54a8ad52 tempest-VolumesSnapshotListTestJSON-20190602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424 1073741824" returned: 0 in 0.876s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-3b1f7247-47ae-4638-9589-437b54a8ad52 tempest-VolumesSnapshotListTestJSON-20190602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:20 devstack sudo[100413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424
Jul 03 01:18:20 devstack sudo[100413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:21 devstack sudo[100410]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d8a6dff2-05cc-4560-8339-bac148addcf2 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3f6fdcec-f65c-479b-a6bb-566f36dc1526" returned: 1 in 0.827s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d8a6dff2-05cc-4560-8339-bac148addcf2 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3f6fdcec-f65c-479b-a6bb-566f36dc1526' failed. Not Retrying. {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 01:18:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d8a6dff2-05cc-4560-8339-bac148addcf2 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3f6fdcec-f65c-479b-a6bb-566f36dc1526 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:21 devstack sudo[100419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3f6fdcec-f65c-479b-a6bb-566f36dc1526
Jul 03 01:18:21 devstack sudo[100419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:21 devstack sudo[100413]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-3b1f7247-47ae-4638-9589-437b54a8ad52 tempest-VolumesSnapshotListTestJSON-20190602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424" returned: 0 in 0.639s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:21 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-3b1f7247-47ae-4638-9589-437b54a8ad52 tempest-VolumesSnapshotListTestJSON-20190602 None] <== create_volume: return (1557ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:18:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-3b1f7247-47ae-4638-9589-437b54a8ad52 tempest-VolumesSnapshotListTestJSON-20190602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.559s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:18:21 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3b1f7247-47ae-4638-9589-437b54a8ad52 tempest-VolumesSnapshotListTestJSON-20190602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4680660e-fe28-4d1c-a923-ffd95a77de78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:18:21 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3b1f7247-47ae-4638-9589-437b54a8ad52 tempest-VolumesSnapshotListTestJSON-20190602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92d02294-5b0b-4772-b0b6-e547c288fe23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:18:21 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-3b1f7247-47ae-4638-9589-437b54a8ad52 tempest-VolumesSnapshotListTestJSON-20190602 None] Volume volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424 (b81f63ec-41cd-4e5b-8f7a-a481f718b424): created successfully
Jul 03 01:18:21 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3b1f7247-47ae-4638-9589-437b54a8ad52 tempest-VolumesSnapshotListTestJSON-20190602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92d02294-5b0b-4772-b0b6-e547c288fe23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:18:21 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-3b1f7247-47ae-4638-9589-437b54a8ad52 tempest-VolumesSnapshotListTestJSON-20190602 None] Flow 'volume_create_manager' (08316117-424b-46d2-8612-74dec0d6bafd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:18:21 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-3b1f7247-47ae-4638-9589-437b54a8ad52 tempest-VolumesSnapshotListTestJSON-20190602 None] Created volume successfully.
Jul 03 01:18:21 devstack sudo[100419]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d8a6dff2-05cc-4560-8339-bac148addcf2 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3f6fdcec-f65c-479b-a6bb-566f36dc1526" returned: 0 in 0.710s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:21 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d8a6dff2-05cc-4560-8339-bac148addcf2 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Lock "cinder-quobyte-3f6fdcec-f65c-479b-a6bb-566f36dc1526" released by "delete_volume" :: held 2.437s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:18:22 devstack cinder-volume[86891]: WARNING cinder.quota [None req-d8a6dff2-05cc-4560-8339-bac148addcf2 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Jul 03 01:18:22 devstack cinder-volume[86891]: WARNING cinder.quota [None req-d8a6dff2-05cc-4560-8339-bac148addcf2 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Jul 03 01:18:22 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-d8a6dff2-05cc-4560-8339-bac148addcf2 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Created reservations ['71efe63f-6134-4fe7-8d39-554bd0e8111d', '9165e343-0738-43ef-96a8-de33a4769e0e', '08b0b41b-abc4-4d8a-a87a-b5e09c23e905', 'c61010aa-3730-4db9-89c8-0a9e8ca6d174'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:18:22 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a6c795b8-901a-4356-94bb-9f93c1bd5b17 tempest-VolumesSnapshotListTestJSON-20190602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:18:22 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a6c795b8-901a-4356-94bb-9f93c1bd5b17 tempest-VolumesSnapshotListTestJSON-20190602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:18:22 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-a6c795b8-901a-4356-94bb-9f93c1bd5b17 tempest-VolumesSnapshotListTestJSON-20190602 None] Creating offline snapshot a48852ec-1ce0-470a-9d4e-40edb1894baf of volume b81f63ec-41cd-4e5b-8f7a-a481f718b424 {{(pid=86891) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 01:18:22 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[091afbd4-f49c-433b-8ba4-a826f13df7f9]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:18:22 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a6c795b8-901a-4356-94bb-9f93c1bd5b17 tempest-VolumesSnapshotListTestJSON-20190602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:22 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-d8a6dff2-05cc-4560-8339-bac148addcf2 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:18:22 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-d8a6dff2-05cc-4560-8339-bac148addcf2 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:18:22 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-d8a6dff2-05cc-4560-8339-bac148addcf2 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:18:22 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-d8a6dff2-05cc-4560-8339-bac148addcf2 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:18:22 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-d8a6dff2-05cc-4560-8339-bac148addcf2 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:18:22 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d8a6dff2-05cc-4560-8339-bac148addcf2 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:22 devstack sudo[100423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:18:22 devstack sudo[100423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:22 devstack sudo[100422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424
Jul 03 01:18:22 devstack sudo[100422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:22 devstack sudo[100423]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:22 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d8a6dff2-05cc-4560-8339-bac148addcf2 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.699s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:22 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-d8a6dff2-05cc-4560-8339-bac148addcf2 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:18:22 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-d8a6dff2-05cc-4560-8339-bac148addcf2 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Deleted volume successfully.
Jul 03 01:18:22 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d8a6dff2-05cc-4560-8339-bac148addcf2 tempest-VolumeAndVolumeTypeFromImageTest-83267495 None] Lock "cinder-3f6fdcec-f65c-479b-a6bb-566f36dc1526-delete_volume" released by "delete_volume" :: held 3.441s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:18:22 devstack sudo[100422]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:22 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a6c795b8-901a-4356-94bb-9f93c1bd5b17 tempest-VolumesSnapshotListTestJSON-20190602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424" returned: 0 in 0.802s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:22 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a6c795b8-901a-4356-94bb-9f93c1bd5b17 tempest-VolumesSnapshotListTestJSON-20190602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.a48852ec-1ce0-470a-9d4e-40edb1894baf 1G {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:22 devstack sudo[100430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.a48852ec-1ce0-470a-9d4e-40edb1894baf 1G
Jul 03 01:18:22 devstack sudo[100430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:23 devstack sudo[100430]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a6c795b8-901a-4356-94bb-9f93c1bd5b17 tempest-VolumesSnapshotListTestJSON-20190602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.a48852ec-1ce0-470a-9d4e-40edb1894baf 1G" returned: 0 in 0.953s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a6c795b8-901a-4356-94bb-9f93c1bd5b17 tempest-VolumesSnapshotListTestJSON-20190602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.a48852ec-1ce0-470a-9d4e-40edb1894baf {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:23 devstack sudo[100436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.a48852ec-1ce0-470a-9d4e-40edb1894baf
Jul 03 01:18:23 devstack sudo[100436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:24 devstack sudo[100436]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a6c795b8-901a-4356-94bb-9f93c1bd5b17 tempest-VolumesSnapshotListTestJSON-20190602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.a48852ec-1ce0-470a-9d4e-40edb1894baf" returned: 0 in 0.818s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:24 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-a6c795b8-901a-4356-94bb-9f93c1bd5b17 tempest-VolumesSnapshotListTestJSON-20190602 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.a48852ec-1ce0-470a-9d4e-40edb1894baf is being set with open permissions: ugo+rw
Jul 03 01:18:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a6c795b8-901a-4356-94bb-9f93c1bd5b17 tempest-VolumesSnapshotListTestJSON-20190602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.a48852ec-1ce0-470a-9d4e-40edb1894baf {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:24 devstack sudo[100441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.a48852ec-1ce0-470a-9d4e-40edb1894baf
Jul 03 01:18:24 devstack sudo[100441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:25 devstack sudo[100441]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a6c795b8-901a-4356-94bb-9f93c1bd5b17 tempest-VolumesSnapshotListTestJSON-20190602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.a48852ec-1ce0-470a-9d4e-40edb1894baf" returned: 0 in 0.726s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a6c795b8-901a-4356-94bb-9f93c1bd5b17 tempest-VolumesSnapshotListTestJSON-20190602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:25 devstack sudo[100444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.info
Jul 03 01:18:25 devstack sudo[100444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:26 devstack sudo[100444]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:26 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a6c795b8-901a-4356-94bb-9f93c1bd5b17 tempest-VolumesSnapshotListTestJSON-20190602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.info" returned: 0 in 0.921s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:26 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-a6c795b8-901a-4356-94bb-9f93c1bd5b17 tempest-VolumesSnapshotListTestJSON-20190602 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.info is being set with open permissions: ugo+rw
Jul 03 01:18:26 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a6c795b8-901a-4356-94bb-9f93c1bd5b17 tempest-VolumesSnapshotListTestJSON-20190602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:26 devstack sudo[100447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.info
Jul 03 01:18:26 devstack sudo[100447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:27 devstack sudo[100447]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a6c795b8-901a-4356-94bb-9f93c1bd5b17 tempest-VolumesSnapshotListTestJSON-20190602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.info" returned: 0 in 0.677s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a6c795b8-901a-4356-94bb-9f93c1bd5b17 tempest-VolumesSnapshotListTestJSON-20190602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.003s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:18:27 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-a6c795b8-901a-4356-94bb-9f93c1bd5b17 tempest-VolumesSnapshotListTestJSON-20190602 None] Create snapshot completed successfully
Jul 03 01:18:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-bbd2760a-0309-41f4-96cd-594a401c77d4 tempest-VolumesSnapshotListTestJSON-20190602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:18:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-bbd2760a-0309-41f4-96cd-594a401c77d4 tempest-VolumesSnapshotListTestJSON-20190602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:18:27 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-bbd2760a-0309-41f4-96cd-594a401c77d4 tempest-VolumesSnapshotListTestJSON-20190602 None] Creating offline snapshot 0a8698f3-68ff-4f12-b818-7d0e374a8377 of volume b81f63ec-41cd-4e5b-8f7a-a481f718b424 {{(pid=86891) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 01:18:27 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0ca53f-4f71-4a5d-999e-40a4a399d180]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:18:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bbd2760a-0309-41f4-96cd-594a401c77d4 tempest-VolumesSnapshotListTestJSON-20190602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.a48852ec-1ce0-470a-9d4e-40edb1894baf {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:27 devstack sudo[100450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.a48852ec-1ce0-470a-9d4e-40edb1894baf
Jul 03 01:18:27 devstack sudo[100450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:28 devstack sudo[100450]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:28 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bbd2760a-0309-41f4-96cd-594a401c77d4 tempest-VolumesSnapshotListTestJSON-20190602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.a48852ec-1ce0-470a-9d4e-40edb1894baf" returned: 0 in 0.974s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:28 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-bbd2760a-0309-41f4-96cd-594a401c77d4 tempest-VolumesSnapshotListTestJSON-20190602 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:18:28 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bbd2760a-0309-41f4-96cd-594a401c77d4 tempest-VolumesSnapshotListTestJSON-20190602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.a48852ec-1ce0-470a-9d4e-40edb1894baf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.0a8698f3-68ff-4f12-b818-7d0e374a8377 1G {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:28 devstack sudo[100470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.a48852ec-1ce0-470a-9d4e-40edb1894baf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.0a8698f3-68ff-4f12-b818-7d0e374a8377 1G
Jul 03 01:18:28 devstack sudo[100470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:29 devstack sudo[100470]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bbd2760a-0309-41f4-96cd-594a401c77d4 tempest-VolumesSnapshotListTestJSON-20190602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.a48852ec-1ce0-470a-9d4e-40edb1894baf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.0a8698f3-68ff-4f12-b818-7d0e374a8377 1G" returned: 0 in 1.114s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bbd2760a-0309-41f4-96cd-594a401c77d4 tempest-VolumesSnapshotListTestJSON-20190602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.a48852ec-1ce0-470a-9d4e-40edb1894baf -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.0a8698f3-68ff-4f12-b818-7d0e374a8377 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:29 devstack sudo[100498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.a48852ec-1ce0-470a-9d4e-40edb1894baf -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.0a8698f3-68ff-4f12-b818-7d0e374a8377
Jul 03 01:18:29 devstack sudo[100498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:30 devstack sudo[100498]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bbd2760a-0309-41f4-96cd-594a401c77d4 tempest-VolumesSnapshotListTestJSON-20190602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.a48852ec-1ce0-470a-9d4e-40edb1894baf -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.0a8698f3-68ff-4f12-b818-7d0e374a8377" returned: 0 in 0.756s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:30 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-bbd2760a-0309-41f4-96cd-594a401c77d4 tempest-VolumesSnapshotListTestJSON-20190602 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.0a8698f3-68ff-4f12-b818-7d0e374a8377 is being set with open permissions: ugo+rw
Jul 03 01:18:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bbd2760a-0309-41f4-96cd-594a401c77d4 tempest-VolumesSnapshotListTestJSON-20190602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.0a8698f3-68ff-4f12-b818-7d0e374a8377 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:30 devstack sudo[100504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.0a8698f3-68ff-4f12-b818-7d0e374a8377
Jul 03 01:18:30 devstack sudo[100504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:31 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:18:31 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] Flow 'volume_create_manager' (a171a855-f9bc-4506-acaf-0dea4080e042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:18:31 devstack sudo[100504]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:31 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00b7f8ac-c584-4be5-add1-3d49a42074ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:18:31 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bbd2760a-0309-41f4-96cd-594a401c77d4 tempest-VolumesSnapshotListTestJSON-20190602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.0a8698f3-68ff-4f12-b818-7d0e374a8377" returned: 0 in 0.885s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:31 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00b7f8ac-c584-4be5-add1-3d49a42074ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:18:31Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18db9913-5903-40ef-9c3c-06a651b9f8d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e73fe279ce234a038b5b39c2d27b06ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:18:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:18:31Z,use_quota=True,user_id='eb71d818813040ac9642b7192b259b29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:18:31 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b59f1553-6a7f-4ceb-be7f-dc92128cc282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:18:31 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b59f1553-6a7f-4ceb-be7f-dc92128cc282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:18:31 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e004734-b83a-498d-b6de-50fc02bf7919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:18:31 devstack cinder-volume[86891]: DEBUG cinder.image.glance [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] Creating Keystone auth plugin from conf {{(pid=86891) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 03 01:18:31 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-bbd2760a-0309-41f4-96cd-594a401c77d4 tempest-VolumesSnapshotListTestJSON-20190602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.896s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:18:31 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-bbd2760a-0309-41f4-96cd-594a401c77d4 tempest-VolumesSnapshotListTestJSON-20190602 None] Create snapshot completed successfully
Jul 03 01:18:31 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e004734-b83a-498d-b6de-50fc02bf7919) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '18db9913-5903-40ef-9c3c-06a651b9f8d4', 'volume_name': 'volume-18db9913-5903-40ef-9c3c-06a651b9f8d4', 'volume_size': 1, 'image_id': '8dba4c5d-4777-4d39-91f4-24780f99faad', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8dba4c5d-4777-4d39-91f4-24780f99faad', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5202671eadef9b49c2280798db481d75', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e73fe279ce234a038b5b39c2d27b06ec', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8186ec870a70972bb2b3bc292f30ae8edb0f884c4e874bf30b30d89bda74730c0d60b01949a35195ec5b07b578efecbb5f53a5d3e2b42e498be16cb278e014d8', 'id': '8dba4c5d-4777-4d39-91f4-24780f99faad', 'created_at': datetime.datetime(2026, 7, 2, 23, 18, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 23, 18, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8dba4c5d-4777-4d39-91f4-24780f99faad/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7c5b353df980>}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:18:31 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ab6dc52-9e52-4897-a833-b4b3bc944875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:18:31 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ab6dc52-9e52-4897-a833-b4b3bc944875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:18:31 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (110f5e04-c527-4ed3-a48c-fa730d547676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:18:31 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] Volume 18db9913-5903-40ef-9c3c-06a651b9f8d4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-18db9913-5903-40ef-9c3c-06a651b9f8d4', 'volume_size': 1, 'image_id': '8dba4c5d-4777-4d39-91f4-24780f99faad', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8dba4c5d-4777-4d39-91f4-24780f99faad', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5202671eadef9b49c2280798db481d75', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e73fe279ce234a038b5b39c2d27b06ec', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8186ec870a70972bb2b3bc292f30ae8edb0f884c4e874bf30b30d89bda74730c0d60b01949a35195ec5b07b578efecbb5f53a5d3e2b42e498be16cb278e014d8', 'id': '8dba4c5d-4777-4d39-91f4-24780f99faad', 'created_at': datetime.datetime(2026, 7, 2, 23, 18, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 23, 18, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8dba4c5d-4777-4d39-91f4-24780f99faad/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7c5b353df980>}
Jul 03 01:18:31 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] Trying to clone 18db9913-5903-40ef-9c3c-06a651b9f8d4 from image 8dba4c5d-4777-4d39-91f4-24780f99faad at location (None, [{'url': 'file:///opt/stack/data/glance/images/8dba4c5d-4777-4d39-91f4-24780f99faad', 'metadata': {}}]). {{(pid=86891) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 03 01:18:31 devstack cinder-volume[86891]: DEBUG cinder.image.image_utils [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8dba4c5d-4777-4d39-91f4-24780f99faad_uvooo0indevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86891) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 03 01:18:31 devstack cinder-volume[86891]: INFO cinder.image.image_utils [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] Image download 0.00 MB at 0.00 MB/s
Jul 03 01:18:32 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[e91b1619-7a45-4928-a902-425adf3afe5b]: (4, 'raw') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:18:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8dba4c5d-4777-4d39-91f4-24780f99faad_uvooo0indevstack@QuobyteHD {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f8069a4f-b40b-45fb-ac30-c188c327bb56 tempest-VolumesSnapshotListTestJSON-20190602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:18:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f8069a4f-b40b-45fb-ac30-c188c327bb56 tempest-VolumesSnapshotListTestJSON-20190602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:18:32 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-f8069a4f-b40b-45fb-ac30-c188c327bb56 tempest-VolumesSnapshotListTestJSON-20190602 None] Creating offline snapshot 8c5c4b8e-67f7-49cb-8237-72c30f7ab2de of volume b81f63ec-41cd-4e5b-8f7a-a481f718b424 {{(pid=86891) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 01:18:32 devstack sudo[100507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8dba4c5d-4777-4d39-91f4-24780f99faad_uvooo0indevstack@QuobyteHD
Jul 03 01:18:32 devstack sudo[100507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:32 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[322e5c9d-a0f8-42a7-9f57-ac80193ff285]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:18:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f8069a4f-b40b-45fb-ac30-c188c327bb56 tempest-VolumesSnapshotListTestJSON-20190602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.0a8698f3-68ff-4f12-b818-7d0e374a8377 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:32 devstack sudo[100509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.0a8698f3-68ff-4f12-b818-7d0e374a8377
Jul 03 01:18:32 devstack sudo[100509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:32 devstack sudo[100507]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8dba4c5d-4777-4d39-91f4-24780f99faad_uvooo0indevstack@QuobyteHD" returned: 0 in 0.836s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8dba4c5d-4777-4d39-91f4-24780f99faad_uvooo0indevstack@QuobyteHD {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:32 devstack sudo[100513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8dba4c5d-4777-4d39-91f4-24780f99faad_uvooo0indevstack@QuobyteHD
Jul 03 01:18:32 devstack sudo[100513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:33 devstack sudo[100509]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f8069a4f-b40b-45fb-ac30-c188c327bb56 tempest-VolumesSnapshotListTestJSON-20190602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.0a8698f3-68ff-4f12-b818-7d0e374a8377" returned: 0 in 0.842s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:33 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-f8069a4f-b40b-45fb-ac30-c188c327bb56 tempest-VolumesSnapshotListTestJSON-20190602 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:18:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f8069a4f-b40b-45fb-ac30-c188c327bb56 tempest-VolumesSnapshotListTestJSON-20190602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.0a8698f3-68ff-4f12-b818-7d0e374a8377,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.8c5c4b8e-67f7-49cb-8237-72c30f7ab2de 1G {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:33 devstack sudo[100518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.0a8698f3-68ff-4f12-b818-7d0e374a8377,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.8c5c4b8e-67f7-49cb-8237-72c30f7ab2de 1G
Jul 03 01:18:33 devstack sudo[100518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:33 devstack sudo[100513]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8dba4c5d-4777-4d39-91f4-24780f99faad_uvooo0indevstack@QuobyteHD" returned: 1 in 0.797s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8dba4c5d-4777-4d39-91f4-24780f99faad_uvooo0indevstack@QuobyteHD' failed. Not Retrying. {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 01:18:33 devstack cinder-volume[86891]: DEBUG cinder.image.image_utils [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] Temporary image 8dba4c5d-4777-4d39-91f4-24780f99faad is fetched for user eb71d818813040ac9642b7192b259b29. {{(pid=86891) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 03 01:18:33 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ca0fca-2449-4b64-81f3-c93c1c79a0b9]: (4, 'raw') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:18:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8dba4c5d-4777-4d39-91f4-24780f99faad_uvooo0indevstack@QuobyteHD {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:33 devstack sudo[100527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8dba4c5d-4777-4d39-91f4-24780f99faad_uvooo0indevstack@QuobyteHD
Jul 03 01:18:33 devstack sudo[100527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:34 devstack sudo[100518]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f8069a4f-b40b-45fb-ac30-c188c327bb56 tempest-VolumesSnapshotListTestJSON-20190602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.0a8698f3-68ff-4f12-b818-7d0e374a8377,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.8c5c4b8e-67f7-49cb-8237-72c30f7ab2de 1G" returned: 0 in 0.989s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f8069a4f-b40b-45fb-ac30-c188c327bb56 tempest-VolumesSnapshotListTestJSON-20190602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.0a8698f3-68ff-4f12-b818-7d0e374a8377 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.8c5c4b8e-67f7-49cb-8237-72c30f7ab2de {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:34 devstack sudo[100529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.0a8698f3-68ff-4f12-b818-7d0e374a8377 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.8c5c4b8e-67f7-49cb-8237-72c30f7ab2de
Jul 03 01:18:34 devstack sudo[100529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:34 devstack sudo[100527]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8dba4c5d-4777-4d39-91f4-24780f99faad_uvooo0indevstack@QuobyteHD" returned: 0 in 0.803s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8dba4c5d-4777-4d39-91f4-24780f99faad_uvooo0indevstack@QuobyteHD {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:34 devstack sudo[100533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8dba4c5d-4777-4d39-91f4-24780f99faad_uvooo0indevstack@QuobyteHD
Jul 03 01:18:34 devstack sudo[100533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:34 devstack sudo[100529]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f8069a4f-b40b-45fb-ac30-c188c327bb56 tempest-VolumesSnapshotListTestJSON-20190602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.0a8698f3-68ff-4f12-b818-7d0e374a8377 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.8c5c4b8e-67f7-49cb-8237-72c30f7ab2de" returned: 0 in 0.757s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:34 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-f8069a4f-b40b-45fb-ac30-c188c327bb56 tempest-VolumesSnapshotListTestJSON-20190602 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.8c5c4b8e-67f7-49cb-8237-72c30f7ab2de is being set with open permissions: ugo+rw
Jul 03 01:18:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f8069a4f-b40b-45fb-ac30-c188c327bb56 tempest-VolumesSnapshotListTestJSON-20190602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.8c5c4b8e-67f7-49cb-8237-72c30f7ab2de {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:34 devstack sudo[100538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.8c5c4b8e-67f7-49cb-8237-72c30f7ab2de
Jul 03 01:18:34 devstack sudo[100538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:35 devstack sudo[100533]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8dba4c5d-4777-4d39-91f4-24780f99faad_uvooo0indevstack@QuobyteHD" returned: 1 in 0.821s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8dba4c5d-4777-4d39-91f4-24780f99faad_uvooo0indevstack@QuobyteHD' failed. Not Retrying. {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 01:18:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:18:35 devstack sudo[100538]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f8069a4f-b40b-45fb-ac30-c188c327bb56 tempest-VolumesSnapshotListTestJSON-20190602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.8c5c4b8e-67f7-49cb-8237-72c30f7ab2de" returned: 0 in 0.777s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f8069a4f-b40b-45fb-ac30-c188c327bb56 tempest-VolumesSnapshotListTestJSON-20190602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.476s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:18:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.255s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:18:35 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:18:31Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18db9913-5903-40ef-9c3c-06a651b9f8d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e73fe279ce234a038b5b39c2d27b06ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:18:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:18:31Z,use_quota=True,user_id='eb71d818813040ac9642b7192b259b29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:18:35 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] Creating volume 18db9913-5903-40ef-9c3c-06a651b9f8d4 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:18:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:18:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:18:35 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:18:35 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:18:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:18:35 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:18:35 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:18:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-18db9913-5903-40ef-9c3c-06a651b9f8d4 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:35 devstack sudo[100544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-18db9913-5903-40ef-9c3c-06a651b9f8d4 1073741824
Jul 03 01:18:35 devstack sudo[100544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:35 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-f8069a4f-b40b-45fb-ac30-c188c327bb56 tempest-VolumesSnapshotListTestJSON-20190602 None] Create snapshot completed successfully
Jul 03 01:18:36 devstack sudo[100544]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-18db9913-5903-40ef-9c3c-06a651b9f8d4 1073741824" returned: 0 in 0.985s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-18db9913-5903-40ef-9c3c-06a651b9f8d4 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:36 devstack sudo[100550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-18db9913-5903-40ef-9c3c-06a651b9f8d4
Jul 03 01:18:36 devstack sudo[100550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:37 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-6f476557-f7ff-4c05-94fd-89bf0efb73e4 tempest-VolumesSnapshotListTestJSON-20190602 None] Acquiring lock "cinder-8c5c4b8e-67f7-49cb-8237-72c30f7ab2de-delete_snapshot" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:18:37 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-6f476557-f7ff-4c05-94fd-89bf0efb73e4 tempest-VolumesSnapshotListTestJSON-20190602 None] Lock "cinder-8c5c4b8e-67f7-49cb-8237-72c30f7ab2de-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:18:37 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-6f476557-f7ff-4c05-94fd-89bf0efb73e4 tempest-VolumesSnapshotListTestJSON-20190602 None] Acquiring lock "cinder-quobyte-b81f63ec-41cd-4e5b-8f7a-a481f718b424" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:18:37 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-6f476557-f7ff-4c05-94fd-89bf0efb73e4 tempest-VolumesSnapshotListTestJSON-20190602 None] Lock "cinder-quobyte-b81f63ec-41cd-4e5b-8f7a-a481f718b424" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:18:37 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-6f476557-f7ff-4c05-94fd-89bf0efb73e4 tempest-VolumesSnapshotListTestJSON-20190602 None] Acquiring lock "cinder-quobyte-8c5c4b8e-67f7-49cb-8237-72c30f7ab2de" by "_delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:18:37 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-6f476557-f7ff-4c05-94fd-89bf0efb73e4 tempest-VolumesSnapshotListTestJSON-20190602 None] Lock "cinder-quobyte-8c5c4b8e-67f7-49cb-8237-72c30f7ab2de" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:18:37 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-6f476557-f7ff-4c05-94fd-89bf0efb73e4 tempest-VolumesSnapshotListTestJSON-20190602 None] Deleting offline snapshot 8c5c4b8e-67f7-49cb-8237-72c30f7ab2de of volume b81f63ec-41cd-4e5b-8f7a-a481f718b424 {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 01:18:37 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-6f476557-f7ff-4c05-94fd-89bf0efb73e4 tempest-VolumesSnapshotListTestJSON-20190602 None] snapshot_file for this snap is: volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.8c5c4b8e-67f7-49cb-8237-72c30f7ab2de {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 01:18:37 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7f414a-0836-4f73-b5dd-7534eaece7f0]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:18:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6f476557-f7ff-4c05-94fd-89bf0efb73e4 tempest-VolumesSnapshotListTestJSON-20190602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.8c5c4b8e-67f7-49cb-8237-72c30f7ab2de {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:37 devstack sudo[100550]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-18db9913-5903-40ef-9c3c-06a651b9f8d4" returned: 0 in 0.767s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:37 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] <== create_volume: return (1806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:18:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.809s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:18:37 devstack cinder-volume[86891]: DEBUG cinder.volume.volume_utils [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] Attempting download of 8dba4c5d-4777-4d39-91f4-24780f99faad ((None, [{'url': 'file:///opt/stack/data/glance/images/8dba4c5d-4777-4d39-91f4-24780f99faad', 'metadata': {}}])) to volume 18db9913-5903-40ef-9c3c-06a651b9f8d4. {{(pid=86891) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 03 01:18:37 devstack sudo[100553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.8c5c4b8e-67f7-49cb-8237-72c30f7ab2de
Jul 03 01:18:37 devstack sudo[100553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:37 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7126574-85de-4ffd-8928-09000356780f]: (4, 'raw') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:18:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8dba4c5d-4777-4d39-91f4-24780f99faad_ptnidzpz {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:37 devstack sudo[100555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8dba4c5d-4777-4d39-91f4-24780f99faad_ptnidzpz
Jul 03 01:18:37 devstack sudo[100555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:38 devstack sudo[100553]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6f476557-f7ff-4c05-94fd-89bf0efb73e4 tempest-VolumesSnapshotListTestJSON-20190602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.8c5c4b8e-67f7-49cb-8237-72c30f7ab2de" returned: 0 in 1.120s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:38 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-6f476557-f7ff-4c05-94fd-89bf0efb73e4 tempest-VolumesSnapshotListTestJSON-20190602 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:18:38 devstack sudo[100555]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8dba4c5d-4777-4d39-91f4-24780f99faad_ptnidzpz" returned: 0 in 0.788s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8dba4c5d-4777-4d39-91f4-24780f99faad_ptnidzpz {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:38 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[7227b293-162d-42ac-b863-4210e11702c5]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:18:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6f476557-f7ff-4c05-94fd-89bf0efb73e4 tempest-VolumesSnapshotListTestJSON-20190602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.0a8698f3-68ff-4f12-b818-7d0e374a8377 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:38 devstack sudo[100563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8dba4c5d-4777-4d39-91f4-24780f99faad_ptnidzpz
Jul 03 01:18:38 devstack sudo[100563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:38 devstack sudo[100564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.0a8698f3-68ff-4f12-b818-7d0e374a8377
Jul 03 01:18:38 devstack sudo[100564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:39 devstack sudo[100563]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8dba4c5d-4777-4d39-91f4-24780f99faad_ptnidzpz" returned: 1 in 0.748s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8dba4c5d-4777-4d39-91f4-24780f99faad_ptnidzpz' failed. Not Retrying. {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 01:18:39 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[d395f423-1d65-4cb9-ba95-91bcc73d4af1]: (4, 'raw') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:18:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8dba4c5d-4777-4d39-91f4-24780f99faad_uvooo0indevstack@QuobyteHD {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:39 devstack sudo[100564]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:39 devstack sudo[100572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8dba4c5d-4777-4d39-91f4-24780f99faad_uvooo0indevstack@QuobyteHD
Jul 03 01:18:39 devstack sudo[100572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6f476557-f7ff-4c05-94fd-89bf0efb73e4 tempest-VolumesSnapshotListTestJSON-20190602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.0a8698f3-68ff-4f12-b818-7d0e374a8377" returned: 0 in 0.863s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:39 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-6f476557-f7ff-4c05-94fd-89bf0efb73e4 tempest-VolumesSnapshotListTestJSON-20190602 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:18:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6f476557-f7ff-4c05-94fd-89bf0efb73e4 tempest-VolumesSnapshotListTestJSON-20190602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.8c5c4b8e-67f7-49cb-8237-72c30f7ab2de {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:39 devstack sudo[100574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.8c5c4b8e-67f7-49cb-8237-72c30f7ab2de
Jul 03 01:18:39 devstack sudo[100574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:40 devstack sudo[100572]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8dba4c5d-4777-4d39-91f4-24780f99faad_uvooo0indevstack@QuobyteHD" returned: 0 in 0.953s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8dba4c5d-4777-4d39-91f4-24780f99faad_uvooo0indevstack@QuobyteHD {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:40 devstack sudo[100574]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6f476557-f7ff-4c05-94fd-89bf0efb73e4 tempest-VolumesSnapshotListTestJSON-20190602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.8c5c4b8e-67f7-49cb-8237-72c30f7ab2de" returned: 0 in 0.892s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6f476557-f7ff-4c05-94fd-89bf0efb73e4 tempest-VolumesSnapshotListTestJSON-20190602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.8c5c4b8e-67f7-49cb-8237-72c30f7ab2de {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:40 devstack sudo[100587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.8c5c4b8e-67f7-49cb-8237-72c30f7ab2de
Jul 03 01:18:40 devstack sudo[100587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:40 devstack sudo[100584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8dba4c5d-4777-4d39-91f4-24780f99faad_uvooo0indevstack@QuobyteHD
Jul 03 01:18:40 devstack sudo[100584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:41 devstack sudo[100584]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8dba4c5d-4777-4d39-91f4-24780f99faad_uvooo0indevstack@QuobyteHD" returned: 1 in 0.857s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8dba4c5d-4777-4d39-91f4-24780f99faad_uvooo0indevstack@QuobyteHD' failed. Not Retrying. {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 01:18:41 devstack cinder-volume[86891]: DEBUG cinder.image.image_utils [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] 8dba4c5d-4777-4d39-91f4-24780f99faad was raw, converting to raw {{(pid=86891) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 03 01:18:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8dba4c5d-4777-4d39-91f4-24780f99faad_uvooo0indevstack@QuobyteHD /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-18db9913-5903-40ef-9c3c-06a651b9f8d4 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:41 devstack sudo[100587]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6f476557-f7ff-4c05-94fd-89bf0efb73e4 tempest-VolumesSnapshotListTestJSON-20190602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.8c5c4b8e-67f7-49cb-8237-72c30f7ab2de" returned: 0 in 0.812s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:41 devstack sudo[100597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8dba4c5d-4777-4d39-91f4-24780f99faad_uvooo0indevstack@QuobyteHD /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-18db9913-5903-40ef-9c3c-06a651b9f8d4
Jul 03 01:18:41 devstack sudo[100597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:41 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-6f476557-f7ff-4c05-94fd-89bf0efb73e4 tempest-VolumesSnapshotListTestJSON-20190602 None] Lock "cinder-quobyte-8c5c4b8e-67f7-49cb-8237-72c30f7ab2de" released by "_delete_snapshot" :: held 3.818s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:18:41 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-6f476557-f7ff-4c05-94fd-89bf0efb73e4 tempest-VolumesSnapshotListTestJSON-20190602 None] Lock "cinder-quobyte-b81f63ec-41cd-4e5b-8f7a-a481f718b424" released by "delete_snapshot" :: held 3.848s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:18:41 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-6f476557-f7ff-4c05-94fd-89bf0efb73e4 tempest-VolumesSnapshotListTestJSON-20190602 None] Created reservations ['c3ff9a2c-2bce-421e-9303-10a420648648', '6f758953-daba-4127-8500-fe54abf410d3', 'f4eec738-bf3b-47b7-bc49-dbc5476ad428', 'd6bc5ed7-d7e7-4452-b33d-561fcd161822'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:18:41 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-6f476557-f7ff-4c05-94fd-89bf0efb73e4 tempest-VolumesSnapshotListTestJSON-20190602 None] Delete snapshot completed successfully.
Jul 03 01:18:41 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-6f476557-f7ff-4c05-94fd-89bf0efb73e4 tempest-VolumesSnapshotListTestJSON-20190602 None] Lock "cinder-8c5c4b8e-67f7-49cb-8237-72c30f7ab2de-delete_snapshot" released by "delete_snapshot" :: held 4.018s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:18:41 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-41b34f5e-e079-4504-b6c8-6dbcc8454594 tempest-VolumesSnapshotListTestJSON-20190602 None] Acquiring lock "cinder-0a8698f3-68ff-4f12-b818-7d0e374a8377-delete_snapshot" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:18:41 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-41b34f5e-e079-4504-b6c8-6dbcc8454594 tempest-VolumesSnapshotListTestJSON-20190602 None] Lock "cinder-0a8698f3-68ff-4f12-b818-7d0e374a8377-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:18:41 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-41b34f5e-e079-4504-b6c8-6dbcc8454594 tempest-VolumesSnapshotListTestJSON-20190602 None] Acquiring lock "cinder-quobyte-b81f63ec-41cd-4e5b-8f7a-a481f718b424" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:18:41 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-41b34f5e-e079-4504-b6c8-6dbcc8454594 tempest-VolumesSnapshotListTestJSON-20190602 None] Lock "cinder-quobyte-b81f63ec-41cd-4e5b-8f7a-a481f718b424" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:18:41 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-41b34f5e-e079-4504-b6c8-6dbcc8454594 tempest-VolumesSnapshotListTestJSON-20190602 None] Acquiring lock "cinder-quobyte-0a8698f3-68ff-4f12-b818-7d0e374a8377" by "_delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:18:41 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-41b34f5e-e079-4504-b6c8-6dbcc8454594 tempest-VolumesSnapshotListTestJSON-20190602 None] Lock "cinder-quobyte-0a8698f3-68ff-4f12-b818-7d0e374a8377" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:18:41 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-41b34f5e-e079-4504-b6c8-6dbcc8454594 tempest-VolumesSnapshotListTestJSON-20190602 None] Deleting offline snapshot 0a8698f3-68ff-4f12-b818-7d0e374a8377 of volume b81f63ec-41cd-4e5b-8f7a-a481f718b424 {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 01:18:41 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-41b34f5e-e079-4504-b6c8-6dbcc8454594 tempest-VolumesSnapshotListTestJSON-20190602 None] snapshot_file for this snap is: volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.0a8698f3-68ff-4f12-b818-7d0e374a8377 {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 01:18:41 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[553ec533-6ac6-49b1-994a-ac655fa7bcc2]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:18:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-41b34f5e-e079-4504-b6c8-6dbcc8454594 tempest-VolumesSnapshotListTestJSON-20190602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.0a8698f3-68ff-4f12-b818-7d0e374a8377 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:41 devstack sudo[100601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.0a8698f3-68ff-4f12-b818-7d0e374a8377
Jul 03 01:18:41 devstack sudo[100601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:41 devstack sudo[100597]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8dba4c5d-4777-4d39-91f4-24780f99faad_uvooo0indevstack@QuobyteHD /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-18db9913-5903-40ef-9c3c-06a651b9f8d4" returned: 0 in 0.802s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:41 devstack cinder-volume[86891]: DEBUG cinder.image.image_utils [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8dba4c5d-4777-4d39-91f4-24780f99faad_uvooo0indevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-18db9913-5903-40ef-9c3c-06a651b9f8d4 {{(pid=86891) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 03 01:18:41 devstack cinder-volume[86891]: INFO cinder.image.image_utils [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] Converted 0.00 MB image at 0.00 MB/s
Jul 03 01:18:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-18db9913-5903-40ef-9c3c-06a651b9f8d4 1G {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:41 devstack sudo[100604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-18db9913-5903-40ef-9c3c-06a651b9f8d4 1G
Jul 03 01:18:41 devstack sudo[100604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:42 devstack sudo[100601]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-41b34f5e-e079-4504-b6c8-6dbcc8454594 tempest-VolumesSnapshotListTestJSON-20190602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.0a8698f3-68ff-4f12-b818-7d0e374a8377" returned: 0 in 0.996s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:42 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-41b34f5e-e079-4504-b6c8-6dbcc8454594 tempest-VolumesSnapshotListTestJSON-20190602 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:18:42 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[59125ba0-5cbd-46c3-8fbb-7cbb76ed27b3]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:18:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-41b34f5e-e079-4504-b6c8-6dbcc8454594 tempest-VolumesSnapshotListTestJSON-20190602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.a48852ec-1ce0-470a-9d4e-40edb1894baf {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:42 devstack sudo[100604]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-18db9913-5903-40ef-9c3c-06a651b9f8d4 1G" returned: 0 in 0.820s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:42 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a679fd4-b0a2-4e3d-a487-674c63674f74]: (4, 'raw') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:18:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-18db9913-5903-40ef-9c3c-06a651b9f8d4 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:42 devstack sudo[100613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.a48852ec-1ce0-470a-9d4e-40edb1894baf
Jul 03 01:18:42 devstack sudo[100613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:43 devstack sudo[100614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-18db9913-5903-40ef-9c3c-06a651b9f8d4
Jul 03 01:18:43 devstack sudo[100614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:43 devstack sudo[100613]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-41b34f5e-e079-4504-b6c8-6dbcc8454594 tempest-VolumesSnapshotListTestJSON-20190602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.a48852ec-1ce0-470a-9d4e-40edb1894baf" returned: 0 in 0.945s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:43 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-41b34f5e-e079-4504-b6c8-6dbcc8454594 tempest-VolumesSnapshotListTestJSON-20190602 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:18:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-41b34f5e-e079-4504-b6c8-6dbcc8454594 tempest-VolumesSnapshotListTestJSON-20190602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.0a8698f3-68ff-4f12-b818-7d0e374a8377 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:43 devstack sudo[100622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.0a8698f3-68ff-4f12-b818-7d0e374a8377
Jul 03 01:18:43 devstack sudo[100622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:43 devstack sudo[100614]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-18db9913-5903-40ef-9c3c-06a651b9f8d4" returned: 0 in 0.982s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-18db9913-5903-40ef-9c3c-06a651b9f8d4 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:43 devstack sudo[100624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-18db9913-5903-40ef-9c3c-06a651b9f8d4
Jul 03 01:18:43 devstack sudo[100624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:44 devstack sudo[100622]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-41b34f5e-e079-4504-b6c8-6dbcc8454594 tempest-VolumesSnapshotListTestJSON-20190602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.0a8698f3-68ff-4f12-b818-7d0e374a8377" returned: 0 in 0.869s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-41b34f5e-e079-4504-b6c8-6dbcc8454594 tempest-VolumesSnapshotListTestJSON-20190602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.0a8698f3-68ff-4f12-b818-7d0e374a8377 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:44 devstack sudo[100632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.0a8698f3-68ff-4f12-b818-7d0e374a8377
Jul 03 01:18:44 devstack sudo[100632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:44 devstack sudo[100624]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-18db9913-5903-40ef-9c3c-06a651b9f8d4" returned: 1 in 0.840s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-18db9913-5903-40ef-9c3c-06a651b9f8d4' failed. Not Retrying. {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 01:18:44 devstack cinder-volume[86891]: DEBUG cinder.volume.volume_utils [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] Downloaded image 8dba4c5d-4777-4d39-91f4-24780f99faad ((None, [{'url': 'file:///opt/stack/data/glance/images/8dba4c5d-4777-4d39-91f4-24780f99faad', 'metadata': {}}])) to volume 18db9913-5903-40ef-9c3c-06a651b9f8d4 successfully. {{(pid=86891) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 03 01:18:44 devstack cinder-volume[86891]: DEBUG cinder.image.image_utils [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] Temporary image 8dba4c5d-4777-4d39-91f4-24780f99faad for user eb71d818813040ac9642b7192b259b29 is deleted. {{(pid=86891) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 03 01:18:44 devstack cinder-volume[86891]: DEBUG cinder.volume.volume_utils [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] Marking volume 18db9913-5903-40ef-9c3c-06a651b9f8d4 as bootable. {{(pid=86891) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 03 01:18:44 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] Copying metadata from image 8dba4c5d-4777-4d39-91f4-24780f99faad to 18db9913-5903-40ef-9c3c-06a651b9f8d4. {{(pid=86891) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 03 01:18:44 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] Creating volume glance metadata for volume 18db9913-5903-40ef-9c3c-06a651b9f8d4 backed by image 8dba4c5d-4777-4d39-91f4-24780f99faad with: {'image_id': '8dba4c5d-4777-4d39-91f4-24780f99faad', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '5202671eadef9b49c2280798db481d75', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86891) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 03 01:18:44 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (110f5e04-c527-4ed3-a48c-fa730d547676) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18db9913-5903-40ef-9c3c-06a651b9f8d4', 'volume_size': 1, 'image_id': '8dba4c5d-4777-4d39-91f4-24780f99faad', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8dba4c5d-4777-4d39-91f4-24780f99faad', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5202671eadef9b49c2280798db481d75', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e73fe279ce234a038b5b39c2d27b06ec', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8186ec870a70972bb2b3bc292f30ae8edb0f884c4e874bf30b30d89bda74730c0d60b01949a35195ec5b07b578efecbb5f53a5d3e2b42e498be16cb278e014d8', 'id': '8dba4c5d-4777-4d39-91f4-24780f99faad', 'created_at': datetime.datetime(2026, 7, 2, 23, 18, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 23, 18, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8dba4c5d-4777-4d39-91f4-24780f99faad/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7c5b353df980>}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:18:44 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6af1b582-2077-4c1c-a53a-bc2834be339d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:18:44 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] Volume volume-18db9913-5903-40ef-9c3c-06a651b9f8d4 (18db9913-5903-40ef-9c3c-06a651b9f8d4): created successfully
Jul 03 01:18:44 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6af1b582-2077-4c1c-a53a-bc2834be339d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:18:44 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] Flow 'volume_create_manager' (a171a855-f9bc-4506-acaf-0dea4080e042) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:18:44 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-541ff737-7eba-4ce1-85c8-54e3f312b8c4 tempest-VolumeImageDependencyTests-658260342 None] Created volume successfully.
Jul 03 01:18:45 devstack sudo[100632]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-41b34f5e-e079-4504-b6c8-6dbcc8454594 tempest-VolumesSnapshotListTestJSON-20190602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.0a8698f3-68ff-4f12-b818-7d0e374a8377" returned: 0 in 0.668s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:45 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-41b34f5e-e079-4504-b6c8-6dbcc8454594 tempest-VolumesSnapshotListTestJSON-20190602 None] Lock "cinder-quobyte-0a8698f3-68ff-4f12-b818-7d0e374a8377" released by "_delete_snapshot" :: held 3.596s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:18:45 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-41b34f5e-e079-4504-b6c8-6dbcc8454594 tempest-VolumesSnapshotListTestJSON-20190602 None] Lock "cinder-quobyte-b81f63ec-41cd-4e5b-8f7a-a481f718b424" released by "delete_snapshot" :: held 3.622s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:18:45 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-41b34f5e-e079-4504-b6c8-6dbcc8454594 tempest-VolumesSnapshotListTestJSON-20190602 None] Created reservations ['f0142266-d2fe-49f5-99c1-67b6e7766e1c', '798d464d-a752-49b5-932f-6cbdc9ab9dfa', '2cd512d0-efa3-44b0-93a9-9b7570f49241', '1ed01671-ac6d-44b2-ab2a-479382fecdd0'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:18:45 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-41b34f5e-e079-4504-b6c8-6dbcc8454594 tempest-VolumesSnapshotListTestJSON-20190602 None] Delete snapshot completed successfully.
Jul 03 01:18:45 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-41b34f5e-e079-4504-b6c8-6dbcc8454594 tempest-VolumesSnapshotListTestJSON-20190602 None] Lock "cinder-0a8698f3-68ff-4f12-b818-7d0e374a8377-delete_snapshot" released by "delete_snapshot" :: held 3.773s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:18:45 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-f5820b16-196d-4ecc-996c-4a51d588642d tempest-VolumeImageDependencyTests-658260342 None] Acquiring lock "cinder-18db9913-5903-40ef-9c3c-06a651b9f8d4-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:18:45 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-f5820b16-196d-4ecc-996c-4a51d588642d tempest-VolumeImageDependencyTests-658260342 None] Lock "cinder-18db9913-5903-40ef-9c3c-06a651b9f8d4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:18:45 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-f5820b16-196d-4ecc-996c-4a51d588642d tempest-VolumeImageDependencyTests-658260342 None] Acquiring lock "cinder-quobyte-18db9913-5903-40ef-9c3c-06a651b9f8d4" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:18:45 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-f5820b16-196d-4ecc-996c-4a51d588642d tempest-VolumeImageDependencyTests-658260342 None] Lock "cinder-quobyte-18db9913-5903-40ef-9c3c-06a651b9f8d4" acquired by "delete_volume" :: waited 0.020s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:18:45 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb60735-271d-4115-9e28-059918f8e760]: (4, 'raw') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:18:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f5820b16-196d-4ecc-996c-4a51d588642d tempest-VolumeImageDependencyTests-658260342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-18db9913-5903-40ef-9c3c-06a651b9f8d4 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:45 devstack sudo[100635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-18db9913-5903-40ef-9c3c-06a651b9f8d4
Jul 03 01:18:45 devstack sudo[100635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:45 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e02d68bc-f0d3-412e-ada1-4b25c3ed2e7e tempest-VolumesSnapshotListTestJSON-20190602 None] Acquiring lock "cinder-a48852ec-1ce0-470a-9d4e-40edb1894baf-delete_snapshot" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:18:45 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e02d68bc-f0d3-412e-ada1-4b25c3ed2e7e tempest-VolumesSnapshotListTestJSON-20190602 None] Lock "cinder-a48852ec-1ce0-470a-9d4e-40edb1894baf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:18:45 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e02d68bc-f0d3-412e-ada1-4b25c3ed2e7e tempest-VolumesSnapshotListTestJSON-20190602 None] Acquiring lock "cinder-quobyte-b81f63ec-41cd-4e5b-8f7a-a481f718b424" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:18:45 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e02d68bc-f0d3-412e-ada1-4b25c3ed2e7e tempest-VolumesSnapshotListTestJSON-20190602 None] Lock "cinder-quobyte-b81f63ec-41cd-4e5b-8f7a-a481f718b424" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:18:45 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e02d68bc-f0d3-412e-ada1-4b25c3ed2e7e tempest-VolumesSnapshotListTestJSON-20190602 None] Acquiring lock "cinder-quobyte-a48852ec-1ce0-470a-9d4e-40edb1894baf" by "_delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:18:45 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e02d68bc-f0d3-412e-ada1-4b25c3ed2e7e tempest-VolumesSnapshotListTestJSON-20190602 None] Lock "cinder-quobyte-a48852ec-1ce0-470a-9d4e-40edb1894baf" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:18:45 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-e02d68bc-f0d3-412e-ada1-4b25c3ed2e7e tempest-VolumesSnapshotListTestJSON-20190602 None] Deleting offline snapshot a48852ec-1ce0-470a-9d4e-40edb1894baf of volume b81f63ec-41cd-4e5b-8f7a-a481f718b424 {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 01:18:45 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-e02d68bc-f0d3-412e-ada1-4b25c3ed2e7e tempest-VolumesSnapshotListTestJSON-20190602 None] snapshot_file for this snap is: volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.a48852ec-1ce0-470a-9d4e-40edb1894baf {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 01:18:45 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e45f11-8082-4331-9b8f-4e1447a23e92]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:18:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e02d68bc-f0d3-412e-ada1-4b25c3ed2e7e tempest-VolumesSnapshotListTestJSON-20190602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.a48852ec-1ce0-470a-9d4e-40edb1894baf {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:46 devstack sudo[100637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.a48852ec-1ce0-470a-9d4e-40edb1894baf
Jul 03 01:18:46 devstack sudo[100637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:46 devstack sudo[100635]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f5820b16-196d-4ecc-996c-4a51d588642d tempest-VolumeImageDependencyTests-658260342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-18db9913-5903-40ef-9c3c-06a651b9f8d4" returned: 0 in 0.784s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f5820b16-196d-4ecc-996c-4a51d588642d tempest-VolumeImageDependencyTests-658260342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-18db9913-5903-40ef-9c3c-06a651b9f8d4 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:46 devstack sudo[100641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-18db9913-5903-40ef-9c3c-06a651b9f8d4
Jul 03 01:18:46 devstack sudo[100641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:46 devstack sudo[100637]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e02d68bc-f0d3-412e-ada1-4b25c3ed2e7e tempest-VolumesSnapshotListTestJSON-20190602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.a48852ec-1ce0-470a-9d4e-40edb1894baf" returned: 0 in 0.863s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:46 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-e02d68bc-f0d3-412e-ada1-4b25c3ed2e7e tempest-VolumesSnapshotListTestJSON-20190602 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:18:46 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[6abd1260-895b-4725-86c8-fcf9d04d5865]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:18:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e02d68bc-f0d3-412e-ada1-4b25c3ed2e7e tempest-VolumesSnapshotListTestJSON-20190602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:46 devstack sudo[100646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424
Jul 03 01:18:46 devstack sudo[100646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:47 devstack sudo[100641]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f5820b16-196d-4ecc-996c-4a51d588642d tempest-VolumeImageDependencyTests-658260342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-18db9913-5903-40ef-9c3c-06a651b9f8d4" returned: 1 in 0.815s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f5820b16-196d-4ecc-996c-4a51d588642d tempest-VolumeImageDependencyTests-658260342 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-18db9913-5903-40ef-9c3c-06a651b9f8d4' failed. Not Retrying. {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 01:18:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f5820b16-196d-4ecc-996c-4a51d588642d tempest-VolumeImageDependencyTests-658260342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-18db9913-5903-40ef-9c3c-06a651b9f8d4 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:47 devstack sudo[100651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-18db9913-5903-40ef-9c3c-06a651b9f8d4
Jul 03 01:18:47 devstack sudo[100651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:47 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed7398d6-2165-4f4d-90a8-04bc85932c73 tempest-TestInstancesWithCinderVolumes-1418312596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:18:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ed7398d6-2165-4f4d-90a8-04bc85932c73 tempest-TestInstancesWithCinderVolumes-1418312596 None] Flow 'volume_create_manager' (d7704c64-38a9-4d0c-bb46-86060651a0d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:18:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ed7398d6-2165-4f4d-90a8-04bc85932c73 tempest-TestInstancesWithCinderVolumes-1418312596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d184b35-9607-4ad6-b621-00d852f910c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:18:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ed7398d6-2165-4f4d-90a8-04bc85932c73 tempest-TestInstancesWithCinderVolumes-1418312596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d184b35-9607-4ad6-b621-00d852f910c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:18:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2021183459',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47a2c419-6de4-4354-ab8e-f99046be195a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32a3143784af48dc965619024ef66ea0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:18:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:18:47Z,use_quota=True,user_id='aa5463a24a4f4c058a58c0f75b2bde1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a07f2291-43e0-49ac-887e-98cb373ce053),volume_type_id=a07f2291-43e0-49ac-887e-98cb373ce053)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:18:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ed7398d6-2165-4f4d-90a8-04bc85932c73 tempest-TestInstancesWithCinderVolumes-1418312596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (714b9444-63da-4c1e-8421-dac8e0ce260d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:18:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ed7398d6-2165-4f4d-90a8-04bc85932c73 tempest-TestInstancesWithCinderVolumes-1418312596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (714b9444-63da-4c1e-8421-dac8e0ce260d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:18:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ed7398d6-2165-4f4d-90a8-04bc85932c73 tempest-TestInstancesWithCinderVolumes-1418312596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a6a01df-fbd2-4f8d-9730-1f1da1766862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:18:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ed7398d6-2165-4f4d-90a8-04bc85932c73 tempest-TestInstancesWithCinderVolumes-1418312596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a6a01df-fbd2-4f8d-9730-1f1da1766862) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47a2c419-6de4-4354-ab8e-f99046be195a', 'volume_name': 'volume-47a2c419-6de4-4354-ab8e-f99046be195a', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:18:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ed7398d6-2165-4f4d-90a8-04bc85932c73 tempest-TestInstancesWithCinderVolumes-1418312596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca339063-5c7b-4c4d-acee-d507565f82a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:18:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ed7398d6-2165-4f4d-90a8-04bc85932c73 tempest-TestInstancesWithCinderVolumes-1418312596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca339063-5c7b-4c4d-acee-d507565f82a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:18:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ed7398d6-2165-4f4d-90a8-04bc85932c73 tempest-TestInstancesWithCinderVolumes-1418312596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e70950e-837c-4d8a-b00a-439947d01a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:18:47 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-ed7398d6-2165-4f4d-90a8-04bc85932c73 tempest-TestInstancesWithCinderVolumes-1418312596 None] Volume 47a2c419-6de4-4354-ab8e-f99046be195a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47a2c419-6de4-4354-ab8e-f99046be195a', 'volume_size': 1}
Jul 03 01:18:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-ed7398d6-2165-4f4d-90a8-04bc85932c73 tempest-TestInstancesWithCinderVolumes-1418312596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:18:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-ed7398d6-2165-4f4d-90a8-04bc85932c73 tempest-TestInstancesWithCinderVolumes-1418312596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:18:47 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-ed7398d6-2165-4f4d-90a8-04bc85932c73 tempest-TestInstancesWithCinderVolumes-1418312596 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:18:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2021183459',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47a2c419-6de4-4354-ab8e-f99046be195a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32a3143784af48dc965619024ef66ea0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:18:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:18:47Z,use_quota=True,user_id='aa5463a24a4f4c058a58c0f75b2bde1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a07f2291-43e0-49ac-887e-98cb373ce053),volume_type_id=a07f2291-43e0-49ac-887e-98cb373ce053)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:18:47 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-ed7398d6-2165-4f4d-90a8-04bc85932c73 tempest-TestInstancesWithCinderVolumes-1418312596 None] Creating volume 47a2c419-6de4-4354-ab8e-f99046be195a {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:18:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-ed7398d6-2165-4f4d-90a8-04bc85932c73 tempest-TestInstancesWithCinderVolumes-1418312596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:18:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-ed7398d6-2165-4f4d-90a8-04bc85932c73 tempest-TestInstancesWithCinderVolumes-1418312596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:18:47 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-ed7398d6-2165-4f4d-90a8-04bc85932c73 tempest-TestInstancesWithCinderVolumes-1418312596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:18:47 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-ed7398d6-2165-4f4d-90a8-04bc85932c73 tempest-TestInstancesWithCinderVolumes-1418312596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:18:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-ed7398d6-2165-4f4d-90a8-04bc85932c73 tempest-TestInstancesWithCinderVolumes-1418312596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:18:47 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-ed7398d6-2165-4f4d-90a8-04bc85932c73 tempest-TestInstancesWithCinderVolumes-1418312596 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:18:47 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-ed7398d6-2165-4f4d-90a8-04bc85932c73 tempest-TestInstancesWithCinderVolumes-1418312596 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:18:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-ed7398d6-2165-4f4d-90a8-04bc85932c73 tempest-TestInstancesWithCinderVolumes-1418312596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-47a2c419-6de4-4354-ab8e-f99046be195a 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:47 devstack sudo[100653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-47a2c419-6de4-4354-ab8e-f99046be195a 1073741824
Jul 03 01:18:47 devstack sudo[100653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:47 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a80d123-304a-4dba-a508-b1baa24bf4a7 tempest-TestInstancesWithCinderVolumes-1418312596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:18:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1a80d123-304a-4dba-a508-b1baa24bf4a7 tempest-TestInstancesWithCinderVolumes-1418312596 None] Flow 'volume_create_manager' (264fd6a0-90f8-4337-82e4-fef2ebe3839b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:18:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1a80d123-304a-4dba-a508-b1baa24bf4a7 tempest-TestInstancesWithCinderVolumes-1418312596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe12c32b-aee1-495d-8234-221c0a1eee18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:18:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1a80d123-304a-4dba-a508-b1baa24bf4a7 tempest-TestInstancesWithCinderVolumes-1418312596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe12c32b-aee1-495d-8234-221c0a1eee18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:18:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1869863122',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e97b278-7ffc-4df6-9f1f-b5e19c742d25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32a3143784af48dc965619024ef66ea0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:18:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:18:48Z,use_quota=True,user_id='aa5463a24a4f4c058a58c0f75b2bde1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc906606-ae32-4f53-b5b0-d6a817a8af87),volume_type_id=bc906606-ae32-4f53-b5b0-d6a817a8af87)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:18:47 devstack sudo[100646]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1a80d123-304a-4dba-a508-b1baa24bf4a7 tempest-TestInstancesWithCinderVolumes-1418312596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dede09ce-53ed-4c03-8b73-24e2f0eff704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:18:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1a80d123-304a-4dba-a508-b1baa24bf4a7 tempest-TestInstancesWithCinderVolumes-1418312596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dede09ce-53ed-4c03-8b73-24e2f0eff704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:18:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1a80d123-304a-4dba-a508-b1baa24bf4a7 tempest-TestInstancesWithCinderVolumes-1418312596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d12896d-9b2f-4fdc-892d-a57f39f86088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:18:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1a80d123-304a-4dba-a508-b1baa24bf4a7 tempest-TestInstancesWithCinderVolumes-1418312596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d12896d-9b2f-4fdc-892d-a57f39f86088) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e97b278-7ffc-4df6-9f1f-b5e19c742d25', 'volume_name': 'volume-1e97b278-7ffc-4df6-9f1f-b5e19c742d25', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:18:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1a80d123-304a-4dba-a508-b1baa24bf4a7 tempest-TestInstancesWithCinderVolumes-1418312596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c871016c-5e5a-4fc7-9a26-9e176dfa5122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:18:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1a80d123-304a-4dba-a508-b1baa24bf4a7 tempest-TestInstancesWithCinderVolumes-1418312596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c871016c-5e5a-4fc7-9a26-9e176dfa5122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:18:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1a80d123-304a-4dba-a508-b1baa24bf4a7 tempest-TestInstancesWithCinderVolumes-1418312596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3831409a-6836-4b4e-8edc-34e73b682cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:18:47 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-1a80d123-304a-4dba-a508-b1baa24bf4a7 tempest-TestInstancesWithCinderVolumes-1418312596 None] Volume 1e97b278-7ffc-4df6-9f1f-b5e19c742d25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e97b278-7ffc-4df6-9f1f-b5e19c742d25', 'volume_size': 1}
Jul 03 01:18:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1a80d123-304a-4dba-a508-b1baa24bf4a7 tempest-TestInstancesWithCinderVolumes-1418312596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:18:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e02d68bc-f0d3-412e-ada1-4b25c3ed2e7e tempest-VolumesSnapshotListTestJSON-20190602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424" returned: 0 in 1.127s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e02d68bc-f0d3-412e-ada1-4b25c3ed2e7e tempest-VolumesSnapshotListTestJSON-20190602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.a48852ec-1ce0-470a-9d4e-40edb1894baf {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:47 devstack sudo[100659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.a48852ec-1ce0-470a-9d4e-40edb1894baf
Jul 03 01:18:47 devstack sudo[100659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:48 devstack sudo[100651]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f5820b16-196d-4ecc-996c-4a51d588642d tempest-VolumeImageDependencyTests-658260342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-18db9913-5903-40ef-9c3c-06a651b9f8d4" returned: 0 in 0.920s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:48 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-f5820b16-196d-4ecc-996c-4a51d588642d tempest-VolumeImageDependencyTests-658260342 None] Lock "cinder-quobyte-18db9913-5903-40ef-9c3c-06a651b9f8d4" released by "delete_volume" :: held 2.597s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:18:48 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-f5820b16-196d-4ecc-996c-4a51d588642d tempest-VolumeImageDependencyTests-658260342 None] Created reservations ['6842ebf1-1619-49cb-ae05-e4b88c2ce857', '99eddd85-ba6a-45e4-aaea-2837047b9e13', 'b7ef9db6-a654-43b4-87c8-0173c04da3ed', '83ed0ed1-20e9-4506-aa3b-19cc87b086a8'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:18:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f5820b16-196d-4ecc-996c-4a51d588642d tempest-VolumeImageDependencyTests-658260342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:18:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f5820b16-196d-4ecc-996c-4a51d588642d tempest-VolumeImageDependencyTests-658260342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:18:48 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-f5820b16-196d-4ecc-996c-4a51d588642d tempest-VolumeImageDependencyTests-658260342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:18:48 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-f5820b16-196d-4ecc-996c-4a51d588642d tempest-VolumeImageDependencyTests-658260342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:18:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f5820b16-196d-4ecc-996c-4a51d588642d tempest-VolumeImageDependencyTests-658260342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:18:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f5820b16-196d-4ecc-996c-4a51d588642d tempest-VolumeImageDependencyTests-658260342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:48 devstack sudo[100664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:18:48 devstack sudo[100664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:48 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-22386cbc-47a7-4c99-bd53-737b1662b760 tempest-TestInstancesWithCinderVolumes-1418312596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:18:48 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-22386cbc-47a7-4c99-bd53-737b1662b760 tempest-TestInstancesWithCinderVolumes-1418312596 None] Flow 'volume_create_manager' (ccb301e0-d26c-46ae-9b54-88b906d9f7d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:18:48 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-22386cbc-47a7-4c99-bd53-737b1662b760 tempest-TestInstancesWithCinderVolumes-1418312596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74d71441-4cfa-4af3-95d6-fcd4045fa89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:18:48 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-22386cbc-47a7-4c99-bd53-737b1662b760 tempest-TestInstancesWithCinderVolumes-1418312596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74d71441-4cfa-4af3-95d6-fcd4045fa89e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:18:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-682348347',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11f94ee7-3bfd-4ff2-95d3-321609d90c22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32a3143784af48dc965619024ef66ea0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:18:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:18:48Z,use_quota=True,user_id='aa5463a24a4f4c058a58c0f75b2bde1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebf79061-4d73-4588-97e8-0670790fb3a2),volume_type_id=ebf79061-4d73-4588-97e8-0670790fb3a2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:18:48 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-22386cbc-47a7-4c99-bd53-737b1662b760 tempest-TestInstancesWithCinderVolumes-1418312596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a588b0ec-8d11-4a77-a61a-af0c2ac2a806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:18:48 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-22386cbc-47a7-4c99-bd53-737b1662b760 tempest-TestInstancesWithCinderVolumes-1418312596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a588b0ec-8d11-4a77-a61a-af0c2ac2a806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:18:48 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-22386cbc-47a7-4c99-bd53-737b1662b760 tempest-TestInstancesWithCinderVolumes-1418312596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4db92bf9-68e3-40f6-8ee0-e6f884cd5cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:18:48 devstack cinder-volume[86891]: DEBUG cinder.image.glance [None req-22386cbc-47a7-4c99-bd53-737b1662b760 tempest-TestInstancesWithCinderVolumes-1418312596 None] Creating Keystone auth plugin from conf {{(pid=86891) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 03 01:18:48 devstack sudo[100653]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-ed7398d6-2165-4f4d-90a8-04bc85932c73 tempest-TestInstancesWithCinderVolumes-1418312596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-47a2c419-6de4-4354-ab8e-f99046be195a 1073741824" returned: 0 in 1.176s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-ed7398d6-2165-4f4d-90a8-04bc85932c73 tempest-TestInstancesWithCinderVolumes-1418312596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-47a2c419-6de4-4354-ab8e-f99046be195a {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:48 devstack sudo[100669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-47a2c419-6de4-4354-ab8e-f99046be195a
Jul 03 01:18:48 devstack sudo[100669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:48 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-22386cbc-47a7-4c99-bd53-737b1662b760 tempest-TestInstancesWithCinderVolumes-1418312596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4db92bf9-68e3-40f6-8ee0-e6f884cd5cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '11f94ee7-3bfd-4ff2-95d3-321609d90c22', 'volume_name': 'volume-11f94ee7-3bfd-4ff2-95d3-321609d90c22', 'volume_size': 1, 'image_id': '09853275-a36d-4f62-a9c6-77a4bc4e072f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/09853275-a36d-4f62-a9c6-77a4bc4e072f', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--35016192', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '32a3143784af48dc965619024ef66ea0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '09853275-a36d-4f62-a9c6-77a4bc4e072f', 'created_at': datetime.datetime(2026, 7, 2, 23, 18, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 23, 18, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/09853275-a36d-4f62-a9c6-77a4bc4e072f/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7c5b2ae85280>}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:18:48 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-22386cbc-47a7-4c99-bd53-737b1662b760 tempest-TestInstancesWithCinderVolumes-1418312596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b8f6de6-984a-480a-a291-479492f5e5ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:18:48 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-22386cbc-47a7-4c99-bd53-737b1662b760 tempest-TestInstancesWithCinderVolumes-1418312596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b8f6de6-984a-480a-a291-479492f5e5ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:18:48 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-22386cbc-47a7-4c99-bd53-737b1662b760 tempest-TestInstancesWithCinderVolumes-1418312596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c3a4c9b-0a57-4dfb-a0ed-9a8eb38a05a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:18:48 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-22386cbc-47a7-4c99-bd53-737b1662b760 tempest-TestInstancesWithCinderVolumes-1418312596 None] Volume 11f94ee7-3bfd-4ff2-95d3-321609d90c22: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-11f94ee7-3bfd-4ff2-95d3-321609d90c22', 'volume_size': 1, 'image_id': '09853275-a36d-4f62-a9c6-77a4bc4e072f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/09853275-a36d-4f62-a9c6-77a4bc4e072f', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--35016192', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '32a3143784af48dc965619024ef66ea0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '09853275-a36d-4f62-a9c6-77a4bc4e072f', 'created_at': datetime.datetime(2026, 7, 2, 23, 18, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 23, 18, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/09853275-a36d-4f62-a9c6-77a4bc4e072f/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7c5b2ae85280>}
Jul 03 01:18:48 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-22386cbc-47a7-4c99-bd53-737b1662b760 tempest-TestInstancesWithCinderVolumes-1418312596 None] Trying to clone 11f94ee7-3bfd-4ff2-95d3-321609d90c22 from image 09853275-a36d-4f62-a9c6-77a4bc4e072f at location (None, [{'url': 'file:///opt/stack/data/glance/images/09853275-a36d-4f62-a9c6-77a4bc4e072f', 'metadata': {}}]). {{(pid=86891) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 03 01:18:48 devstack sudo[100659]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e02d68bc-f0d3-412e-ada1-4b25c3ed2e7e tempest-VolumesSnapshotListTestJSON-20190602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.a48852ec-1ce0-470a-9d4e-40edb1894baf" returned: 0 in 1.088s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e02d68bc-f0d3-412e-ada1-4b25c3ed2e7e tempest-VolumesSnapshotListTestJSON-20190602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.a48852ec-1ce0-470a-9d4e-40edb1894baf {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:49 devstack sudo[100674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.a48852ec-1ce0-470a-9d4e-40edb1894baf
Jul 03 01:18:49 devstack sudo[100674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:49 devstack sudo[100664]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f5820b16-196d-4ecc-996c-4a51d588642d tempest-VolumeImageDependencyTests-658260342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 1.092s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:49 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-f5820b16-196d-4ecc-996c-4a51d588642d tempest-VolumeImageDependencyTests-658260342 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:18:49 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-f5820b16-196d-4ecc-996c-4a51d588642d tempest-VolumeImageDependencyTests-658260342 None] Deleted volume successfully.
Jul 03 01:18:49 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-f5820b16-196d-4ecc-996c-4a51d588642d tempest-VolumeImageDependencyTests-658260342 None] Lock "cinder-18db9913-5903-40ef-9c3c-06a651b9f8d4-delete_volume" released by "delete_volume" :: held 3.973s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:18:49 devstack sudo[100669]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-ed7398d6-2165-4f4d-90a8-04bc85932c73 tempest-TestInstancesWithCinderVolumes-1418312596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-47a2c419-6de4-4354-ab8e-f99046be195a" returned: 0 in 0.947s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:49 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-ed7398d6-2165-4f4d-90a8-04bc85932c73 tempest-TestInstancesWithCinderVolumes-1418312596 None] <== create_volume: return (2176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:18:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-ed7398d6-2165-4f4d-90a8-04bc85932c73 tempest-TestInstancesWithCinderVolumes-1418312596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.182s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:18:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1a80d123-304a-4dba-a508-b1baa24bf4a7 tempest-TestInstancesWithCinderVolumes-1418312596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.686s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:18:49 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-1a80d123-304a-4dba-a508-b1baa24bf4a7 tempest-TestInstancesWithCinderVolumes-1418312596 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:18:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1869863122',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e97b278-7ffc-4df6-9f1f-b5e19c742d25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32a3143784af48dc965619024ef66ea0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:18:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:18:48Z,use_quota=True,user_id='aa5463a24a4f4c058a58c0f75b2bde1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc906606-ae32-4f53-b5b0-d6a817a8af87),volume_type_id=bc906606-ae32-4f53-b5b0-d6a817a8af87)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:18:49 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-1a80d123-304a-4dba-a508-b1baa24bf4a7 tempest-TestInstancesWithCinderVolumes-1418312596 None] Creating volume 1e97b278-7ffc-4df6-9f1f-b5e19c742d25 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:18:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1a80d123-304a-4dba-a508-b1baa24bf4a7 tempest-TestInstancesWithCinderVolumes-1418312596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:18:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1a80d123-304a-4dba-a508-b1baa24bf4a7 tempest-TestInstancesWithCinderVolumes-1418312596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:18:49 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-1a80d123-304a-4dba-a508-b1baa24bf4a7 tempest-TestInstancesWithCinderVolumes-1418312596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:18:49 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-1a80d123-304a-4dba-a508-b1baa24bf4a7 tempest-TestInstancesWithCinderVolumes-1418312596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:18:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1a80d123-304a-4dba-a508-b1baa24bf4a7 tempest-TestInstancesWithCinderVolumes-1418312596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:18:49 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-1a80d123-304a-4dba-a508-b1baa24bf4a7 tempest-TestInstancesWithCinderVolumes-1418312596 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:18:49 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-1a80d123-304a-4dba-a508-b1baa24bf4a7 tempest-TestInstancesWithCinderVolumes-1418312596 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:18:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1a80d123-304a-4dba-a508-b1baa24bf4a7 tempest-TestInstancesWithCinderVolumes-1418312596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1e97b278-7ffc-4df6-9f1f-b5e19c742d25 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:49 devstack sudo[100678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1e97b278-7ffc-4df6-9f1f-b5e19c742d25 1073741824
Jul 03 01:18:49 devstack sudo[100678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:49 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ed7398d6-2165-4f4d-90a8-04bc85932c73 tempest-TestInstancesWithCinderVolumes-1418312596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e70950e-837c-4d8a-b00a-439947d01a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47a2c419-6de4-4354-ab8e-f99046be195a', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:18:49 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ed7398d6-2165-4f4d-90a8-04bc85932c73 tempest-TestInstancesWithCinderVolumes-1418312596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d49d58b3-d445-43fd-b651-1f216dc161b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:18:49 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-ed7398d6-2165-4f4d-90a8-04bc85932c73 tempest-TestInstancesWithCinderVolumes-1418312596 None] Volume volume-47a2c419-6de4-4354-ab8e-f99046be195a (47a2c419-6de4-4354-ab8e-f99046be195a): created successfully
Jul 03 01:18:49 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ed7398d6-2165-4f4d-90a8-04bc85932c73 tempest-TestInstancesWithCinderVolumes-1418312596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d49d58b3-d445-43fd-b651-1f216dc161b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:18:49 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ed7398d6-2165-4f4d-90a8-04bc85932c73 tempest-TestInstancesWithCinderVolumes-1418312596 None] Flow 'volume_create_manager' (d7704c64-38a9-4d0c-bb46-86060651a0d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:18:49 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-ed7398d6-2165-4f4d-90a8-04bc85932c73 tempest-TestInstancesWithCinderVolumes-1418312596 None] Created volume successfully.
Jul 03 01:18:49 devstack sudo[100674]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e02d68bc-f0d3-412e-ada1-4b25c3ed2e7e tempest-VolumesSnapshotListTestJSON-20190602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424.a48852ec-1ce0-470a-9d4e-40edb1894baf" returned: 0 in 0.932s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:49 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e02d68bc-f0d3-412e-ada1-4b25c3ed2e7e tempest-VolumesSnapshotListTestJSON-20190602 None] Lock "cinder-quobyte-a48852ec-1ce0-470a-9d4e-40edb1894baf" released by "_delete_snapshot" :: held 4.134s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:18:49 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e02d68bc-f0d3-412e-ada1-4b25c3ed2e7e tempest-VolumesSnapshotListTestJSON-20190602 None] Lock "cinder-quobyte-b81f63ec-41cd-4e5b-8f7a-a481f718b424" released by "delete_snapshot" :: held 4.166s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:18:50 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-e02d68bc-f0d3-412e-ada1-4b25c3ed2e7e tempest-VolumesSnapshotListTestJSON-20190602 None] Created reservations ['885dc980-dce9-48c4-a5bd-49a0744c480b', '298dbe27-8722-46ac-8cb9-c241f8204b9f', '38fa803d-0549-49f1-a2a6-46426cb252a9', '5bc5c40b-f1ef-410e-93e4-c6d624ba905c'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:18:50 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-e02d68bc-f0d3-412e-ada1-4b25c3ed2e7e tempest-VolumesSnapshotListTestJSON-20190602 None] Delete snapshot completed successfully.
Jul 03 01:18:50 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e02d68bc-f0d3-412e-ada1-4b25c3ed2e7e tempest-VolumesSnapshotListTestJSON-20190602 None] Lock "cinder-a48852ec-1ce0-470a-9d4e-40edb1894baf-delete_snapshot" released by "delete_snapshot" :: held 4.381s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:18:50 devstack sudo[100678]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1a80d123-304a-4dba-a508-b1baa24bf4a7 tempest-TestInstancesWithCinderVolumes-1418312596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1e97b278-7ffc-4df6-9f1f-b5e19c742d25 1073741824" returned: 0 in 1.053s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1a80d123-304a-4dba-a508-b1baa24bf4a7 tempest-TestInstancesWithCinderVolumes-1418312596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1e97b278-7ffc-4df6-9f1f-b5e19c742d25 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:50 devstack sudo[100686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1e97b278-7ffc-4df6-9f1f-b5e19c742d25
Jul 03 01:18:50 devstack sudo[100686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:51 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-eb26baed-9dd6-4fd2-9c9b-c3bff8f8aac2 tempest-VolumesSnapshotListTestJSON-20190602 None] Acquiring lock "cinder-b81f63ec-41cd-4e5b-8f7a-a481f718b424-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:18:51 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-eb26baed-9dd6-4fd2-9c9b-c3bff8f8aac2 tempest-VolumesSnapshotListTestJSON-20190602 None] Lock "cinder-b81f63ec-41cd-4e5b-8f7a-a481f718b424-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:18:51 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-eb26baed-9dd6-4fd2-9c9b-c3bff8f8aac2 tempest-VolumesSnapshotListTestJSON-20190602 None] Acquiring lock "cinder-quobyte-b81f63ec-41cd-4e5b-8f7a-a481f718b424" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:18:51 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-eb26baed-9dd6-4fd2-9c9b-c3bff8f8aac2 tempest-VolumesSnapshotListTestJSON-20190602 None] Lock "cinder-quobyte-b81f63ec-41cd-4e5b-8f7a-a481f718b424" acquired by "delete_volume" :: waited 0.020s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:18:51 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[97915015-b000-455c-a8f8-3ebbbc71b4dd]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:18:51 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-eb26baed-9dd6-4fd2-9c9b-c3bff8f8aac2 tempest-VolumesSnapshotListTestJSON-20190602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:51 devstack sudo[100686]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:51 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1a80d123-304a-4dba-a508-b1baa24bf4a7 tempest-TestInstancesWithCinderVolumes-1418312596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1e97b278-7ffc-4df6-9f1f-b5e19c742d25" returned: 0 in 0.717s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:51 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-1a80d123-304a-4dba-a508-b1baa24bf4a7 tempest-TestInstancesWithCinderVolumes-1418312596 None] <== create_volume: return (1860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:18:51 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1a80d123-304a-4dba-a508-b1baa24bf4a7 tempest-TestInstancesWithCinderVolumes-1418312596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.863s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:18:51 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1a80d123-304a-4dba-a508-b1baa24bf4a7 tempest-TestInstancesWithCinderVolumes-1418312596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3831409a-6836-4b4e-8edc-34e73b682cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e97b278-7ffc-4df6-9f1f-b5e19c742d25', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:18:51 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1a80d123-304a-4dba-a508-b1baa24bf4a7 tempest-TestInstancesWithCinderVolumes-1418312596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acdb864d-a926-427c-b796-ea6dd1b0ea34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:18:51 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-1a80d123-304a-4dba-a508-b1baa24bf4a7 tempest-TestInstancesWithCinderVolumes-1418312596 None] Volume volume-1e97b278-7ffc-4df6-9f1f-b5e19c742d25 (1e97b278-7ffc-4df6-9f1f-b5e19c742d25): created successfully
Jul 03 01:18:51 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1a80d123-304a-4dba-a508-b1baa24bf4a7 tempest-TestInstancesWithCinderVolumes-1418312596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acdb864d-a926-427c-b796-ea6dd1b0ea34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:18:51 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1a80d123-304a-4dba-a508-b1baa24bf4a7 tempest-TestInstancesWithCinderVolumes-1418312596 None] Flow 'volume_create_manager' (264fd6a0-90f8-4337-82e4-fef2ebe3839b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:18:51 devstack sudo[100689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424
Jul 03 01:18:51 devstack sudo[100689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:51 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-1a80d123-304a-4dba-a508-b1baa24bf4a7 tempest-TestInstancesWithCinderVolumes-1418312596 None] Created volume successfully.
Jul 03 01:18:52 devstack sudo[100689]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-eb26baed-9dd6-4fd2-9c9b-c3bff8f8aac2 tempest-VolumesSnapshotListTestJSON-20190602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424" returned: 0 in 0.817s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-eb26baed-9dd6-4fd2-9c9b-c3bff8f8aac2 tempest-VolumesSnapshotListTestJSON-20190602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:52 devstack sudo[100694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424
Jul 03 01:18:52 devstack sudo[100694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:52 devstack sudo[100694]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-eb26baed-9dd6-4fd2-9c9b-c3bff8f8aac2 tempest-VolumesSnapshotListTestJSON-20190602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-b81f63ec-41cd-4e5b-8f7a-a481f718b424" returned: 0 in 0.681s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:52 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-eb26baed-9dd6-4fd2-9c9b-c3bff8f8aac2 tempest-VolumesSnapshotListTestJSON-20190602 None] Lock "cinder-quobyte-b81f63ec-41cd-4e5b-8f7a-a481f718b424" released by "delete_volume" :: held 1.569s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:18:52 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-eb26baed-9dd6-4fd2-9c9b-c3bff8f8aac2 tempest-VolumesSnapshotListTestJSON-20190602 None] Created reservations ['f41ced59-ba92-411e-82f1-8e66b88afffc', 'ee2ecdd9-3733-4518-b527-b010158fb765', 'deb95cec-038b-4856-af35-74848f52903f', '55dc8f3e-c2c0-45e4-9e2e-a882d92b3229'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:18:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-eb26baed-9dd6-4fd2-9c9b-c3bff8f8aac2 tempest-VolumesSnapshotListTestJSON-20190602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:18:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-eb26baed-9dd6-4fd2-9c9b-c3bff8f8aac2 tempest-VolumesSnapshotListTestJSON-20190602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:18:53 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-eb26baed-9dd6-4fd2-9c9b-c3bff8f8aac2 tempest-VolumesSnapshotListTestJSON-20190602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:18:53 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-eb26baed-9dd6-4fd2-9c9b-c3bff8f8aac2 tempest-VolumesSnapshotListTestJSON-20190602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:18:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-eb26baed-9dd6-4fd2-9c9b-c3bff8f8aac2 tempest-VolumesSnapshotListTestJSON-20190602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:18:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-eb26baed-9dd6-4fd2-9c9b-c3bff8f8aac2 tempest-VolumesSnapshotListTestJSON-20190602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:53 devstack sudo[100697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:18:53 devstack sudo[100697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:53 devstack cinder-volume[86891]: DEBUG cinder.image.image_utils [None req-22386cbc-47a7-4c99-bd53-737b1662b760 tempest-TestInstancesWithCinderVolumes-1418312596 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_09853275-a36d-4f62-a9c6-77a4bc4e072f_okoct1l7devstack@QuobyteHD, size 20.69 MB, duration 4.32 sec {{(pid=86891) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 03 01:18:53 devstack cinder-volume[86891]: INFO cinder.image.image_utils [None req-22386cbc-47a7-4c99-bd53-737b1662b760 tempest-TestInstancesWithCinderVolumes-1418312596 None] Image download 20.69 MB at 4.79 MB/s
Jul 03 01:18:53 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[75019601-bc98-4721-a591-a35965075ff5]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:18:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-22386cbc-47a7-4c99-bd53-737b1662b760 tempest-TestInstancesWithCinderVolumes-1418312596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_09853275-a36d-4f62-a9c6-77a4bc4e072f_okoct1l7devstack@QuobyteHD {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:53 devstack sudo[100699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_09853275-a36d-4f62-a9c6-77a4bc4e072f_okoct1l7devstack@QuobyteHD
Jul 03 01:18:53 devstack sudo[100699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:53 devstack sudo[100697]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-eb26baed-9dd6-4fd2-9c9b-c3bff8f8aac2 tempest-VolumesSnapshotListTestJSON-20190602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.750s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:53 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-eb26baed-9dd6-4fd2-9c9b-c3bff8f8aac2 tempest-VolumesSnapshotListTestJSON-20190602 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:18:53 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-eb26baed-9dd6-4fd2-9c9b-c3bff8f8aac2 tempest-VolumesSnapshotListTestJSON-20190602 None] Deleted volume successfully.
Jul 03 01:18:53 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-eb26baed-9dd6-4fd2-9c9b-c3bff8f8aac2 tempest-VolumesSnapshotListTestJSON-20190602 None] Lock "cinder-b81f63ec-41cd-4e5b-8f7a-a481f718b424-delete_volume" released by "delete_volume" :: held 2.595s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:18:54 devstack sudo[100699]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:54 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-22386cbc-47a7-4c99-bd53-737b1662b760 tempest-TestInstancesWithCinderVolumes-1418312596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_09853275-a36d-4f62-a9c6-77a4bc4e072f_okoct1l7devstack@QuobyteHD" returned: 0 in 0.911s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:54 devstack cinder-volume[86891]: DEBUG cinder.image.image_utils [None req-22386cbc-47a7-4c99-bd53-737b1662b760 tempest-TestInstancesWithCinderVolumes-1418312596 None] Temporary image 09853275-a36d-4f62-a9c6-77a4bc4e072f is fetched for user aa5463a24a4f4c058a58c0f75b2bde1e. {{(pid=86891) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 03 01:18:54 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[99fe7d1d-fbd8-45a6-a519-666510b78549]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:18:54 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-22386cbc-47a7-4c99-bd53-737b1662b760 tempest-TestInstancesWithCinderVolumes-1418312596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_09853275-a36d-4f62-a9c6-77a4bc4e072f_okoct1l7devstack@QuobyteHD {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:54 devstack sudo[100705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_09853275-a36d-4f62-a9c6-77a4bc4e072f_okoct1l7devstack@QuobyteHD
Jul 03 01:18:54 devstack sudo[100705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:55 devstack sudo[100705]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-22386cbc-47a7-4c99-bd53-737b1662b760 tempest-TestInstancesWithCinderVolumes-1418312596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_09853275-a36d-4f62-a9c6-77a4bc4e072f_okoct1l7devstack@QuobyteHD" returned: 0 in 0.916s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-22386cbc-47a7-4c99-bd53-737b1662b760 tempest-TestInstancesWithCinderVolumes-1418312596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:18:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-22386cbc-47a7-4c99-bd53-737b1662b760 tempest-TestInstancesWithCinderVolumes-1418312596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:18:55 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-22386cbc-47a7-4c99-bd53-737b1662b760 tempest-TestInstancesWithCinderVolumes-1418312596 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:18:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-682348347',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11f94ee7-3bfd-4ff2-95d3-321609d90c22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32a3143784af48dc965619024ef66ea0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:18:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:18:48Z,use_quota=True,user_id='aa5463a24a4f4c058a58c0f75b2bde1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebf79061-4d73-4588-97e8-0670790fb3a2),volume_type_id=ebf79061-4d73-4588-97e8-0670790fb3a2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:18:55 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-22386cbc-47a7-4c99-bd53-737b1662b760 tempest-TestInstancesWithCinderVolumes-1418312596 None] Creating volume 11f94ee7-3bfd-4ff2-95d3-321609d90c22 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:18:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-22386cbc-47a7-4c99-bd53-737b1662b760 tempest-TestInstancesWithCinderVolumes-1418312596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:18:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-22386cbc-47a7-4c99-bd53-737b1662b760 tempest-TestInstancesWithCinderVolumes-1418312596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:18:55 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-22386cbc-47a7-4c99-bd53-737b1662b760 tempest-TestInstancesWithCinderVolumes-1418312596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:18:55 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-22386cbc-47a7-4c99-bd53-737b1662b760 tempest-TestInstancesWithCinderVolumes-1418312596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:18:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-22386cbc-47a7-4c99-bd53-737b1662b760 tempest-TestInstancesWithCinderVolumes-1418312596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:18:55 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-22386cbc-47a7-4c99-bd53-737b1662b760 tempest-TestInstancesWithCinderVolumes-1418312596 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:18:55 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-22386cbc-47a7-4c99-bd53-737b1662b760 tempest-TestInstancesWithCinderVolumes-1418312596 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:18:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-22386cbc-47a7-4c99-bd53-737b1662b760 tempest-TestInstancesWithCinderVolumes-1418312596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-11f94ee7-3bfd-4ff2-95d3-321609d90c22 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:55 devstack sudo[100710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-11f94ee7-3bfd-4ff2-95d3-321609d90c22 1073741824
Jul 03 01:18:55 devstack sudo[100710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:56 devstack sudo[100710]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-22386cbc-47a7-4c99-bd53-737b1662b760 tempest-TestInstancesWithCinderVolumes-1418312596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-11f94ee7-3bfd-4ff2-95d3-321609d90c22 1073741824" returned: 0 in 0.943s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-22386cbc-47a7-4c99-bd53-737b1662b760 tempest-TestInstancesWithCinderVolumes-1418312596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-11f94ee7-3bfd-4ff2-95d3-321609d90c22 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:56 devstack sudo[100716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-11f94ee7-3bfd-4ff2-95d3-321609d90c22
Jul 03 01:18:56 devstack sudo[100716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:56 devstack sudo[100716]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-22386cbc-47a7-4c99-bd53-737b1662b760 tempest-TestInstancesWithCinderVolumes-1418312596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-11f94ee7-3bfd-4ff2-95d3-321609d90c22" returned: 0 in 0.720s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:56 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-22386cbc-47a7-4c99-bd53-737b1662b760 tempest-TestInstancesWithCinderVolumes-1418312596 None] <== create_volume: return (1712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:18:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-22386cbc-47a7-4c99-bd53-737b1662b760 tempest-TestInstancesWithCinderVolumes-1418312596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.716s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:18:56 devstack cinder-volume[86891]: DEBUG cinder.volume.volume_utils [None req-22386cbc-47a7-4c99-bd53-737b1662b760 tempest-TestInstancesWithCinderVolumes-1418312596 None] Attempting download of 09853275-a36d-4f62-a9c6-77a4bc4e072f ((None, [{'url': 'file:///opt/stack/data/glance/images/09853275-a36d-4f62-a9c6-77a4bc4e072f', 'metadata': {}}])) to volume 11f94ee7-3bfd-4ff2-95d3-321609d90c22. {{(pid=86891) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 03 01:18:56 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[6222db4a-b097-4261-9b19-8e2177fc3c5d]: (4, 'raw') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:18:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-22386cbc-47a7-4c99-bd53-737b1662b760 tempest-TestInstancesWithCinderVolumes-1418312596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_09853275-a36d-4f62-a9c6-77a4bc4e072f_wy_64_vk {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:57 devstack sudo[100719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_09853275-a36d-4f62-a9c6-77a4bc4e072f_wy_64_vk
Jul 03 01:18:57 devstack sudo[100719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:57 devstack sudo[100719]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-22386cbc-47a7-4c99-bd53-737b1662b760 tempest-TestInstancesWithCinderVolumes-1418312596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_09853275-a36d-4f62-a9c6-77a4bc4e072f_wy_64_vk" returned: 0 in 0.767s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-22386cbc-47a7-4c99-bd53-737b1662b760 tempest-TestInstancesWithCinderVolumes-1418312596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_09853275-a36d-4f62-a9c6-77a4bc4e072f_wy_64_vk {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:57 devstack sudo[100723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_09853275-a36d-4f62-a9c6-77a4bc4e072f_wy_64_vk
Jul 03 01:18:57 devstack sudo[100723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:58 devstack sudo[100723]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-22386cbc-47a7-4c99-bd53-737b1662b760 tempest-TestInstancesWithCinderVolumes-1418312596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_09853275-a36d-4f62-a9c6-77a4bc4e072f_wy_64_vk" returned: 1 in 0.746s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-22386cbc-47a7-4c99-bd53-737b1662b760 tempest-TestInstancesWithCinderVolumes-1418312596 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_09853275-a36d-4f62-a9c6-77a4bc4e072f_wy_64_vk' failed. Not Retrying. {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 01:18:58 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ef00f6-c2c7-4e59-929c-247c3563ac61]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:18:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-22386cbc-47a7-4c99-bd53-737b1662b760 tempest-TestInstancesWithCinderVolumes-1418312596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_09853275-a36d-4f62-a9c6-77a4bc4e072f_okoct1l7devstack@QuobyteHD {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:58 devstack sudo[100728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_09853275-a36d-4f62-a9c6-77a4bc4e072f_okoct1l7devstack@QuobyteHD
Jul 03 01:18:58 devstack sudo[100728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:18:59 devstack sudo[100728]: pam_unix(sudo:session): session closed for user root
Jul 03 01:18:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-22386cbc-47a7-4c99-bd53-737b1662b760 tempest-TestInstancesWithCinderVolumes-1418312596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_09853275-a36d-4f62-a9c6-77a4bc4e072f_okoct1l7devstack@QuobyteHD" returned: 0 in 0.806s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:18:59 devstack cinder-volume[86891]: DEBUG cinder.image.image_utils [None req-22386cbc-47a7-4c99-bd53-737b1662b760 tempest-TestInstancesWithCinderVolumes-1418312596 None] 09853275-a36d-4f62-a9c6-77a4bc4e072f was qcow2, converting to raw {{(pid=86891) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 03 01:18:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-22386cbc-47a7-4c99-bd53-737b1662b760 tempest-TestInstancesWithCinderVolumes-1418312596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_09853275-a36d-4f62-a9c6-77a4bc4e072f_okoct1l7devstack@QuobyteHD /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-11f94ee7-3bfd-4ff2-95d3-321609d90c22 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:18:59 devstack sudo[100733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_09853275-a36d-4f62-a9c6-77a4bc4e072f_okoct1l7devstack@QuobyteHD /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-11f94ee7-3bfd-4ff2-95d3-321609d90c22
Jul 03 01:18:59 devstack sudo[100733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:19:01 devstack sudo[100733]: pam_unix(sudo:session): session closed for user root
Jul 03 01:19:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-22386cbc-47a7-4c99-bd53-737b1662b760 tempest-TestInstancesWithCinderVolumes-1418312596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_09853275-a36d-4f62-a9c6-77a4bc4e072f_okoct1l7devstack@QuobyteHD /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-11f94ee7-3bfd-4ff2-95d3-321609d90c22" returned: 0 in 2.130s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:19:01 devstack cinder-volume[86891]: DEBUG cinder.image.image_utils [None req-22386cbc-47a7-4c99-bd53-737b1662b760 tempest-TestInstancesWithCinderVolumes-1418312596 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_09853275-a36d-4f62-a9c6-77a4bc4e072f_okoct1l7devstack@QuobyteHD, size 112.00 MB, duration 2.13 sec, destination /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-11f94ee7-3bfd-4ff2-95d3-321609d90c22 {{(pid=86891) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 03 01:19:01 devstack cinder-volume[86891]: INFO cinder.image.image_utils [None req-22386cbc-47a7-4c99-bd53-737b1662b760 tempest-TestInstancesWithCinderVolumes-1418312596 None] Converted 112.00 MB image at 52.55 MB/s
Jul 03 01:19:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-22386cbc-47a7-4c99-bd53-737b1662b760 tempest-TestInstancesWithCinderVolumes-1418312596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-11f94ee7-3bfd-4ff2-95d3-321609d90c22 1G {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:19:01 devstack sudo[100742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-11f94ee7-3bfd-4ff2-95d3-321609d90c22 1G
Jul 03 01:19:01 devstack sudo[100742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:19:01 devstack cinder-volume[86891]: DEBUG oslo_service.periodic_task [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86891) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 01:19:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:19:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:19:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:19:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:19:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:19:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:19:01 devstack sudo[100744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:19:01 devstack sudo[100744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:19:02 devstack sudo[100742]: pam_unix(sudo:session): session closed for user root
Jul 03 01:19:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-22386cbc-47a7-4c99-bd53-737b1662b760 tempest-TestInstancesWithCinderVolumes-1418312596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-11f94ee7-3bfd-4ff2-95d3-321609d90c22 1G" returned: 0 in 0.875s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:19:02 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1965321-9c5f-4327-b53b-8bdeb47a73e5]: (4, 'raw') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:19:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-22386cbc-47a7-4c99-bd53-737b1662b760 tempest-TestInstancesWithCinderVolumes-1418312596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-11f94ee7-3bfd-4ff2-95d3-321609d90c22 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:19:02 devstack sudo[100749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-11f94ee7-3bfd-4ff2-95d3-321609d90c22
Jul 03 01:19:02 devstack sudo[100749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:19:02 devstack sudo[100744]: pam_unix(sudo:session): session closed for user root
Jul 03 01:19:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.888s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:19:02 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:19:02 devstack cinder-volume[86891]: DEBUG oslo_service.periodic_task [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running periodic task VolumeManager._thread_info {{(pid=86891) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 01:19:02 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] thread count: 28 {{(pid=86891) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 01:19:02 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] thread info: [<_MainThread(MainThread, started 136731296534656)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136731184953280)>, <Thread(Thread-3 (stat_writer), started daemon 136731184058816)>, <Thread(Rabbit-heartbeat, started daemon 136731184846080)>, <Thread(Thread-5 (_runner), started daemon 136731182936576)>, <Thread(Thread-7 (_runner), started daemon 136731182954944)>, <Thread(fd_logger, started daemon 136731181916416)>, <Thread(privsep_reader, started daemon 136731180942208)>, <Thread(tpool_thread_0, started daemon 136731172161216)>, <Thread(tpool_thread_1, started daemon 136731163768512)>, <Thread(tpool_thread_2, started daemon 136731155375808)>, <Thread(tpool_thread_3, started daemon 136731146983104)>, <Thread(tpool_thread_4, started daemon 136731138590400)>, <Thread(tpool_thread_5, started daemon 136731130197696)>, <Thread(tpool_thread_6, started daemon 136731121804992)>, <Thread(tpool_thread_7, started daemon 136731113412288)>, <Thread(tpool_thread_8, started daemon 136731105003200)>, <Thread(tpool_thread_9, started daemon 136731096594112)>, <Thread(tpool_thread_10, started daemon 136731088185024)>, <Thread(tpool_thread_11, started daemon 136731079775936)>, <Thread(tpool_thread_12, started daemon 136731071366848)>, <Thread(tpool_thread_13, started daemon 136731062957760)>, <Thread(tpool_thread_14, started daemon 136731054548672)>, <Thread(tpool_thread_15, started daemon 136731046139584)>, <Thread(tpool_thread_16, started daemon 136731037730496)>, <Thread(tpool_thread_17, started daemon 136731029321408)>, <Thread(tpool_thread_18, started daemon 136731020912320)>, <Thread(tpool_thread_19, started daemon 136731012503232)>] {{(pid=86891) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 01:19:03 devstack sudo[100749]: pam_unix(sudo:session): session closed for user root
Jul 03 01:19:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-22386cbc-47a7-4c99-bd53-737b1662b760 tempest-TestInstancesWithCinderVolumes-1418312596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-11f94ee7-3bfd-4ff2-95d3-321609d90c22" returned: 0 in 0.981s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:19:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-22386cbc-47a7-4c99-bd53-737b1662b760 tempest-TestInstancesWithCinderVolumes-1418312596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-11f94ee7-3bfd-4ff2-95d3-321609d90c22 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:19:03 devstack sudo[100754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-11f94ee7-3bfd-4ff2-95d3-321609d90c22
Jul 03 01:19:03 devstack sudo[100754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:19:04 devstack sudo[100754]: pam_unix(sudo:session): session closed for user root
Jul 03 01:19:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-22386cbc-47a7-4c99-bd53-737b1662b760 tempest-TestInstancesWithCinderVolumes-1418312596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-11f94ee7-3bfd-4ff2-95d3-321609d90c22" returned: 1 in 0.849s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:19:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-22386cbc-47a7-4c99-bd53-737b1662b760 tempest-TestInstancesWithCinderVolumes-1418312596 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-11f94ee7-3bfd-4ff2-95d3-321609d90c22' failed. Not Retrying. {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 01:19:04 devstack cinder-volume[86891]: DEBUG cinder.volume.volume_utils [None req-22386cbc-47a7-4c99-bd53-737b1662b760 tempest-TestInstancesWithCinderVolumes-1418312596 None] Downloaded image 09853275-a36d-4f62-a9c6-77a4bc4e072f ((None, [{'url': 'file:///opt/stack/data/glance/images/09853275-a36d-4f62-a9c6-77a4bc4e072f', 'metadata': {}}])) to volume 11f94ee7-3bfd-4ff2-95d3-321609d90c22 successfully. {{(pid=86891) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 03 01:19:04 devstack cinder-volume[86891]: DEBUG cinder.image.image_utils [None req-22386cbc-47a7-4c99-bd53-737b1662b760 tempest-TestInstancesWithCinderVolumes-1418312596 None] Temporary image 09853275-a36d-4f62-a9c6-77a4bc4e072f for user aa5463a24a4f4c058a58c0f75b2bde1e is deleted. {{(pid=86891) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 03 01:19:04 devstack cinder-volume[86891]: DEBUG cinder.volume.volume_utils [None req-22386cbc-47a7-4c99-bd53-737b1662b760 tempest-TestInstancesWithCinderVolumes-1418312596 None] Marking volume 11f94ee7-3bfd-4ff2-95d3-321609d90c22 as bootable. {{(pid=86891) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 03 01:19:04 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:UPDATE=124,cinder:DELETE=10,cinder:SELECT=98,cinder:INSERT=42 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:19:04 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-22386cbc-47a7-4c99-bd53-737b1662b760 tempest-TestInstancesWithCinderVolumes-1418312596 None] Copying metadata from image 09853275-a36d-4f62-a9c6-77a4bc4e072f to 11f94ee7-3bfd-4ff2-95d3-321609d90c22. {{(pid=86891) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 03 01:19:04 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-22386cbc-47a7-4c99-bd53-737b1662b760 tempest-TestInstancesWithCinderVolumes-1418312596 None] Creating volume glance metadata for volume 11f94ee7-3bfd-4ff2-95d3-321609d90c22 backed by image 09853275-a36d-4f62-a9c6-77a4bc4e072f with: {'image_id': '09853275-a36d-4f62-a9c6-77a4bc4e072f', 'image_name': 'tempest-scenario-img--35016192', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86891) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 03 01:19:04 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:UPDATE=133,cinder:SELECT=110,cinder:DELETE=11,cinder:INSERT=40 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:19:04 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-22386cbc-47a7-4c99-bd53-737b1662b760 tempest-TestInstancesWithCinderVolumes-1418312596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c3a4c9b-0a57-4dfb-a0ed-9a8eb38a05a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11f94ee7-3bfd-4ff2-95d3-321609d90c22', 'volume_size': 1, 'image_id': '09853275-a36d-4f62-a9c6-77a4bc4e072f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/09853275-a36d-4f62-a9c6-77a4bc4e072f', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--35016192', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '32a3143784af48dc965619024ef66ea0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '09853275-a36d-4f62-a9c6-77a4bc4e072f', 'created_at': datetime.datetime(2026, 7, 2, 23, 18, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 23, 18, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/09853275-a36d-4f62-a9c6-77a4bc4e072f/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7c5b2ae85280>}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:19:04 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-22386cbc-47a7-4c99-bd53-737b1662b760 tempest-TestInstancesWithCinderVolumes-1418312596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dde4d31-0161-4537-bd8e-51df84c99a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:19:04 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-22386cbc-47a7-4c99-bd53-737b1662b760 tempest-TestInstancesWithCinderVolumes-1418312596 None] Volume volume-11f94ee7-3bfd-4ff2-95d3-321609d90c22 (11f94ee7-3bfd-4ff2-95d3-321609d90c22): created successfully
Jul 03 01:19:04 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-22386cbc-47a7-4c99-bd53-737b1662b760 tempest-TestInstancesWithCinderVolumes-1418312596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dde4d31-0161-4537-bd8e-51df84c99a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:19:04 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-22386cbc-47a7-4c99-bd53-737b1662b760 tempest-TestInstancesWithCinderVolumes-1418312596 None] Flow 'volume_create_manager' (ccb301e0-d26c-46ae-9b54-88b906d9f7d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:19:04 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-22386cbc-47a7-4c99-bd53-737b1662b760 tempest-TestInstancesWithCinderVolumes-1418312596 None] Created volume successfully.
Jul 03 01:19:14 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:SELECT=8,cinder:INSERT=5,cinder:UPDATE=3 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:19:14 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:INSERT=3,cinder:DELETE=1 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:19:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-1ce8f99a-87ae-4134-a1d5-a5401357498a req-ab218f50-2b22-4a83-98e8-013eca19858e tempest-TestInstancesWithCinderVolumes-1418312596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:19:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-1ce8f99a-87ae-4134-a1d5-a5401357498a req-ab218f50-2b22-4a83-98e8-013eca19858e tempest-TestInstancesWithCinderVolumes-1418312596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:19:15 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c33eedd-6317-46e2-81b4-fe89c5a3ec11]: (4, 'raw') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:19:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-1ce8f99a-87ae-4134-a1d5-a5401357498a req-ab218f50-2b22-4a83-98e8-013eca19858e tempest-TestInstancesWithCinderVolumes-1418312596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-11f94ee7-3bfd-4ff2-95d3-321609d90c22 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:19:15 devstack sudo[100772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-11f94ee7-3bfd-4ff2-95d3-321609d90c22
Jul 03 01:19:15 devstack sudo[100772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:19:15 devstack sudo[100772]: pam_unix(sudo:session): session closed for user root
Jul 03 01:19:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-1ce8f99a-87ae-4134-a1d5-a5401357498a req-ab218f50-2b22-4a83-98e8-013eca19858e tempest-TestInstancesWithCinderVolumes-1418312596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-11f94ee7-3bfd-4ff2-95d3-321609d90c22" returned: 0 in 0.932s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:19:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-1ce8f99a-87ae-4134-a1d5-a5401357498a req-ab218f50-2b22-4a83-98e8-013eca19858e tempest-TestInstancesWithCinderVolumes-1418312596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-11f94ee7-3bfd-4ff2-95d3-321609d90c22 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:19:16 devstack sudo[100776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-11f94ee7-3bfd-4ff2-95d3-321609d90c22
Jul 03 01:19:16 devstack sudo[100776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:19:16 devstack sudo[100776]: pam_unix(sudo:session): session closed for user root
Jul 03 01:19:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-1ce8f99a-87ae-4134-a1d5-a5401357498a req-ab218f50-2b22-4a83-98e8-013eca19858e tempest-TestInstancesWithCinderVolumes-1418312596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-11f94ee7-3bfd-4ff2-95d3-321609d90c22" returned: 1 in 0.815s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:19:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-1ce8f99a-87ae-4134-a1d5-a5401357498a req-ab218f50-2b22-4a83-98e8-013eca19858e tempest-TestInstancesWithCinderVolumes-1418312596 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-11f94ee7-3bfd-4ff2-95d3-321609d90c22' failed. Not Retrying. {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 01:19:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-1ce8f99a-87ae-4134-a1d5-a5401357498a req-ab218f50-2b22-4a83-98e8-013eca19858e tempest-TestInstancesWithCinderVolumes-1418312596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.816s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:19:16 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [req-1ce8f99a-87ae-4134-a1d5-a5401357498a req-ab218f50-2b22-4a83-98e8-013eca19858e tempest-TestInstancesWithCinderVolumes-1418312596 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3', 'name': 'volume-11f94ee7-3bfd-4ff2-95d3-321609d90c22', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '298c2e82-130f-48d9-a351-4346f01db7ec', 'enforce_multipath': True} {{(pid=86891) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 01:19:16 devstack cinder-volume[86891]: INFO cinder.volume.manager [req-1ce8f99a-87ae-4134-a1d5-a5401357498a req-ab218f50-2b22-4a83-98e8-013eca19858e tempest-TestInstancesWithCinderVolumes-1418312596 None] attachment_update completed successfully.
Jul 03 01:19:26 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:19:26 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:SELECT=6 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:19:36 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a96dc6b-ccb4-469a-8790-e8a59237c112 tempest-TestMinimumBasicScenario-1965106343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:19:36 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-4a96dc6b-ccb4-469a-8790-e8a59237c112 tempest-TestMinimumBasicScenario-1965106343 None] Flow 'volume_create_manager' (4497f51c-9df6-4995-96a3-83b9c57c48ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:19:36 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-4a96dc6b-ccb4-469a-8790-e8a59237c112 tempest-TestMinimumBasicScenario-1965106343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4992312a-e5d3-4187-8436-35acb7c5014a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:19:36 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-4a96dc6b-ccb4-469a-8790-e8a59237c112 tempest-TestMinimumBasicScenario-1965106343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4992312a-e5d3-4187-8436-35acb7c5014a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:19:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1330687072',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df719e77-2b0e-4605-9787-9617ee4c23d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cf53f0c5a294cca8b00e5fc3654e309',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:19:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:19:37Z,use_quota=True,user_id='be97ee8ce216441aac3cb528b11eae92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:19:36 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-4a96dc6b-ccb4-469a-8790-e8a59237c112 tempest-TestMinimumBasicScenario-1965106343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a601d22c-3192-494d-a3ed-534577b3ee42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:19:36 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-4a96dc6b-ccb4-469a-8790-e8a59237c112 tempest-TestMinimumBasicScenario-1965106343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a601d22c-3192-494d-a3ed-534577b3ee42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:19:36 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-4a96dc6b-ccb4-469a-8790-e8a59237c112 tempest-TestMinimumBasicScenario-1965106343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c4fd6c3-bf75-4001-bcb9-862e6895fb06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:19:36 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-4a96dc6b-ccb4-469a-8790-e8a59237c112 tempest-TestMinimumBasicScenario-1965106343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c4fd6c3-bf75-4001-bcb9-862e6895fb06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df719e77-2b0e-4605-9787-9617ee4c23d5', 'volume_name': 'volume-df719e77-2b0e-4605-9787-9617ee4c23d5', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:19:36 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-4a96dc6b-ccb4-469a-8790-e8a59237c112 tempest-TestMinimumBasicScenario-1965106343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e5c3a09-f104-40f5-a708-7fcca6f2b1be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:19:36 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-4a96dc6b-ccb4-469a-8790-e8a59237c112 tempest-TestMinimumBasicScenario-1965106343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e5c3a09-f104-40f5-a708-7fcca6f2b1be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:19:36 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-4a96dc6b-ccb4-469a-8790-e8a59237c112 tempest-TestMinimumBasicScenario-1965106343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54d4988e-d5f8-4dd8-b4b0-4b44cf25dc04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:19:36 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-4a96dc6b-ccb4-469a-8790-e8a59237c112 tempest-TestMinimumBasicScenario-1965106343 None] Volume df719e77-2b0e-4605-9787-9617ee4c23d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df719e77-2b0e-4605-9787-9617ee4c23d5', 'volume_size': 1}
Jul 03 01:19:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-4a96dc6b-ccb4-469a-8790-e8a59237c112 tempest-TestMinimumBasicScenario-1965106343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:19:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-4a96dc6b-ccb4-469a-8790-e8a59237c112 tempest-TestMinimumBasicScenario-1965106343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:19:36 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-4a96dc6b-ccb4-469a-8790-e8a59237c112 tempest-TestMinimumBasicScenario-1965106343 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:19:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1330687072',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df719e77-2b0e-4605-9787-9617ee4c23d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cf53f0c5a294cca8b00e5fc3654e309',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:19:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:19:37Z,use_quota=True,user_id='be97ee8ce216441aac3cb528b11eae92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:19:36 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-4a96dc6b-ccb4-469a-8790-e8a59237c112 tempest-TestMinimumBasicScenario-1965106343 None] Creating volume df719e77-2b0e-4605-9787-9617ee4c23d5 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:19:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-4a96dc6b-ccb4-469a-8790-e8a59237c112 tempest-TestMinimumBasicScenario-1965106343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:19:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-4a96dc6b-ccb4-469a-8790-e8a59237c112 tempest-TestMinimumBasicScenario-1965106343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:19:36 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-4a96dc6b-ccb4-469a-8790-e8a59237c112 tempest-TestMinimumBasicScenario-1965106343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:19:36 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-4a96dc6b-ccb4-469a-8790-e8a59237c112 tempest-TestMinimumBasicScenario-1965106343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:19:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-4a96dc6b-ccb4-469a-8790-e8a59237c112 tempest-TestMinimumBasicScenario-1965106343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:19:36 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-4a96dc6b-ccb4-469a-8790-e8a59237c112 tempest-TestMinimumBasicScenario-1965106343 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:19:36 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-4a96dc6b-ccb4-469a-8790-e8a59237c112 tempest-TestMinimumBasicScenario-1965106343 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:19:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-4a96dc6b-ccb4-469a-8790-e8a59237c112 tempest-TestMinimumBasicScenario-1965106343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-df719e77-2b0e-4605-9787-9617ee4c23d5 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:19:37 devstack sudo[101376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-df719e77-2b0e-4605-9787-9617ee4c23d5 1073741824
Jul 03 01:19:37 devstack sudo[101376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:19:37 devstack sudo[101376]: pam_unix(sudo:session): session closed for user root
Jul 03 01:19:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-4a96dc6b-ccb4-469a-8790-e8a59237c112 tempest-TestMinimumBasicScenario-1965106343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-df719e77-2b0e-4605-9787-9617ee4c23d5 1073741824" returned: 0 in 0.899s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:19:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-4a96dc6b-ccb4-469a-8790-e8a59237c112 tempest-TestMinimumBasicScenario-1965106343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-df719e77-2b0e-4605-9787-9617ee4c23d5 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:19:37 devstack sudo[101384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-df719e77-2b0e-4605-9787-9617ee4c23d5
Jul 03 01:19:37 devstack sudo[101384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:19:38 devstack sudo[101384]: pam_unix(sudo:session): session closed for user root
Jul 03 01:19:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-4a96dc6b-ccb4-469a-8790-e8a59237c112 tempest-TestMinimumBasicScenario-1965106343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-df719e77-2b0e-4605-9787-9617ee4c23d5" returned: 0 in 0.796s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:19:38 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-4a96dc6b-ccb4-469a-8790-e8a59237c112 tempest-TestMinimumBasicScenario-1965106343 None] <== create_volume: return (1739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:19:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-4a96dc6b-ccb4-469a-8790-e8a59237c112 tempest-TestMinimumBasicScenario-1965106343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.745s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:19:38 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-4a96dc6b-ccb4-469a-8790-e8a59237c112 tempest-TestMinimumBasicScenario-1965106343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54d4988e-d5f8-4dd8-b4b0-4b44cf25dc04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df719e77-2b0e-4605-9787-9617ee4c23d5', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:19:38 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-4a96dc6b-ccb4-469a-8790-e8a59237c112 tempest-TestMinimumBasicScenario-1965106343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16ddb2bc-7d4f-40aa-9de1-0ff13271c5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:19:38 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-4a96dc6b-ccb4-469a-8790-e8a59237c112 tempest-TestMinimumBasicScenario-1965106343 None] Volume volume-df719e77-2b0e-4605-9787-9617ee4c23d5 (df719e77-2b0e-4605-9787-9617ee4c23d5): created successfully
Jul 03 01:19:38 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-4a96dc6b-ccb4-469a-8790-e8a59237c112 tempest-TestMinimumBasicScenario-1965106343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16ddb2bc-7d4f-40aa-9de1-0ff13271c5ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:19:38 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-4a96dc6b-ccb4-469a-8790-e8a59237c112 tempest-TestMinimumBasicScenario-1965106343 None] Flow 'volume_create_manager' (4497f51c-9df6-4995-96a3-83b9c57c48ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:19:38 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-4a96dc6b-ccb4-469a-8790-e8a59237c112 tempest-TestMinimumBasicScenario-1965106343 None] Created volume successfully.
Jul 03 01:19:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-9b65ed9d-0a89-4272-b188-b4d9d3218bea req-d9be82d4-547b-409e-9629-86118b065738 tempest-TestMinimumBasicScenario-1965106343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:19:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-9b65ed9d-0a89-4272-b188-b4d9d3218bea req-d9be82d4-547b-409e-9629-86118b065738 tempest-TestMinimumBasicScenario-1965106343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:19:42 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ccdbd0-d8ed-4913-a163-677b481d50e3]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:19:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-9b65ed9d-0a89-4272-b188-b4d9d3218bea req-d9be82d4-547b-409e-9629-86118b065738 tempest-TestMinimumBasicScenario-1965106343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-df719e77-2b0e-4605-9787-9617ee4c23d5 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:19:42 devstack sudo[101501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-df719e77-2b0e-4605-9787-9617ee4c23d5
Jul 03 01:19:42 devstack sudo[101501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:19:43 devstack sudo[101501]: pam_unix(sudo:session): session closed for user root
Jul 03 01:19:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-9b65ed9d-0a89-4272-b188-b4d9d3218bea req-d9be82d4-547b-409e-9629-86118b065738 tempest-TestMinimumBasicScenario-1965106343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-df719e77-2b0e-4605-9787-9617ee4c23d5" returned: 0 in 0.745s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:19:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-9b65ed9d-0a89-4272-b188-b4d9d3218bea req-d9be82d4-547b-409e-9629-86118b065738 tempest-TestMinimumBasicScenario-1965106343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.763s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:19:43 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [req-9b65ed9d-0a89-4272-b188-b4d9d3218bea req-d9be82d4-547b-409e-9629-86118b065738 tempest-TestMinimumBasicScenario-1965106343 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3', 'name': 'volume-df719e77-2b0e-4605-9787-9617ee4c23d5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e2bd971b-10bd-42a2-a940-09d6afb2acf8', 'enforce_multipath': True} {{(pid=86891) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 01:19:43 devstack cinder-volume[86891]: INFO cinder.volume.manager [req-9b65ed9d-0a89-4272-b188-b4d9d3218bea req-d9be82d4-547b-409e-9629-86118b065738 tempest-TestMinimumBasicScenario-1965106343 None] attachment_update completed successfully.
Jul 03 01:19:53 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:UPDATE=2,cinder:SELECT=8,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:19:53 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:SELECT=7,cinder:UPDATE=7 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:19:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-93931441-314b-4c5f-bd9a-39096f62d61d req-4abded15-3ece-4951-86c6-2ea5d75a434f tempest-TestInstancesWithCinderVolumes-1418312596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:19:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-93931441-314b-4c5f-bd9a-39096f62d61d req-4abded15-3ece-4951-86c6-2ea5d75a434f tempest-TestInstancesWithCinderVolumes-1418312596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:19:56 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[79382a7c-cd35-414b-8642-73ff9e1dbd76]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:19:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-93931441-314b-4c5f-bd9a-39096f62d61d req-4abded15-3ece-4951-86c6-2ea5d75a434f tempest-TestInstancesWithCinderVolumes-1418312596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-47a2c419-6de4-4354-ab8e-f99046be195a {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:19:56 devstack sudo[101550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-47a2c419-6de4-4354-ab8e-f99046be195a
Jul 03 01:19:56 devstack sudo[101550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:19:56 devstack sudo[101550]: pam_unix(sudo:session): session closed for user root
Jul 03 01:19:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-93931441-314b-4c5f-bd9a-39096f62d61d req-4abded15-3ece-4951-86c6-2ea5d75a434f tempest-TestInstancesWithCinderVolumes-1418312596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-47a2c419-6de4-4354-ab8e-f99046be195a" returned: 0 in 0.770s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:19:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-93931441-314b-4c5f-bd9a-39096f62d61d req-4abded15-3ece-4951-86c6-2ea5d75a434f tempest-TestInstancesWithCinderVolumes-1418312596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.798s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:19:56 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [req-93931441-314b-4c5f-bd9a-39096f62d61d req-4abded15-3ece-4951-86c6-2ea5d75a434f tempest-TestInstancesWithCinderVolumes-1418312596 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3', 'name': 'volume-47a2c419-6de4-4354-ab8e-f99046be195a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '51b40c63-521c-4ee4-a68c-b782f7908124', 'enforce_multipath': True} {{(pid=86891) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 01:19:56 devstack cinder-volume[86891]: INFO cinder.volume.manager [req-93931441-314b-4c5f-bd9a-39096f62d61d req-4abded15-3ece-4951-86c6-2ea5d75a434f tempest-TestInstancesWithCinderVolumes-1418312596 None] attachment_update completed successfully.
Jul 03 01:20:01 devstack cinder-volume[86891]: DEBUG oslo_service.periodic_task [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86891) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 01:20:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:20:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:20:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:20:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:20:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:20:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:20:01 devstack sudo[101567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:20:01 devstack sudo[101567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:20:02 devstack sudo[101567]: pam_unix(sudo:session): session closed for user root
Jul 03 01:20:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.775s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:20:02 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:20:02 devstack cinder-volume[86891]: DEBUG oslo_service.periodic_task [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running periodic task VolumeManager._thread_info {{(pid=86891) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 01:20:02 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] thread count: 28 {{(pid=86891) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 01:20:02 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] thread info: [<_MainThread(MainThread, started 136731296534656)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136731184953280)>, <Thread(Thread-3 (stat_writer), started daemon 136731184058816)>, <Thread(Rabbit-heartbeat, started daemon 136731184846080)>, <Thread(Thread-5 (_runner), started daemon 136731182936576)>, <Thread(Thread-7 (_runner), started daemon 136731182954944)>, <Thread(fd_logger, started daemon 136731181916416)>, <Thread(privsep_reader, started daemon 136731180942208)>, <Thread(tpool_thread_0, started daemon 136731172161216)>, <Thread(tpool_thread_1, started daemon 136731163768512)>, <Thread(tpool_thread_2, started daemon 136731155375808)>, <Thread(tpool_thread_3, started daemon 136731146983104)>, <Thread(tpool_thread_4, started daemon 136731138590400)>, <Thread(tpool_thread_5, started daemon 136731130197696)>, <Thread(tpool_thread_6, started daemon 136731121804992)>, <Thread(tpool_thread_7, started daemon 136731113412288)>, <Thread(tpool_thread_8, started daemon 136731105003200)>, <Thread(tpool_thread_9, started daemon 136731096594112)>, <Thread(tpool_thread_10, started daemon 136731088185024)>, <Thread(tpool_thread_11, started daemon 136731079775936)>, <Thread(tpool_thread_12, started daemon 136731071366848)>, <Thread(tpool_thread_13, started daemon 136731062957760)>, <Thread(tpool_thread_14, started daemon 136731054548672)>, <Thread(tpool_thread_15, started daemon 136731046139584)>, <Thread(tpool_thread_16, started daemon 136731037730496)>, <Thread(tpool_thread_17, started daemon 136731029321408)>, <Thread(tpool_thread_18, started daemon 136731020912320)>, <Thread(tpool_thread_19, started daemon 136731012503232)>] {{(pid=86891) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 01:20:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-8b901f2f-b978-4d17-b478-201b709a96eb req-6bc31305-e1c1-4490-84bd-e94c003f9622 tempest-TestInstancesWithCinderVolumes-1418312596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:20:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-8b901f2f-b978-4d17-b478-201b709a96eb req-6bc31305-e1c1-4490-84bd-e94c003f9622 tempest-TestInstancesWithCinderVolumes-1418312596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:20:04 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d77093f-e73a-4971-a75f-63fe083d9feb]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:20:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-8b901f2f-b978-4d17-b478-201b709a96eb req-6bc31305-e1c1-4490-84bd-e94c003f9622 tempest-TestInstancesWithCinderVolumes-1418312596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1e97b278-7ffc-4df6-9f1f-b5e19c742d25 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:20:04 devstack sudo[101685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1e97b278-7ffc-4df6-9f1f-b5e19c742d25
Jul 03 01:20:04 devstack sudo[101685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:20:05 devstack sudo[101685]: pam_unix(sudo:session): session closed for user root
Jul 03 01:20:05 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-8b901f2f-b978-4d17-b478-201b709a96eb req-6bc31305-e1c1-4490-84bd-e94c003f9622 tempest-TestInstancesWithCinderVolumes-1418312596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1e97b278-7ffc-4df6-9f1f-b5e19c742d25" returned: 0 in 0.802s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:20:05 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-8b901f2f-b978-4d17-b478-201b709a96eb req-6bc31305-e1c1-4490-84bd-e94c003f9622 tempest-TestInstancesWithCinderVolumes-1418312596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.822s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:20:05 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [req-8b901f2f-b978-4d17-b478-201b709a96eb req-6bc31305-e1c1-4490-84bd-e94c003f9622 tempest-TestInstancesWithCinderVolumes-1418312596 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3', 'name': 'volume-1e97b278-7ffc-4df6-9f1f-b5e19c742d25', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '58dfca3d-e618-4038-bd75-91d043fa841c', 'enforce_multipath': True} {{(pid=86891) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 01:20:05 devstack cinder-volume[86891]: INFO cinder.volume.manager [req-8b901f2f-b978-4d17-b478-201b709a96eb req-6bc31305-e1c1-4490-84bd-e94c003f9622 tempest-TestInstancesWithCinderVolumes-1418312596 None] attachment_update completed successfully.
Jul 03 01:20:14 devstack cinder-volume[86891]: INFO cinder.volume.manager [req-b7784e7f-0fd4-46dc-bc99-8a984814bec1 req-170b5122-d43e-47b9-b57b-e4d1ae2f799d tempest-TestInstancesWithCinderVolumes-1418312596 None] Terminate volume connection completed successfully.
Jul 03 01:20:14 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [req-b7784e7f-0fd4-46dc-bc99-8a984814bec1 req-170b5122-d43e-47b9-b57b-e4d1ae2f799d tempest-TestInstancesWithCinderVolumes-1418312596 None] Deleting attachment 51b40c63-521c-4ee4-a68c-b782f7908124. {{(pid=86891) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 01:20:16 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-0bc7ff3e-592c-4490-9444-828c57d7b470 tempest-TestInstancesWithCinderVolumes-1418312596 None] Acquiring lock "cinder-47a2c419-6de4-4354-ab8e-f99046be195a-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:20:16 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-0bc7ff3e-592c-4490-9444-828c57d7b470 tempest-TestInstancesWithCinderVolumes-1418312596 None] Lock "cinder-47a2c419-6de4-4354-ab8e-f99046be195a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:20:16 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-0bc7ff3e-592c-4490-9444-828c57d7b470 tempest-TestInstancesWithCinderVolumes-1418312596 None] Acquiring lock "cinder-quobyte-47a2c419-6de4-4354-ab8e-f99046be195a" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:20:16 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-0bc7ff3e-592c-4490-9444-828c57d7b470 tempest-TestInstancesWithCinderVolumes-1418312596 None] Lock "cinder-quobyte-47a2c419-6de4-4354-ab8e-f99046be195a" acquired by "delete_volume" :: waited 0.015s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:20:16 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66a96b6-22e9-4a99-be94-bfff700978d8]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:20:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0bc7ff3e-592c-4490-9444-828c57d7b470 tempest-TestInstancesWithCinderVolumes-1418312596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-47a2c419-6de4-4354-ab8e-f99046be195a {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:20:16 devstack sudo[101740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-47a2c419-6de4-4354-ab8e-f99046be195a
Jul 03 01:20:16 devstack sudo[101740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:20:17 devstack sudo[101740]: pam_unix(sudo:session): session closed for user root
Jul 03 01:20:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0bc7ff3e-592c-4490-9444-828c57d7b470 tempest-TestInstancesWithCinderVolumes-1418312596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-47a2c419-6de4-4354-ab8e-f99046be195a" returned: 0 in 0.807s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:20:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0bc7ff3e-592c-4490-9444-828c57d7b470 tempest-TestInstancesWithCinderVolumes-1418312596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-47a2c419-6de4-4354-ab8e-f99046be195a {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:20:17 devstack sudo[101747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-47a2c419-6de4-4354-ab8e-f99046be195a
Jul 03 01:20:17 devstack sudo[101747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:20:17 devstack sudo[101747]: pam_unix(sudo:session): session closed for user root
Jul 03 01:20:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0bc7ff3e-592c-4490-9444-828c57d7b470 tempest-TestInstancesWithCinderVolumes-1418312596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-47a2c419-6de4-4354-ab8e-f99046be195a" returned: 0 in 0.688s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:20:17 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-0bc7ff3e-592c-4490-9444-828c57d7b470 tempest-TestInstancesWithCinderVolumes-1418312596 None] Lock "cinder-quobyte-47a2c419-6de4-4354-ab8e-f99046be195a" released by "delete_volume" :: held 1.541s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:20:17 devstack cinder-volume[86891]: WARNING cinder.quota [None req-0bc7ff3e-592c-4490-9444-828c57d7b470 tempest-TestInstancesWithCinderVolumes-1418312596 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2064160147-38443335 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2064160147-38443335, it is now deprecated. Please use the default quota class for default quota.
Jul 03 01:20:17 devstack cinder-volume[86891]: WARNING cinder.quota [None req-0bc7ff3e-592c-4490-9444-828c57d7b470 tempest-TestInstancesWithCinderVolumes-1418312596 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2064160147-38443335 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2064160147-38443335, it is now deprecated. Please use the default quota class for default quota.
Jul 03 01:20:17 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-0bc7ff3e-592c-4490-9444-828c57d7b470 tempest-TestInstancesWithCinderVolumes-1418312596 None] Created reservations ['b607f9a1-90a9-4b43-8f24-9e7495775d53', '42b4b8ea-3a20-46b4-bd3c-f3bc68216764', 'd282809d-e296-4a5e-b0ee-40553eb92380', '0fe651a6-d002-4430-9713-e0d796573535'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:20:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-0bc7ff3e-592c-4490-9444-828c57d7b470 tempest-TestInstancesWithCinderVolumes-1418312596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:20:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-0bc7ff3e-592c-4490-9444-828c57d7b470 tempest-TestInstancesWithCinderVolumes-1418312596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:20:17 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-0bc7ff3e-592c-4490-9444-828c57d7b470 tempest-TestInstancesWithCinderVolumes-1418312596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:20:17 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-0bc7ff3e-592c-4490-9444-828c57d7b470 tempest-TestInstancesWithCinderVolumes-1418312596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:20:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-0bc7ff3e-592c-4490-9444-828c57d7b470 tempest-TestInstancesWithCinderVolumes-1418312596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:20:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0bc7ff3e-592c-4490-9444-828c57d7b470 tempest-TestInstancesWithCinderVolumes-1418312596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:20:17 devstack sudo[101750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:20:17 devstack sudo[101750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:20:18 devstack sudo[101750]: pam_unix(sudo:session): session closed for user root
Jul 03 01:20:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0bc7ff3e-592c-4490-9444-828c57d7b470 tempest-TestInstancesWithCinderVolumes-1418312596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.657s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:20:18 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-0bc7ff3e-592c-4490-9444-828c57d7b470 tempest-TestInstancesWithCinderVolumes-1418312596 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:20:18 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-0bc7ff3e-592c-4490-9444-828c57d7b470 tempest-TestInstancesWithCinderVolumes-1418312596 None] Deleted volume successfully.
Jul 03 01:20:18 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-0bc7ff3e-592c-4490-9444-828c57d7b470 tempest-TestInstancesWithCinderVolumes-1418312596 None] Lock "cinder-47a2c419-6de4-4354-ab8e-f99046be195a-delete_volume" released by "delete_volume" :: held 2.401s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:20:20 devstack cinder-volume[86891]: INFO cinder.volume.manager [req-0e3f4bae-6009-4674-9eb9-b057481ad3ea req-ff8ff915-18d0-42b4-b810-528baf5daec0 tempest-TestInstancesWithCinderVolumes-1418312596 None] Terminate volume connection completed successfully.
Jul 03 01:20:20 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [req-0e3f4bae-6009-4674-9eb9-b057481ad3ea req-ff8ff915-18d0-42b4-b810-528baf5daec0 tempest-TestInstancesWithCinderVolumes-1418312596 None] Deleting attachment 58dfca3d-e618-4038-bd75-91d043fa841c. {{(pid=86891) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 01:20:22 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-327c4344-e119-49ae-89a5-b8ba20d485ea tempest-TestInstancesWithCinderVolumes-1418312596 None] Acquiring lock "cinder-1e97b278-7ffc-4df6-9f1f-b5e19c742d25-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:20:22 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-327c4344-e119-49ae-89a5-b8ba20d485ea tempest-TestInstancesWithCinderVolumes-1418312596 None] Lock "cinder-1e97b278-7ffc-4df6-9f1f-b5e19c742d25-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:20:22 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-327c4344-e119-49ae-89a5-b8ba20d485ea tempest-TestInstancesWithCinderVolumes-1418312596 None] Acquiring lock "cinder-quobyte-1e97b278-7ffc-4df6-9f1f-b5e19c742d25" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:20:22 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-327c4344-e119-49ae-89a5-b8ba20d485ea tempest-TestInstancesWithCinderVolumes-1418312596 None] Lock "cinder-quobyte-1e97b278-7ffc-4df6-9f1f-b5e19c742d25" acquired by "delete_volume" :: waited 0.020s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:20:22 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[d87e72b3-ab1f-4cad-9fc2-8966b656dbb0]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:20:22 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-327c4344-e119-49ae-89a5-b8ba20d485ea tempest-TestInstancesWithCinderVolumes-1418312596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1e97b278-7ffc-4df6-9f1f-b5e19c742d25 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:20:22 devstack sudo[101781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1e97b278-7ffc-4df6-9f1f-b5e19c742d25
Jul 03 01:20:22 devstack sudo[101781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:20:23 devstack sudo[101781]: pam_unix(sudo:session): session closed for user root
Jul 03 01:20:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-327c4344-e119-49ae-89a5-b8ba20d485ea tempest-TestInstancesWithCinderVolumes-1418312596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1e97b278-7ffc-4df6-9f1f-b5e19c742d25" returned: 0 in 0.773s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:20:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-327c4344-e119-49ae-89a5-b8ba20d485ea tempest-TestInstancesWithCinderVolumes-1418312596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1e97b278-7ffc-4df6-9f1f-b5e19c742d25 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:20:23 devstack sudo[101786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1e97b278-7ffc-4df6-9f1f-b5e19c742d25
Jul 03 01:20:23 devstack sudo[101786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:20:24 devstack sudo[101786]: pam_unix(sudo:session): session closed for user root
Jul 03 01:20:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-327c4344-e119-49ae-89a5-b8ba20d485ea tempest-TestInstancesWithCinderVolumes-1418312596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1e97b278-7ffc-4df6-9f1f-b5e19c742d25" returned: 0 in 0.791s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:20:24 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-327c4344-e119-49ae-89a5-b8ba20d485ea tempest-TestInstancesWithCinderVolumes-1418312596 None] Lock "cinder-quobyte-1e97b278-7ffc-4df6-9f1f-b5e19c742d25" released by "delete_volume" :: held 1.615s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:20:24 devstack cinder-volume[86891]: WARNING cinder.quota [None req-327c4344-e119-49ae-89a5-b8ba20d485ea tempest-TestInstancesWithCinderVolumes-1418312596 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2098493059-1856986395 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2098493059-1856986395, it is now deprecated. Please use the default quota class for default quota.
Jul 03 01:20:24 devstack cinder-volume[86891]: WARNING cinder.quota [None req-327c4344-e119-49ae-89a5-b8ba20d485ea tempest-TestInstancesWithCinderVolumes-1418312596 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2098493059-1856986395 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2098493059-1856986395, it is now deprecated. Please use the default quota class for default quota.
Jul 03 01:20:24 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-327c4344-e119-49ae-89a5-b8ba20d485ea tempest-TestInstancesWithCinderVolumes-1418312596 None] Created reservations ['28dec188-9f83-45d9-be8d-9bb85f9996b5', '43abd5b9-dc9b-4978-9db5-f2b89d3891ff', '0ebe4ccb-e318-4ce5-9f8e-aba1039067e9', 'eb13db91-00f5-4c42-984d-f28234eaf11c'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:20:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-327c4344-e119-49ae-89a5-b8ba20d485ea tempest-TestInstancesWithCinderVolumes-1418312596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:20:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-327c4344-e119-49ae-89a5-b8ba20d485ea tempest-TestInstancesWithCinderVolumes-1418312596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:20:24 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-327c4344-e119-49ae-89a5-b8ba20d485ea tempest-TestInstancesWithCinderVolumes-1418312596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:20:24 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-327c4344-e119-49ae-89a5-b8ba20d485ea tempest-TestInstancesWithCinderVolumes-1418312596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:20:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-327c4344-e119-49ae-89a5-b8ba20d485ea tempest-TestInstancesWithCinderVolumes-1418312596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:20:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-327c4344-e119-49ae-89a5-b8ba20d485ea tempest-TestInstancesWithCinderVolumes-1418312596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:20:24 devstack sudo[101790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:20:24 devstack sudo[101790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:20:25 devstack sudo[101790]: pam_unix(sudo:session): session closed for user root
Jul 03 01:20:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-327c4344-e119-49ae-89a5-b8ba20d485ea tempest-TestInstancesWithCinderVolumes-1418312596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.929s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:20:25 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-327c4344-e119-49ae-89a5-b8ba20d485ea tempest-TestInstancesWithCinderVolumes-1418312596 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:20:25 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-327c4344-e119-49ae-89a5-b8ba20d485ea tempest-TestInstancesWithCinderVolumes-1418312596 None] Deleted volume successfully.
Jul 03 01:20:25 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-327c4344-e119-49ae-89a5-b8ba20d485ea tempest-TestInstancesWithCinderVolumes-1418312596 None] Lock "cinder-1e97b278-7ffc-4df6-9f1f-b5e19c742d25-delete_volume" released by "delete_volume" :: held 2.838s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:20:29 devstack cinder-volume[86891]: INFO cinder.volume.manager [req-30f6965a-eccb-49f1-ab23-ad89a5a172be req-bac6da0a-3587-4cbe-b657-42c94d0aa27d tempest-TestInstancesWithCinderVolumes-1418312596 None] Terminate volume connection completed successfully.
Jul 03 01:20:29 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [req-30f6965a-eccb-49f1-ab23-ad89a5a172be req-bac6da0a-3587-4cbe-b657-42c94d0aa27d tempest-TestInstancesWithCinderVolumes-1418312596 None] Deleting attachment 298c2e82-130f-48d9-a351-4346f01db7ec. {{(pid=86891) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 01:20:29 devstack cinder-volume[86891]: INFO cinder.volume.manager [req-aa8fde5a-c0bf-4cde-b6f7-73f32bb068ad req-b285f49f-0850-44f5-9f47-d4bca14e55d6 tempest-TestMinimumBasicScenario-1965106343 None] Terminate volume connection completed successfully.
Jul 03 01:20:29 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [req-aa8fde5a-c0bf-4cde-b6f7-73f32bb068ad req-b285f49f-0850-44f5-9f47-d4bca14e55d6 tempest-TestMinimumBasicScenario-1965106343 None] Deleting attachment e2bd971b-10bd-42a2-a940-09d6afb2acf8. {{(pid=86891) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 01:20:31 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-06ac3f3b-6371-4a02-9b6a-8d6076fb8304 tempest-TestMinimumBasicScenario-1965106343 None] Acquiring lock "cinder-df719e77-2b0e-4605-9787-9617ee4c23d5-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:20:31 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-06ac3f3b-6371-4a02-9b6a-8d6076fb8304 tempest-TestMinimumBasicScenario-1965106343 None] Lock "cinder-df719e77-2b0e-4605-9787-9617ee4c23d5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:20:31 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-06ac3f3b-6371-4a02-9b6a-8d6076fb8304 tempest-TestMinimumBasicScenario-1965106343 None] Acquiring lock "cinder-quobyte-df719e77-2b0e-4605-9787-9617ee4c23d5" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:20:31 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-06ac3f3b-6371-4a02-9b6a-8d6076fb8304 tempest-TestMinimumBasicScenario-1965106343 None] Lock "cinder-quobyte-df719e77-2b0e-4605-9787-9617ee4c23d5" acquired by "delete_volume" :: waited 0.016s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:20:31 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d00b61-e059-4b9e-a035-f7bb2556342b]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:20:31 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-06ac3f3b-6371-4a02-9b6a-8d6076fb8304 tempest-TestMinimumBasicScenario-1965106343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-df719e77-2b0e-4605-9787-9617ee4c23d5 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:20:31 devstack sudo[101883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-df719e77-2b0e-4605-9787-9617ee4c23d5
Jul 03 01:20:31 devstack sudo[101883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:20:32 devstack sudo[101883]: pam_unix(sudo:session): session closed for user root
Jul 03 01:20:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-06ac3f3b-6371-4a02-9b6a-8d6076fb8304 tempest-TestMinimumBasicScenario-1965106343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-df719e77-2b0e-4605-9787-9617ee4c23d5" returned: 0 in 0.774s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:20:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-06ac3f3b-6371-4a02-9b6a-8d6076fb8304 tempest-TestMinimumBasicScenario-1965106343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-df719e77-2b0e-4605-9787-9617ee4c23d5 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:20:32 devstack sudo[101888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-df719e77-2b0e-4605-9787-9617ee4c23d5
Jul 03 01:20:32 devstack sudo[101888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:20:33 devstack sudo[101888]: pam_unix(sudo:session): session closed for user root
Jul 03 01:20:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-06ac3f3b-6371-4a02-9b6a-8d6076fb8304 tempest-TestMinimumBasicScenario-1965106343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-df719e77-2b0e-4605-9787-9617ee4c23d5" returned: 0 in 0.617s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:20:33 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-06ac3f3b-6371-4a02-9b6a-8d6076fb8304 tempest-TestMinimumBasicScenario-1965106343 None] Lock "cinder-quobyte-df719e77-2b0e-4605-9787-9617ee4c23d5" released by "delete_volume" :: held 1.432s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:20:33 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-06ac3f3b-6371-4a02-9b6a-8d6076fb8304 tempest-TestMinimumBasicScenario-1965106343 None] Created reservations ['1039f4c9-9209-475d-b87b-9828c575306f', 'bc5acaa1-25e1-434d-8610-282c6aa1724a', '52a53f25-f67f-4e86-bf21-960161a7b4fa', '782f8eae-6966-49bd-b69a-515fc256ae7b'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:20:33 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5ca6279e-7888-4f29-a061-d051249db0b5 tempest-TestInstancesWithCinderVolumes-1418312596 None] Acquiring lock "cinder-11f94ee7-3bfd-4ff2-95d3-321609d90c22-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:20:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-06ac3f3b-6371-4a02-9b6a-8d6076fb8304 tempest-TestMinimumBasicScenario-1965106343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:20:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-06ac3f3b-6371-4a02-9b6a-8d6076fb8304 tempest-TestMinimumBasicScenario-1965106343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:20:33 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-06ac3f3b-6371-4a02-9b6a-8d6076fb8304 tempest-TestMinimumBasicScenario-1965106343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:20:33 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-06ac3f3b-6371-4a02-9b6a-8d6076fb8304 tempest-TestMinimumBasicScenario-1965106343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:20:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-06ac3f3b-6371-4a02-9b6a-8d6076fb8304 tempest-TestMinimumBasicScenario-1965106343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:20:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-06ac3f3b-6371-4a02-9b6a-8d6076fb8304 tempest-TestMinimumBasicScenario-1965106343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:20:33 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5ca6279e-7888-4f29-a061-d051249db0b5 tempest-TestInstancesWithCinderVolumes-1418312596 None] Lock "cinder-11f94ee7-3bfd-4ff2-95d3-321609d90c22-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:20:33 devstack sudo[101891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:20:33 devstack sudo[101891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:20:33 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5ca6279e-7888-4f29-a061-d051249db0b5 tempest-TestInstancesWithCinderVolumes-1418312596 None] Acquiring lock "cinder-quobyte-11f94ee7-3bfd-4ff2-95d3-321609d90c22" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:20:33 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5ca6279e-7888-4f29-a061-d051249db0b5 tempest-TestInstancesWithCinderVolumes-1418312596 None] Lock "cinder-quobyte-11f94ee7-3bfd-4ff2-95d3-321609d90c22" acquired by "delete_volume" :: waited 0.018s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:20:33 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8423bda-399f-419d-b943-6e01ab43dc27]: (4, 'raw') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:20:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5ca6279e-7888-4f29-a061-d051249db0b5 tempest-TestInstancesWithCinderVolumes-1418312596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-11f94ee7-3bfd-4ff2-95d3-321609d90c22 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:20:33 devstack sudo[101893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-11f94ee7-3bfd-4ff2-95d3-321609d90c22
Jul 03 01:20:33 devstack sudo[101893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:20:33 devstack sudo[101891]: pam_unix(sudo:session): session closed for user root
Jul 03 01:20:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-06ac3f3b-6371-4a02-9b6a-8d6076fb8304 tempest-TestMinimumBasicScenario-1965106343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.734s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:20:33 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-06ac3f3b-6371-4a02-9b6a-8d6076fb8304 tempest-TestMinimumBasicScenario-1965106343 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:20:33 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-06ac3f3b-6371-4a02-9b6a-8d6076fb8304 tempest-TestMinimumBasicScenario-1965106343 None] Deleted volume successfully.
Jul 03 01:20:33 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-06ac3f3b-6371-4a02-9b6a-8d6076fb8304 tempest-TestMinimumBasicScenario-1965106343 None] Lock "cinder-df719e77-2b0e-4605-9787-9617ee4c23d5-delete_volume" released by "delete_volume" :: held 2.406s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:20:34 devstack sudo[101893]: pam_unix(sudo:session): session closed for user root
Jul 03 01:20:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5ca6279e-7888-4f29-a061-d051249db0b5 tempest-TestInstancesWithCinderVolumes-1418312596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-11f94ee7-3bfd-4ff2-95d3-321609d90c22" returned: 0 in 0.782s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:20:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5ca6279e-7888-4f29-a061-d051249db0b5 tempest-TestInstancesWithCinderVolumes-1418312596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-11f94ee7-3bfd-4ff2-95d3-321609d90c22 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:20:34 devstack sudo[101898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-11f94ee7-3bfd-4ff2-95d3-321609d90c22
Jul 03 01:20:34 devstack sudo[101898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:20:34 devstack sudo[101898]: pam_unix(sudo:session): session closed for user root
Jul 03 01:20:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5ca6279e-7888-4f29-a061-d051249db0b5 tempest-TestInstancesWithCinderVolumes-1418312596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-11f94ee7-3bfd-4ff2-95d3-321609d90c22" returned: 1 in 0.805s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:20:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5ca6279e-7888-4f29-a061-d051249db0b5 tempest-TestInstancesWithCinderVolumes-1418312596 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-11f94ee7-3bfd-4ff2-95d3-321609d90c22' failed. Not Retrying. {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 01:20:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5ca6279e-7888-4f29-a061-d051249db0b5 tempest-TestInstancesWithCinderVolumes-1418312596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-11f94ee7-3bfd-4ff2-95d3-321609d90c22 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:20:34 devstack sudo[101909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-11f94ee7-3bfd-4ff2-95d3-321609d90c22
Jul 03 01:20:34 devstack sudo[101909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:20:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5ca6279e-7888-4f29-a061-d051249db0b5 tempest-TestInstancesWithCinderVolumes-1418312596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-11f94ee7-3bfd-4ff2-95d3-321609d90c22" returned: 0 in 0.981s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:20:35 devstack sudo[101909]: pam_unix(sudo:session): session closed for user root
Jul 03 01:20:35 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5ca6279e-7888-4f29-a061-d051249db0b5 tempest-TestInstancesWithCinderVolumes-1418312596 None] Lock "cinder-quobyte-11f94ee7-3bfd-4ff2-95d3-321609d90c22" released by "delete_volume" :: held 2.671s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:20:35 devstack cinder-volume[86891]: WARNING cinder.quota [None req-5ca6279e-7888-4f29-a061-d051249db0b5 tempest-TestInstancesWithCinderVolumes-1418312596 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-861525723-733293728 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-861525723-733293728, it is now deprecated. Please use the default quota class for default quota.
Jul 03 01:20:35 devstack cinder-volume[86891]: WARNING cinder.quota [None req-5ca6279e-7888-4f29-a061-d051249db0b5 tempest-TestInstancesWithCinderVolumes-1418312596 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-861525723-733293728 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-861525723-733293728, it is now deprecated. Please use the default quota class for default quota.
Jul 03 01:20:35 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-5ca6279e-7888-4f29-a061-d051249db0b5 tempest-TestInstancesWithCinderVolumes-1418312596 None] Created reservations ['1a21cfa1-2d44-48f6-acef-b8a6efc7961b', 'b0bd56a0-65a7-48cf-914f-bbb5007da31c', 'f5ae0596-f7ef-4062-96d6-f67f4c17ffb5', '007c2141-33be-473d-a0b8-a9a47df6dedc'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:20:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-5ca6279e-7888-4f29-a061-d051249db0b5 tempest-TestInstancesWithCinderVolumes-1418312596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:20:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-5ca6279e-7888-4f29-a061-d051249db0b5 tempest-TestInstancesWithCinderVolumes-1418312596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:20:36 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-5ca6279e-7888-4f29-a061-d051249db0b5 tempest-TestInstancesWithCinderVolumes-1418312596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:20:36 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-5ca6279e-7888-4f29-a061-d051249db0b5 tempest-TestInstancesWithCinderVolumes-1418312596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:20:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-5ca6279e-7888-4f29-a061-d051249db0b5 tempest-TestInstancesWithCinderVolumes-1418312596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:20:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5ca6279e-7888-4f29-a061-d051249db0b5 tempest-TestInstancesWithCinderVolumes-1418312596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:20:36 devstack sudo[101986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:20:36 devstack sudo[101986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:20:36 devstack sudo[101986]: pam_unix(sudo:session): session closed for user root
Jul 03 01:20:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5ca6279e-7888-4f29-a061-d051249db0b5 tempest-TestInstancesWithCinderVolumes-1418312596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.709s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:20:36 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-5ca6279e-7888-4f29-a061-d051249db0b5 tempest-TestInstancesWithCinderVolumes-1418312596 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:20:36 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-5ca6279e-7888-4f29-a061-d051249db0b5 tempest-TestInstancesWithCinderVolumes-1418312596 None] Deleted volume successfully.
Jul 03 01:20:36 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5ca6279e-7888-4f29-a061-d051249db0b5 tempest-TestInstancesWithCinderVolumes-1418312596 None] Lock "cinder-11f94ee7-3bfd-4ff2-95d3-321609d90c22-delete_volume" released by "delete_volume" :: held 3.632s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:20:46 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:SELECT=31,cinder:UPDATE=34,cinder:INSERT=9,cinder:DELETE=2 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:20:46 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:SELECT=39,cinder:UPDATE=36,cinder:INSERT=7,cinder:DELETE=2 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:21:01 devstack cinder-volume[86891]: DEBUG oslo_service.periodic_task [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86891) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 01:21:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:21:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:21:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:21:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:21:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:21:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:21:02 devstack sudo[102019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:21:02 devstack sudo[102019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:21:02 devstack sudo[102019]: pam_unix(sudo:session): session closed for user root
Jul 03 01:21:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.731s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:21:02 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:21:02 devstack cinder-volume[86891]: DEBUG oslo_service.periodic_task [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running periodic task VolumeManager._thread_info {{(pid=86891) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 01:21:02 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] thread count: 28 {{(pid=86891) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 01:21:02 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] thread info: [<_MainThread(MainThread, started 136731296534656)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136731184953280)>, <Thread(Thread-3 (stat_writer), started daemon 136731184058816)>, <Thread(Rabbit-heartbeat, started daemon 136731184846080)>, <Thread(Thread-5 (_runner), started daemon 136731182936576)>, <Thread(Thread-7 (_runner), started daemon 136731182954944)>, <Thread(fd_logger, started daemon 136731181916416)>, <Thread(privsep_reader, started daemon 136731180942208)>, <Thread(tpool_thread_0, started daemon 136731172161216)>, <Thread(tpool_thread_1, started daemon 136731163768512)>, <Thread(tpool_thread_2, started daemon 136731155375808)>, <Thread(tpool_thread_3, started daemon 136731146983104)>, <Thread(tpool_thread_4, started daemon 136731138590400)>, <Thread(tpool_thread_5, started daemon 136731130197696)>, <Thread(tpool_thread_6, started daemon 136731121804992)>, <Thread(tpool_thread_7, started daemon 136731113412288)>, <Thread(tpool_thread_8, started daemon 136731105003200)>, <Thread(tpool_thread_9, started daemon 136731096594112)>, <Thread(tpool_thread_10, started daemon 136731088185024)>, <Thread(tpool_thread_11, started daemon 136731079775936)>, <Thread(tpool_thread_12, started daemon 136731071366848)>, <Thread(tpool_thread_13, started daemon 136731062957760)>, <Thread(tpool_thread_14, started daemon 136731054548672)>, <Thread(tpool_thread_15, started daemon 136731046139584)>, <Thread(tpool_thread_16, started daemon 136731037730496)>, <Thread(tpool_thread_17, started daemon 136731029321408)>, <Thread(tpool_thread_18, started daemon 136731020912320)>, <Thread(tpool_thread_19, started daemon 136731012503232)>] {{(pid=86891) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 01:21:08 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:SELECT=1 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:21:08 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:UPDATE=1 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:21:12 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-f75f1de6-5e2f-437d-9d9e-087801a1b80d tempest-TestServerVolumeAttachmentScenario-2032709709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:21:12 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f75f1de6-5e2f-437d-9d9e-087801a1b80d tempest-TestServerVolumeAttachmentScenario-2032709709 None] Flow 'volume_create_manager' (ea364fac-7777-422f-aec5-3ff5eddbc137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:21:12 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f75f1de6-5e2f-437d-9d9e-087801a1b80d tempest-TestServerVolumeAttachmentScenario-2032709709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f7f5f86-0802-4962-ae37-0dab9fbbc87f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:21:12 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f75f1de6-5e2f-437d-9d9e-087801a1b80d tempest-TestServerVolumeAttachmentScenario-2032709709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f7f5f86-0802-4962-ae37-0dab9fbbc87f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:21:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1920318187',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cde6dbba-bd4d-4b73-bb5f-e484b1890e5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e135c6cce5334fe5881787ebb0bbe060',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:21:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:21:13Z,use_quota=True,user_id='9d9867ca778d43e5bd73b7c2c2380195',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:21:12 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f75f1de6-5e2f-437d-9d9e-087801a1b80d tempest-TestServerVolumeAttachmentScenario-2032709709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b043b8e-c1ab-47c9-9f0d-24d3f27074a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:21:12 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f75f1de6-5e2f-437d-9d9e-087801a1b80d tempest-TestServerVolumeAttachmentScenario-2032709709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b043b8e-c1ab-47c9-9f0d-24d3f27074a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:21:12 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f75f1de6-5e2f-437d-9d9e-087801a1b80d tempest-TestServerVolumeAttachmentScenario-2032709709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (605cfb29-0341-43ee-ac33-8911ea7b283c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:21:12 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f75f1de6-5e2f-437d-9d9e-087801a1b80d tempest-TestServerVolumeAttachmentScenario-2032709709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (605cfb29-0341-43ee-ac33-8911ea7b283c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cde6dbba-bd4d-4b73-bb5f-e484b1890e5e', 'volume_name': 'volume-cde6dbba-bd4d-4b73-bb5f-e484b1890e5e', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:21:12 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f75f1de6-5e2f-437d-9d9e-087801a1b80d tempest-TestServerVolumeAttachmentScenario-2032709709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11adf14b-0923-4719-81d6-34ddfe4abb75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:21:12 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f75f1de6-5e2f-437d-9d9e-087801a1b80d tempest-TestServerVolumeAttachmentScenario-2032709709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11adf14b-0923-4719-81d6-34ddfe4abb75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:21:12 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f75f1de6-5e2f-437d-9d9e-087801a1b80d tempest-TestServerVolumeAttachmentScenario-2032709709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32951ee4-01f0-4c3d-98f8-2647c2609ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:21:12 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-f75f1de6-5e2f-437d-9d9e-087801a1b80d tempest-TestServerVolumeAttachmentScenario-2032709709 None] Volume cde6dbba-bd4d-4b73-bb5f-e484b1890e5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cde6dbba-bd4d-4b73-bb5f-e484b1890e5e', 'volume_size': 1}
Jul 03 01:21:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f75f1de6-5e2f-437d-9d9e-087801a1b80d tempest-TestServerVolumeAttachmentScenario-2032709709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:21:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f75f1de6-5e2f-437d-9d9e-087801a1b80d tempest-TestServerVolumeAttachmentScenario-2032709709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:21:12 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-f75f1de6-5e2f-437d-9d9e-087801a1b80d tempest-TestServerVolumeAttachmentScenario-2032709709 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:21:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1920318187',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cde6dbba-bd4d-4b73-bb5f-e484b1890e5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e135c6cce5334fe5881787ebb0bbe060',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:21:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:21:13Z,use_quota=True,user_id='9d9867ca778d43e5bd73b7c2c2380195',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:21:12 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-f75f1de6-5e2f-437d-9d9e-087801a1b80d tempest-TestServerVolumeAttachmentScenario-2032709709 None] Creating volume cde6dbba-bd4d-4b73-bb5f-e484b1890e5e {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:21:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f75f1de6-5e2f-437d-9d9e-087801a1b80d tempest-TestServerVolumeAttachmentScenario-2032709709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:21:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f75f1de6-5e2f-437d-9d9e-087801a1b80d tempest-TestServerVolumeAttachmentScenario-2032709709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:21:12 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-f75f1de6-5e2f-437d-9d9e-087801a1b80d tempest-TestServerVolumeAttachmentScenario-2032709709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:21:12 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-f75f1de6-5e2f-437d-9d9e-087801a1b80d tempest-TestServerVolumeAttachmentScenario-2032709709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:21:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f75f1de6-5e2f-437d-9d9e-087801a1b80d tempest-TestServerVolumeAttachmentScenario-2032709709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:21:12 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-f75f1de6-5e2f-437d-9d9e-087801a1b80d tempest-TestServerVolumeAttachmentScenario-2032709709 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:21:12 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-f75f1de6-5e2f-437d-9d9e-087801a1b80d tempest-TestServerVolumeAttachmentScenario-2032709709 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:21:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f75f1de6-5e2f-437d-9d9e-087801a1b80d tempest-TestServerVolumeAttachmentScenario-2032709709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cde6dbba-bd4d-4b73-bb5f-e484b1890e5e 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:21:12 devstack sudo[102025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cde6dbba-bd4d-4b73-bb5f-e484b1890e5e 1073741824
Jul 03 01:21:12 devstack sudo[102025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:21:13 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccfd07cd-6d77-4397-91f8-107c91eb1692 tempest-TestServerVolumeAttachmentScenario-2032709709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:21:13 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ccfd07cd-6d77-4397-91f8-107c91eb1692 tempest-TestServerVolumeAttachmentScenario-2032709709 None] Flow 'volume_create_manager' (5a989f82-25ed-40bf-967d-da2ec7e845f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:21:13 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ccfd07cd-6d77-4397-91f8-107c91eb1692 tempest-TestServerVolumeAttachmentScenario-2032709709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8f32f91-bc34-4dd3-a76c-8c7af1dbd4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:21:13 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ccfd07cd-6d77-4397-91f8-107c91eb1692 tempest-TestServerVolumeAttachmentScenario-2032709709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8f32f91-bc34-4dd3-a76c-8c7af1dbd4eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:21:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-983309681',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=246917a6-5f5b-4119-b879-cf9d7ceb3164,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e135c6cce5334fe5881787ebb0bbe060',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:21:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:21:13Z,use_quota=True,user_id='9d9867ca778d43e5bd73b7c2c2380195',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:21:13 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ccfd07cd-6d77-4397-91f8-107c91eb1692 tempest-TestServerVolumeAttachmentScenario-2032709709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3047404c-ab64-4e8f-b8c8-87ab00aca747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:21:13 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ccfd07cd-6d77-4397-91f8-107c91eb1692 tempest-TestServerVolumeAttachmentScenario-2032709709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3047404c-ab64-4e8f-b8c8-87ab00aca747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:21:13 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ccfd07cd-6d77-4397-91f8-107c91eb1692 tempest-TestServerVolumeAttachmentScenario-2032709709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (404ebda2-416a-4eac-b395-012bc7f06e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:21:13 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ccfd07cd-6d77-4397-91f8-107c91eb1692 tempest-TestServerVolumeAttachmentScenario-2032709709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (404ebda2-416a-4eac-b395-012bc7f06e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '246917a6-5f5b-4119-b879-cf9d7ceb3164', 'volume_name': 'volume-246917a6-5f5b-4119-b879-cf9d7ceb3164', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:21:13 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ccfd07cd-6d77-4397-91f8-107c91eb1692 tempest-TestServerVolumeAttachmentScenario-2032709709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87bb9c2e-b78f-460b-ba79-553786785509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:21:13 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ccfd07cd-6d77-4397-91f8-107c91eb1692 tempest-TestServerVolumeAttachmentScenario-2032709709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87bb9c2e-b78f-460b-ba79-553786785509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:21:13 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ccfd07cd-6d77-4397-91f8-107c91eb1692 tempest-TestServerVolumeAttachmentScenario-2032709709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c32cbc6b-5769-4571-bb94-a763039de6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:21:13 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-ccfd07cd-6d77-4397-91f8-107c91eb1692 tempest-TestServerVolumeAttachmentScenario-2032709709 None] Volume 246917a6-5f5b-4119-b879-cf9d7ceb3164: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-246917a6-5f5b-4119-b879-cf9d7ceb3164', 'volume_size': 1}
Jul 03 01:21:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-ccfd07cd-6d77-4397-91f8-107c91eb1692 tempest-TestServerVolumeAttachmentScenario-2032709709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:21:14 devstack sudo[102025]: pam_unix(sudo:session): session closed for user root
Jul 03 01:21:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f75f1de6-5e2f-437d-9d9e-087801a1b80d tempest-TestServerVolumeAttachmentScenario-2032709709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cde6dbba-bd4d-4b73-bb5f-e484b1890e5e 1073741824" returned: 0 in 1.219s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:21:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f75f1de6-5e2f-437d-9d9e-087801a1b80d tempest-TestServerVolumeAttachmentScenario-2032709709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cde6dbba-bd4d-4b73-bb5f-e484b1890e5e {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:21:14 devstack sudo[102031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cde6dbba-bd4d-4b73-bb5f-e484b1890e5e
Jul 03 01:21:14 devstack sudo[102031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:21:14 devstack sudo[102031]: pam_unix(sudo:session): session closed for user root
Jul 03 01:21:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f75f1de6-5e2f-437d-9d9e-087801a1b80d tempest-TestServerVolumeAttachmentScenario-2032709709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cde6dbba-bd4d-4b73-bb5f-e484b1890e5e" returned: 0 in 0.785s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:21:14 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-f75f1de6-5e2f-437d-9d9e-087801a1b80d tempest-TestServerVolumeAttachmentScenario-2032709709 None] <== create_volume: return (2070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:21:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f75f1de6-5e2f-437d-9d9e-087801a1b80d tempest-TestServerVolumeAttachmentScenario-2032709709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.073s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:21:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-ccfd07cd-6d77-4397-91f8-107c91eb1692 tempest-TestServerVolumeAttachmentScenario-2032709709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.559s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:21:14 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-ccfd07cd-6d77-4397-91f8-107c91eb1692 tempest-TestServerVolumeAttachmentScenario-2032709709 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:21:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-983309681',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=246917a6-5f5b-4119-b879-cf9d7ceb3164,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e135c6cce5334fe5881787ebb0bbe060',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:21:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:21:13Z,use_quota=True,user_id='9d9867ca778d43e5bd73b7c2c2380195',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:21:14 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-ccfd07cd-6d77-4397-91f8-107c91eb1692 tempest-TestServerVolumeAttachmentScenario-2032709709 None] Creating volume 246917a6-5f5b-4119-b879-cf9d7ceb3164 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:21:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-ccfd07cd-6d77-4397-91f8-107c91eb1692 tempest-TestServerVolumeAttachmentScenario-2032709709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:21:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-ccfd07cd-6d77-4397-91f8-107c91eb1692 tempest-TestServerVolumeAttachmentScenario-2032709709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:21:14 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-ccfd07cd-6d77-4397-91f8-107c91eb1692 tempest-TestServerVolumeAttachmentScenario-2032709709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:21:14 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-ccfd07cd-6d77-4397-91f8-107c91eb1692 tempest-TestServerVolumeAttachmentScenario-2032709709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:21:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-ccfd07cd-6d77-4397-91f8-107c91eb1692 tempest-TestServerVolumeAttachmentScenario-2032709709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:21:14 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-ccfd07cd-6d77-4397-91f8-107c91eb1692 tempest-TestServerVolumeAttachmentScenario-2032709709 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:21:14 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-ccfd07cd-6d77-4397-91f8-107c91eb1692 tempest-TestServerVolumeAttachmentScenario-2032709709 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:21:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-ccfd07cd-6d77-4397-91f8-107c91eb1692 tempest-TestServerVolumeAttachmentScenario-2032709709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-246917a6-5f5b-4119-b879-cf9d7ceb3164 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:21:14 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f75f1de6-5e2f-437d-9d9e-087801a1b80d tempest-TestServerVolumeAttachmentScenario-2032709709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32951ee4-01f0-4c3d-98f8-2647c2609ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cde6dbba-bd4d-4b73-bb5f-e484b1890e5e', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:21:14 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f75f1de6-5e2f-437d-9d9e-087801a1b80d tempest-TestServerVolumeAttachmentScenario-2032709709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0920e24b-b4dc-492c-bc19-f633dc5792e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:21:14 devstack sudo[102034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-246917a6-5f5b-4119-b879-cf9d7ceb3164 1073741824
Jul 03 01:21:14 devstack sudo[102034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:21:15 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-f75f1de6-5e2f-437d-9d9e-087801a1b80d tempest-TestServerVolumeAttachmentScenario-2032709709 None] Volume volume-cde6dbba-bd4d-4b73-bb5f-e484b1890e5e (cde6dbba-bd4d-4b73-bb5f-e484b1890e5e): created successfully
Jul 03 01:21:15 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f75f1de6-5e2f-437d-9d9e-087801a1b80d tempest-TestServerVolumeAttachmentScenario-2032709709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0920e24b-b4dc-492c-bc19-f633dc5792e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:21:15 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f75f1de6-5e2f-437d-9d9e-087801a1b80d tempest-TestServerVolumeAttachmentScenario-2032709709 None] Flow 'volume_create_manager' (ea364fac-7777-422f-aec5-3ff5eddbc137) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:21:15 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-f75f1de6-5e2f-437d-9d9e-087801a1b80d tempest-TestServerVolumeAttachmentScenario-2032709709 None] Created volume successfully.
Jul 03 01:21:16 devstack sudo[102034]: pam_unix(sudo:session): session closed for user root
Jul 03 01:21:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-ccfd07cd-6d77-4397-91f8-107c91eb1692 tempest-TestServerVolumeAttachmentScenario-2032709709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-246917a6-5f5b-4119-b879-cf9d7ceb3164 1073741824" returned: 0 in 1.138s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:21:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-ccfd07cd-6d77-4397-91f8-107c91eb1692 tempest-TestServerVolumeAttachmentScenario-2032709709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-246917a6-5f5b-4119-b879-cf9d7ceb3164 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:21:16 devstack sudo[102040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-246917a6-5f5b-4119-b879-cf9d7ceb3164
Jul 03 01:21:16 devstack sudo[102040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:21:17 devstack sudo[102040]: pam_unix(sudo:session): session closed for user root
Jul 03 01:21:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-ccfd07cd-6d77-4397-91f8-107c91eb1692 tempest-TestServerVolumeAttachmentScenario-2032709709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-246917a6-5f5b-4119-b879-cf9d7ceb3164" returned: 0 in 0.894s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:21:17 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-ccfd07cd-6d77-4397-91f8-107c91eb1692 tempest-TestServerVolumeAttachmentScenario-2032709709 None] <== create_volume: return (2095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:21:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-ccfd07cd-6d77-4397-91f8-107c91eb1692 tempest-TestServerVolumeAttachmentScenario-2032709709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.103s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:21:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ccfd07cd-6d77-4397-91f8-107c91eb1692 tempest-TestServerVolumeAttachmentScenario-2032709709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c32cbc6b-5769-4571-bb94-a763039de6d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-246917a6-5f5b-4119-b879-cf9d7ceb3164', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:21:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ccfd07cd-6d77-4397-91f8-107c91eb1692 tempest-TestServerVolumeAttachmentScenario-2032709709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8edb283b-7f24-4bc3-b989-ce8090235ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:21:17 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-ccfd07cd-6d77-4397-91f8-107c91eb1692 tempest-TestServerVolumeAttachmentScenario-2032709709 None] Volume volume-246917a6-5f5b-4119-b879-cf9d7ceb3164 (246917a6-5f5b-4119-b879-cf9d7ceb3164): created successfully
Jul 03 01:21:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ccfd07cd-6d77-4397-91f8-107c91eb1692 tempest-TestServerVolumeAttachmentScenario-2032709709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8edb283b-7f24-4bc3-b989-ce8090235ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:21:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ccfd07cd-6d77-4397-91f8-107c91eb1692 tempest-TestServerVolumeAttachmentScenario-2032709709 None] Flow 'volume_create_manager' (5a989f82-25ed-40bf-967d-da2ec7e845f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:21:17 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-ccfd07cd-6d77-4397-91f8-107c91eb1692 tempest-TestServerVolumeAttachmentScenario-2032709709 None] Created volume successfully.
Jul 03 01:21:23 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-c382202c-4dd8-45ee-a2a5-6fbf5b9e2bc7 tempest-TestShelveInstance-57035342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:21:23 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c382202c-4dd8-45ee-a2a5-6fbf5b9e2bc7 tempest-TestShelveInstance-57035342 None] Flow 'volume_create_manager' (ecabed9e-a8ef-4bcf-896f-fc9df2b068fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:21:23 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c382202c-4dd8-45ee-a2a5-6fbf5b9e2bc7 tempest-TestShelveInstance-57035342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dad8d1ff-4282-4567-9100-d3462a7f4d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:21:23 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c382202c-4dd8-45ee-a2a5-6fbf5b9e2bc7 tempest-TestShelveInstance-57035342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dad8d1ff-4282-4567-9100-d3462a7f4d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:21:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1251062675',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c9ba326-e4f6-474a-aea9-3c3d2466fcad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c01d9c8d34e4efe88b570f3170c5a01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:21:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:21:24Z,use_quota=True,user_id='303802aec4b34611a92253ddfadd049a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:21:23 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c382202c-4dd8-45ee-a2a5-6fbf5b9e2bc7 tempest-TestShelveInstance-57035342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (037b0c4f-df52-476f-9455-f0145e86a0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:21:23 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c382202c-4dd8-45ee-a2a5-6fbf5b9e2bc7 tempest-TestShelveInstance-57035342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (037b0c4f-df52-476f-9455-f0145e86a0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:21:23 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c382202c-4dd8-45ee-a2a5-6fbf5b9e2bc7 tempest-TestShelveInstance-57035342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7117cd4-fc1b-46a0-a096-d7b499553ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:21:23 devstack cinder-volume[86891]: DEBUG cinder.image.glance [None req-c382202c-4dd8-45ee-a2a5-6fbf5b9e2bc7 tempest-TestShelveInstance-57035342 None] Creating Keystone auth plugin from conf {{(pid=86891) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 03 01:21:24 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c382202c-4dd8-45ee-a2a5-6fbf5b9e2bc7 tempest-TestShelveInstance-57035342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7117cd4-fc1b-46a0-a096-d7b499553ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2c9ba326-e4f6-474a-aea9-3c3d2466fcad', 'volume_name': 'volume-2c9ba326-e4f6-474a-aea9-3c3d2466fcad', 'volume_size': 1, 'image_id': '65cceacb-879b-4111-919c-966899666f55', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/65cceacb-879b-4111-919c-966899666f55', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0d33e5361cf145ffa2791b827e46aea8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '65cceacb-879b-4111-919c-966899666f55', 'created_at': datetime.datetime(2026, 7, 2, 22, 57, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 22, 57, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/65cceacb-879b-4111-919c-966899666f55/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7c5b34fa8560>}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:21:24 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c382202c-4dd8-45ee-a2a5-6fbf5b9e2bc7 tempest-TestShelveInstance-57035342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6639f8e6-167d-46b1-9d15-c5cfeaac1dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:21:24 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c382202c-4dd8-45ee-a2a5-6fbf5b9e2bc7 tempest-TestShelveInstance-57035342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6639f8e6-167d-46b1-9d15-c5cfeaac1dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:21:24 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c382202c-4dd8-45ee-a2a5-6fbf5b9e2bc7 tempest-TestShelveInstance-57035342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5181dcc7-1f86-46a2-8862-eb776a42359b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:21:24 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-c382202c-4dd8-45ee-a2a5-6fbf5b9e2bc7 tempest-TestShelveInstance-57035342 None] Volume 2c9ba326-e4f6-474a-aea9-3c3d2466fcad: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2c9ba326-e4f6-474a-aea9-3c3d2466fcad', 'volume_size': 1, 'image_id': '65cceacb-879b-4111-919c-966899666f55', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/65cceacb-879b-4111-919c-966899666f55', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0d33e5361cf145ffa2791b827e46aea8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '65cceacb-879b-4111-919c-966899666f55', 'created_at': datetime.datetime(2026, 7, 2, 22, 57, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 22, 57, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/65cceacb-879b-4111-919c-966899666f55/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7c5b34fa8560>}
Jul 03 01:21:24 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-c382202c-4dd8-45ee-a2a5-6fbf5b9e2bc7 tempest-TestShelveInstance-57035342 None] Trying to clone 2c9ba326-e4f6-474a-aea9-3c3d2466fcad from image 65cceacb-879b-4111-919c-966899666f55 at location (None, [{'url': 'file:///opt/stack/data/glance/images/65cceacb-879b-4111-919c-966899666f55', 'metadata': {}}]). {{(pid=86891) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 03 01:21:24 devstack cinder-volume[86891]: DEBUG cinder.image.image_utils [None req-c382202c-4dd8-45ee-a2a5-6fbf5b9e2bc7 tempest-TestShelveInstance-57035342 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_65cceacb-879b-4111-919c-966899666f55_5o1i1jdydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86891) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 03 01:21:24 devstack cinder-volume[86891]: INFO cinder.image.image_utils [None req-c382202c-4dd8-45ee-a2a5-6fbf5b9e2bc7 tempest-TestShelveInstance-57035342 None] Image download 20.69 MB at 20.69 MB/s
Jul 03 01:21:24 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b0ddda-9a2e-407b-87c6-5c4ce45be6d1]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:21:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c382202c-4dd8-45ee-a2a5-6fbf5b9e2bc7 tempest-TestShelveInstance-57035342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_65cceacb-879b-4111-919c-966899666f55_5o1i1jdydevstack@QuobyteHD {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:21:24 devstack sudo[102052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_65cceacb-879b-4111-919c-966899666f55_5o1i1jdydevstack@QuobyteHD
Jul 03 01:21:24 devstack sudo[102052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:21:25 devstack sudo[102052]: pam_unix(sudo:session): session closed for user root
Jul 03 01:21:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c382202c-4dd8-45ee-a2a5-6fbf5b9e2bc7 tempest-TestShelveInstance-57035342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_65cceacb-879b-4111-919c-966899666f55_5o1i1jdydevstack@QuobyteHD" returned: 0 in 0.782s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:21:25 devstack cinder-volume[86891]: DEBUG cinder.image.image_utils [None req-c382202c-4dd8-45ee-a2a5-6fbf5b9e2bc7 tempest-TestShelveInstance-57035342 None] Temporary image 65cceacb-879b-4111-919c-966899666f55 is fetched for user 303802aec4b34611a92253ddfadd049a. {{(pid=86891) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 03 01:21:25 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[7368b7bd-b6b0-4c8e-b029-3a7e3c50da18]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:21:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c382202c-4dd8-45ee-a2a5-6fbf5b9e2bc7 tempest-TestShelveInstance-57035342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_65cceacb-879b-4111-919c-966899666f55_5o1i1jdydevstack@QuobyteHD {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:21:25 devstack sudo[102071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_65cceacb-879b-4111-919c-966899666f55_5o1i1jdydevstack@QuobyteHD
Jul 03 01:21:25 devstack sudo[102071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:21:26 devstack sudo[102071]: pam_unix(sudo:session): session closed for user root
Jul 03 01:21:26 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c382202c-4dd8-45ee-a2a5-6fbf5b9e2bc7 tempest-TestShelveInstance-57035342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_65cceacb-879b-4111-919c-966899666f55_5o1i1jdydevstack@QuobyteHD" returned: 0 in 0.734s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:21:26 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-c382202c-4dd8-45ee-a2a5-6fbf5b9e2bc7 tempest-TestShelveInstance-57035342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:21:26 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-c382202c-4dd8-45ee-a2a5-6fbf5b9e2bc7 tempest-TestShelveInstance-57035342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:21:26 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-c382202c-4dd8-45ee-a2a5-6fbf5b9e2bc7 tempest-TestShelveInstance-57035342 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:21:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1251062675',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c9ba326-e4f6-474a-aea9-3c3d2466fcad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c01d9c8d34e4efe88b570f3170c5a01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:21:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:21:24Z,use_quota=True,user_id='303802aec4b34611a92253ddfadd049a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:21:26 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-c382202c-4dd8-45ee-a2a5-6fbf5b9e2bc7 tempest-TestShelveInstance-57035342 None] Creating volume 2c9ba326-e4f6-474a-aea9-3c3d2466fcad {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:21:26 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-c382202c-4dd8-45ee-a2a5-6fbf5b9e2bc7 tempest-TestShelveInstance-57035342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:21:26 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-c382202c-4dd8-45ee-a2a5-6fbf5b9e2bc7 tempest-TestShelveInstance-57035342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:21:26 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-c382202c-4dd8-45ee-a2a5-6fbf5b9e2bc7 tempest-TestShelveInstance-57035342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:21:26 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-c382202c-4dd8-45ee-a2a5-6fbf5b9e2bc7 tempest-TestShelveInstance-57035342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:21:26 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-c382202c-4dd8-45ee-a2a5-6fbf5b9e2bc7 tempest-TestShelveInstance-57035342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:21:26 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-c382202c-4dd8-45ee-a2a5-6fbf5b9e2bc7 tempest-TestShelveInstance-57035342 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:21:26 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-c382202c-4dd8-45ee-a2a5-6fbf5b9e2bc7 tempest-TestShelveInstance-57035342 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:21:26 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c382202c-4dd8-45ee-a2a5-6fbf5b9e2bc7 tempest-TestShelveInstance-57035342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2c9ba326-e4f6-474a-aea9-3c3d2466fcad 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:21:26 devstack sudo[102079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2c9ba326-e4f6-474a-aea9-3c3d2466fcad 1073741824
Jul 03 01:21:26 devstack sudo[102079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:21:27 devstack sudo[102079]: pam_unix(sudo:session): session closed for user root
Jul 03 01:21:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c382202c-4dd8-45ee-a2a5-6fbf5b9e2bc7 tempest-TestShelveInstance-57035342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2c9ba326-e4f6-474a-aea9-3c3d2466fcad 1073741824" returned: 0 in 0.840s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:21:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c382202c-4dd8-45ee-a2a5-6fbf5b9e2bc7 tempest-TestShelveInstance-57035342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2c9ba326-e4f6-474a-aea9-3c3d2466fcad {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:21:27 devstack sudo[102085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2c9ba326-e4f6-474a-aea9-3c3d2466fcad
Jul 03 01:21:27 devstack sudo[102085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:21:27 devstack sudo[102085]: pam_unix(sudo:session): session closed for user root
Jul 03 01:21:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c382202c-4dd8-45ee-a2a5-6fbf5b9e2bc7 tempest-TestShelveInstance-57035342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2c9ba326-e4f6-474a-aea9-3c3d2466fcad" returned: 0 in 0.683s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:21:27 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-c382202c-4dd8-45ee-a2a5-6fbf5b9e2bc7 tempest-TestShelveInstance-57035342 None] <== create_volume: return (1568ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:21:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-c382202c-4dd8-45ee-a2a5-6fbf5b9e2bc7 tempest-TestShelveInstance-57035342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.571s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:21:27 devstack cinder-volume[86891]: DEBUG cinder.volume.volume_utils [None req-c382202c-4dd8-45ee-a2a5-6fbf5b9e2bc7 tempest-TestShelveInstance-57035342 None] Attempting download of 65cceacb-879b-4111-919c-966899666f55 ((None, [{'url': 'file:///opt/stack/data/glance/images/65cceacb-879b-4111-919c-966899666f55', 'metadata': {}}])) to volume 2c9ba326-e4f6-474a-aea9-3c3d2466fcad. {{(pid=86891) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 03 01:21:27 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cca4815-3453-42af-b66b-31740bc2fb27]: (4, 'raw') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:21:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c382202c-4dd8-45ee-a2a5-6fbf5b9e2bc7 tempest-TestShelveInstance-57035342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_65cceacb-879b-4111-919c-966899666f55_v99xes36 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:21:28 devstack sudo[102088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_65cceacb-879b-4111-919c-966899666f55_v99xes36
Jul 03 01:21:28 devstack sudo[102088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:21:28 devstack sudo[102088]: pam_unix(sudo:session): session closed for user root
Jul 03 01:21:28 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c382202c-4dd8-45ee-a2a5-6fbf5b9e2bc7 tempest-TestShelveInstance-57035342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_65cceacb-879b-4111-919c-966899666f55_v99xes36" returned: 0 in 0.767s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:21:28 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c382202c-4dd8-45ee-a2a5-6fbf5b9e2bc7 tempest-TestShelveInstance-57035342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_65cceacb-879b-4111-919c-966899666f55_v99xes36 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:21:28 devstack sudo[102097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_65cceacb-879b-4111-919c-966899666f55_v99xes36
Jul 03 01:21:28 devstack sudo[102097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:21:29 devstack sudo[102097]: pam_unix(sudo:session): session closed for user root
Jul 03 01:21:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c382202c-4dd8-45ee-a2a5-6fbf5b9e2bc7 tempest-TestShelveInstance-57035342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_65cceacb-879b-4111-919c-966899666f55_v99xes36" returned: 1 in 0.766s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:21:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c382202c-4dd8-45ee-a2a5-6fbf5b9e2bc7 tempest-TestShelveInstance-57035342 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_65cceacb-879b-4111-919c-966899666f55_v99xes36' failed. Not Retrying. {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 01:21:29 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[8236b578-1570-4443-93e7-5adda7a0e576]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:21:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c382202c-4dd8-45ee-a2a5-6fbf5b9e2bc7 tempest-TestShelveInstance-57035342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_65cceacb-879b-4111-919c-966899666f55_5o1i1jdydevstack@QuobyteHD {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:21:29 devstack sudo[102101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_65cceacb-879b-4111-919c-966899666f55_5o1i1jdydevstack@QuobyteHD
Jul 03 01:21:29 devstack sudo[102101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:21:30 devstack sudo[102101]: pam_unix(sudo:session): session closed for user root
Jul 03 01:21:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c382202c-4dd8-45ee-a2a5-6fbf5b9e2bc7 tempest-TestShelveInstance-57035342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_65cceacb-879b-4111-919c-966899666f55_5o1i1jdydevstack@QuobyteHD" returned: 0 in 0.825s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:21:30 devstack cinder-volume[86891]: DEBUG cinder.image.image_utils [None req-c382202c-4dd8-45ee-a2a5-6fbf5b9e2bc7 tempest-TestShelveInstance-57035342 None] 65cceacb-879b-4111-919c-966899666f55 was qcow2, converting to raw {{(pid=86891) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 03 01:21:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c382202c-4dd8-45ee-a2a5-6fbf5b9e2bc7 tempest-TestShelveInstance-57035342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_65cceacb-879b-4111-919c-966899666f55_5o1i1jdydevstack@QuobyteHD /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2c9ba326-e4f6-474a-aea9-3c3d2466fcad {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:21:30 devstack sudo[102133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_65cceacb-879b-4111-919c-966899666f55_5o1i1jdydevstack@QuobyteHD /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2c9ba326-e4f6-474a-aea9-3c3d2466fcad
Jul 03 01:21:30 devstack sudo[102133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:21:32 devstack sudo[102133]: pam_unix(sudo:session): session closed for user root
Jul 03 01:21:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c382202c-4dd8-45ee-a2a5-6fbf5b9e2bc7 tempest-TestShelveInstance-57035342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_65cceacb-879b-4111-919c-966899666f55_5o1i1jdydevstack@QuobyteHD /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2c9ba326-e4f6-474a-aea9-3c3d2466fcad" returned: 0 in 2.360s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:21:32 devstack cinder-volume[86891]: DEBUG cinder.image.image_utils [None req-c382202c-4dd8-45ee-a2a5-6fbf5b9e2bc7 tempest-TestShelveInstance-57035342 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_65cceacb-879b-4111-919c-966899666f55_5o1i1jdydevstack@QuobyteHD, size 112.00 MB, duration 2.36 sec, destination /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2c9ba326-e4f6-474a-aea9-3c3d2466fcad {{(pid=86891) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 03 01:21:32 devstack cinder-volume[86891]: INFO cinder.image.image_utils [None req-c382202c-4dd8-45ee-a2a5-6fbf5b9e2bc7 tempest-TestShelveInstance-57035342 None] Converted 112.00 MB image at 47.39 MB/s
Jul 03 01:21:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c382202c-4dd8-45ee-a2a5-6fbf5b9e2bc7 tempest-TestShelveInstance-57035342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2c9ba326-e4f6-474a-aea9-3c3d2466fcad 1G {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:21:32 devstack sudo[102219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2c9ba326-e4f6-474a-aea9-3c3d2466fcad 1G
Jul 03 01:21:32 devstack sudo[102219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:21:33 devstack sudo[102219]: pam_unix(sudo:session): session closed for user root
Jul 03 01:21:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c382202c-4dd8-45ee-a2a5-6fbf5b9e2bc7 tempest-TestShelveInstance-57035342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2c9ba326-e4f6-474a-aea9-3c3d2466fcad 1G" returned: 0 in 0.857s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:21:33 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4cd9e45-7564-4d69-bd30-fdb530c3b2b2]: (4, 'raw') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:21:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c382202c-4dd8-45ee-a2a5-6fbf5b9e2bc7 tempest-TestShelveInstance-57035342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2c9ba326-e4f6-474a-aea9-3c3d2466fcad {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:21:33 devstack sudo[102224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2c9ba326-e4f6-474a-aea9-3c3d2466fcad
Jul 03 01:21:33 devstack sudo[102224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:21:34 devstack sudo[102224]: pam_unix(sudo:session): session closed for user root
Jul 03 01:21:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c382202c-4dd8-45ee-a2a5-6fbf5b9e2bc7 tempest-TestShelveInstance-57035342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2c9ba326-e4f6-474a-aea9-3c3d2466fcad" returned: 0 in 0.981s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:21:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c382202c-4dd8-45ee-a2a5-6fbf5b9e2bc7 tempest-TestShelveInstance-57035342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2c9ba326-e4f6-474a-aea9-3c3d2466fcad {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:21:34 devstack sudo[102230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2c9ba326-e4f6-474a-aea9-3c3d2466fcad
Jul 03 01:21:34 devstack sudo[102230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:21:35 devstack sudo[102230]: pam_unix(sudo:session): session closed for user root
Jul 03 01:21:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c382202c-4dd8-45ee-a2a5-6fbf5b9e2bc7 tempest-TestShelveInstance-57035342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2c9ba326-e4f6-474a-aea9-3c3d2466fcad" returned: 1 in 0.844s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:21:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c382202c-4dd8-45ee-a2a5-6fbf5b9e2bc7 tempest-TestShelveInstance-57035342 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2c9ba326-e4f6-474a-aea9-3c3d2466fcad' failed. Not Retrying. {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 01:21:35 devstack cinder-volume[86891]: DEBUG cinder.volume.volume_utils [None req-c382202c-4dd8-45ee-a2a5-6fbf5b9e2bc7 tempest-TestShelveInstance-57035342 None] Downloaded image 65cceacb-879b-4111-919c-966899666f55 ((None, [{'url': 'file:///opt/stack/data/glance/images/65cceacb-879b-4111-919c-966899666f55', 'metadata': {}}])) to volume 2c9ba326-e4f6-474a-aea9-3c3d2466fcad successfully. {{(pid=86891) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 03 01:21:35 devstack cinder-volume[86891]: DEBUG cinder.image.image_utils [None req-c382202c-4dd8-45ee-a2a5-6fbf5b9e2bc7 tempest-TestShelveInstance-57035342 None] Temporary image 65cceacb-879b-4111-919c-966899666f55 for user 303802aec4b34611a92253ddfadd049a is deleted. {{(pid=86891) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 03 01:21:35 devstack cinder-volume[86891]: DEBUG cinder.volume.volume_utils [None req-c382202c-4dd8-45ee-a2a5-6fbf5b9e2bc7 tempest-TestShelveInstance-57035342 None] Marking volume 2c9ba326-e4f6-474a-aea9-3c3d2466fcad as bootable. {{(pid=86891) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 03 01:21:35 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-c382202c-4dd8-45ee-a2a5-6fbf5b9e2bc7 tempest-TestShelveInstance-57035342 None] Copying metadata from image 65cceacb-879b-4111-919c-966899666f55 to 2c9ba326-e4f6-474a-aea9-3c3d2466fcad. {{(pid=86891) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 03 01:21:35 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-c382202c-4dd8-45ee-a2a5-6fbf5b9e2bc7 tempest-TestShelveInstance-57035342 None] Creating volume glance metadata for volume 2c9ba326-e4f6-474a-aea9-3c3d2466fcad backed by image 65cceacb-879b-4111-919c-966899666f55 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '65cceacb-879b-4111-919c-966899666f55', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86891) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 03 01:21:35 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c382202c-4dd8-45ee-a2a5-6fbf5b9e2bc7 tempest-TestShelveInstance-57035342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5181dcc7-1f86-46a2-8862-eb776a42359b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c9ba326-e4f6-474a-aea9-3c3d2466fcad', 'volume_size': 1, 'image_id': '65cceacb-879b-4111-919c-966899666f55', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/65cceacb-879b-4111-919c-966899666f55', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0d33e5361cf145ffa2791b827e46aea8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '65cceacb-879b-4111-919c-966899666f55', 'created_at': datetime.datetime(2026, 7, 2, 22, 57, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 22, 57, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/65cceacb-879b-4111-919c-966899666f55/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7c5b34fa8560>}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:21:35 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c382202c-4dd8-45ee-a2a5-6fbf5b9e2bc7 tempest-TestShelveInstance-57035342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d24b2396-5ba6-4ce8-9ce5-74f06c3f7f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:21:35 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-c382202c-4dd8-45ee-a2a5-6fbf5b9e2bc7 tempest-TestShelveInstance-57035342 None] Volume volume-2c9ba326-e4f6-474a-aea9-3c3d2466fcad (2c9ba326-e4f6-474a-aea9-3c3d2466fcad): created successfully
Jul 03 01:21:35 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c382202c-4dd8-45ee-a2a5-6fbf5b9e2bc7 tempest-TestShelveInstance-57035342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d24b2396-5ba6-4ce8-9ce5-74f06c3f7f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:21:35 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c382202c-4dd8-45ee-a2a5-6fbf5b9e2bc7 tempest-TestShelveInstance-57035342 None] Flow 'volume_create_manager' (ecabed9e-a8ef-4bcf-896f-fc9df2b068fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:21:35 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-c382202c-4dd8-45ee-a2a5-6fbf5b9e2bc7 tempest-TestShelveInstance-57035342 None] Created volume successfully.
Jul 03 01:21:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-1239b24c-8a84-47e1-a90a-7231e22ea018 req-e9cf1e87-7d59-4e3d-9ed6-6a5f4b26abf5 tempest-TestShelveInstance-57035342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:21:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-1239b24c-8a84-47e1-a90a-7231e22ea018 req-e9cf1e87-7d59-4e3d-9ed6-6a5f4b26abf5 tempest-TestShelveInstance-57035342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:21:44 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e1f6a8-1c49-457e-97a7-debf3b97cba9]: (4, 'raw') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:21:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-1239b24c-8a84-47e1-a90a-7231e22ea018 req-e9cf1e87-7d59-4e3d-9ed6-6a5f4b26abf5 tempest-TestShelveInstance-57035342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2c9ba326-e4f6-474a-aea9-3c3d2466fcad {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:21:44 devstack sudo[102271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2c9ba326-e4f6-474a-aea9-3c3d2466fcad
Jul 03 01:21:44 devstack sudo[102271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:21:44 devstack sudo[102271]: pam_unix(sudo:session): session closed for user root
Jul 03 01:21:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-1239b24c-8a84-47e1-a90a-7231e22ea018 req-e9cf1e87-7d59-4e3d-9ed6-6a5f4b26abf5 tempest-TestShelveInstance-57035342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2c9ba326-e4f6-474a-aea9-3c3d2466fcad" returned: 0 in 0.721s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:21:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-1239b24c-8a84-47e1-a90a-7231e22ea018 req-e9cf1e87-7d59-4e3d-9ed6-6a5f4b26abf5 tempest-TestShelveInstance-57035342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2c9ba326-e4f6-474a-aea9-3c3d2466fcad {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:21:44 devstack sudo[102276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2c9ba326-e4f6-474a-aea9-3c3d2466fcad
Jul 03 01:21:44 devstack sudo[102276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:21:45 devstack sudo[102276]: pam_unix(sudo:session): session closed for user root
Jul 03 01:21:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-1239b24c-8a84-47e1-a90a-7231e22ea018 req-e9cf1e87-7d59-4e3d-9ed6-6a5f4b26abf5 tempest-TestShelveInstance-57035342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2c9ba326-e4f6-474a-aea9-3c3d2466fcad" returned: 1 in 0.700s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:21:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-1239b24c-8a84-47e1-a90a-7231e22ea018 req-e9cf1e87-7d59-4e3d-9ed6-6a5f4b26abf5 tempest-TestShelveInstance-57035342 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2c9ba326-e4f6-474a-aea9-3c3d2466fcad' failed. Not Retrying. {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 01:21:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-1239b24c-8a84-47e1-a90a-7231e22ea018 req-e9cf1e87-7d59-4e3d-9ed6-6a5f4b26abf5 tempest-TestShelveInstance-57035342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.478s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:21:45 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [req-1239b24c-8a84-47e1-a90a-7231e22ea018 req-e9cf1e87-7d59-4e3d-9ed6-6a5f4b26abf5 tempest-TestShelveInstance-57035342 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3', 'name': 'volume-2c9ba326-e4f6-474a-aea9-3c3d2466fcad', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c10bdd90-9578-4ffa-b588-128b4c5f865b', 'enforce_multipath': True} {{(pid=86891) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 01:21:45 devstack cinder-volume[86891]: INFO cinder.volume.manager [req-1239b24c-8a84-47e1-a90a-7231e22ea018 req-e9cf1e87-7d59-4e3d-9ed6-6a5f4b26abf5 tempest-TestShelveInstance-57035342 None] attachment_update completed successfully.
Jul 03 01:21:55 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:SELECT=22,cinder:UPDATE=9,cinder:INSERT=10,cinder:DELETE=1 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:21:55 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:UPDATE=15,cinder:SELECT=16,cinder:INSERT=6,cinder:DELETE=2 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:21:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-8f93cb4e-5a14-421b-aec2-b3540ed40ade req-f9276d9b-2982-4c8c-9786-ab304fa9afb9 tempest-TestServerVolumeAttachmentScenario-2032709709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:21:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-8f93cb4e-5a14-421b-aec2-b3540ed40ade req-f9276d9b-2982-4c8c-9786-ab304fa9afb9 tempest-TestServerVolumeAttachmentScenario-2032709709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:21:58 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[959ed4ae-3755-4b84-98fc-a5417105e2a0]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:21:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-8f93cb4e-5a14-421b-aec2-b3540ed40ade req-f9276d9b-2982-4c8c-9786-ab304fa9afb9 tempest-TestServerVolumeAttachmentScenario-2032709709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cde6dbba-bd4d-4b73-bb5f-e484b1890e5e {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:21:58 devstack sudo[102745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cde6dbba-bd4d-4b73-bb5f-e484b1890e5e
Jul 03 01:21:58 devstack sudo[102745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:21:59 devstack sudo[102745]: pam_unix(sudo:session): session closed for user root
Jul 03 01:21:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-8f93cb4e-5a14-421b-aec2-b3540ed40ade req-f9276d9b-2982-4c8c-9786-ab304fa9afb9 tempest-TestServerVolumeAttachmentScenario-2032709709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cde6dbba-bd4d-4b73-bb5f-e484b1890e5e" returned: 0 in 0.761s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:21:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-8f93cb4e-5a14-421b-aec2-b3540ed40ade req-f9276d9b-2982-4c8c-9786-ab304fa9afb9 tempest-TestServerVolumeAttachmentScenario-2032709709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.779s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:21:59 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [req-8f93cb4e-5a14-421b-aec2-b3540ed40ade req-f9276d9b-2982-4c8c-9786-ab304fa9afb9 tempest-TestServerVolumeAttachmentScenario-2032709709 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3', 'name': 'volume-cde6dbba-bd4d-4b73-bb5f-e484b1890e5e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dad7caea-41e5-4159-b696-19addc6504c7', 'enforce_multipath': True} {{(pid=86891) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 01:21:59 devstack cinder-volume[86891]: INFO cinder.volume.manager [req-8f93cb4e-5a14-421b-aec2-b3540ed40ade req-f9276d9b-2982-4c8c-9786-ab304fa9afb9 tempest-TestServerVolumeAttachmentScenario-2032709709 None] attachment_update completed successfully.
Jul 03 01:22:01 devstack cinder-volume[86891]: DEBUG oslo_service.periodic_task [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86891) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 01:22:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:22:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:22:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:22:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:22:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:22:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:22:01 devstack sudo[102753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:22:01 devstack sudo[102753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:22:02 devstack sudo[102753]: pam_unix(sudo:session): session closed for user root
Jul 03 01:22:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.677s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:22:02 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:22:02 devstack cinder-volume[86891]: DEBUG oslo_service.periodic_task [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running periodic task VolumeManager._thread_info {{(pid=86891) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 01:22:02 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] thread count: 28 {{(pid=86891) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 01:22:02 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] thread info: [<_MainThread(MainThread, started 136731296534656)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136731184953280)>, <Thread(Thread-3 (stat_writer), started daemon 136731184058816)>, <Thread(Rabbit-heartbeat, started daemon 136731184846080)>, <Thread(Thread-5 (_runner), started daemon 136731182936576)>, <Thread(Thread-7 (_runner), started daemon 136731182954944)>, <Thread(fd_logger, started daemon 136731181916416)>, <Thread(privsep_reader, started daemon 136731180942208)>, <Thread(tpool_thread_0, started daemon 136731172161216)>, <Thread(tpool_thread_1, started daemon 136731163768512)>, <Thread(tpool_thread_2, started daemon 136731155375808)>, <Thread(tpool_thread_3, started daemon 136731146983104)>, <Thread(tpool_thread_4, started daemon 136731138590400)>, <Thread(tpool_thread_5, started daemon 136731130197696)>, <Thread(tpool_thread_6, started daemon 136731121804992)>, <Thread(tpool_thread_7, started daemon 136731113412288)>, <Thread(tpool_thread_8, started daemon 136731105003200)>, <Thread(tpool_thread_9, started daemon 136731096594112)>, <Thread(tpool_thread_10, started daemon 136731088185024)>, <Thread(tpool_thread_11, started daemon 136731079775936)>, <Thread(tpool_thread_12, started daemon 136731071366848)>, <Thread(tpool_thread_13, started daemon 136731062957760)>, <Thread(tpool_thread_14, started daemon 136731054548672)>, <Thread(tpool_thread_15, started daemon 136731046139584)>, <Thread(tpool_thread_16, started daemon 136731037730496)>, <Thread(tpool_thread_17, started daemon 136731029321408)>, <Thread(tpool_thread_18, started daemon 136731020912320)>, <Thread(tpool_thread_19, started daemon 136731012503232)>] {{(pid=86891) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 01:22:08 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-d0804508-0257-4e5e-b49a-0c6cf875deb2 req-4b4a7a73-8e2a-48d4-99e3-d0830d5e6805 tempest-TestServerVolumeAttachmentScenario-2032709709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:22:08 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-d0804508-0257-4e5e-b49a-0c6cf875deb2 req-4b4a7a73-8e2a-48d4-99e3-d0830d5e6805 tempest-TestServerVolumeAttachmentScenario-2032709709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:22:08 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[819c2eaf-9ce4-4465-b72e-611bb1d89334]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:22:08 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-d0804508-0257-4e5e-b49a-0c6cf875deb2 req-4b4a7a73-8e2a-48d4-99e3-d0830d5e6805 tempest-TestServerVolumeAttachmentScenario-2032709709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-246917a6-5f5b-4119-b879-cf9d7ceb3164 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:22:08 devstack sudo[102855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-246917a6-5f5b-4119-b879-cf9d7ceb3164
Jul 03 01:22:08 devstack sudo[102855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:22:08 devstack sudo[102855]: pam_unix(sudo:session): session closed for user root
Jul 03 01:22:08 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-d0804508-0257-4e5e-b49a-0c6cf875deb2 req-4b4a7a73-8e2a-48d4-99e3-d0830d5e6805 tempest-TestServerVolumeAttachmentScenario-2032709709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-246917a6-5f5b-4119-b879-cf9d7ceb3164" returned: 0 in 0.753s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:22:08 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-d0804508-0257-4e5e-b49a-0c6cf875deb2 req-4b4a7a73-8e2a-48d4-99e3-d0830d5e6805 tempest-TestServerVolumeAttachmentScenario-2032709709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.769s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:22:08 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [req-d0804508-0257-4e5e-b49a-0c6cf875deb2 req-4b4a7a73-8e2a-48d4-99e3-d0830d5e6805 tempest-TestServerVolumeAttachmentScenario-2032709709 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3', 'name': 'volume-246917a6-5f5b-4119-b879-cf9d7ceb3164', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd1dbf277-721d-47e2-ad62-08ca85b612fb', 'enforce_multipath': True} {{(pid=86891) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 01:22:09 devstack cinder-volume[86891]: INFO cinder.volume.manager [req-d0804508-0257-4e5e-b49a-0c6cf875deb2 req-4b4a7a73-8e2a-48d4-99e3-d0830d5e6805 tempest-TestServerVolumeAttachmentScenario-2032709709 None] attachment_update completed successfully.
Jul 03 01:22:14 devstack cinder-volume[86891]: INFO cinder.volume.manager [req-52ba9d9b-f9ee-4837-9e5d-61211e5ec248 req-e6035f0b-761d-4743-9a2e-ad502e7b599c tempest-TestServerVolumeAttachmentScenario-2032709709 None] Terminate volume connection completed successfully.
Jul 03 01:22:14 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [req-52ba9d9b-f9ee-4837-9e5d-61211e5ec248 req-e6035f0b-761d-4743-9a2e-ad502e7b599c tempest-TestServerVolumeAttachmentScenario-2032709709 None] Deleting attachment d1dbf277-721d-47e2-ad62-08ca85b612fb. {{(pid=86891) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 01:22:18 devstack cinder-volume[86891]: INFO cinder.volume.manager [req-11d926dc-bd4a-428f-8b6e-ca16e7bf883f req-e18c80f5-b3e0-4b29-8230-c6e6857e1758 tempest-TestServerVolumeAttachmentScenario-2032709709 None] Terminate volume connection completed successfully.
Jul 03 01:22:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [req-11d926dc-bd4a-428f-8b6e-ca16e7bf883f req-e18c80f5-b3e0-4b29-8230-c6e6857e1758 tempest-TestServerVolumeAttachmentScenario-2032709709 None] Deleting attachment dad7caea-41e5-4159-b696-19addc6504c7. {{(pid=86891) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 01:22:21 devstack cinder-volume[86891]: INFO cinder.volume.manager [req-dba15876-aab6-4844-967e-2c76cbe1fc8c req-de2dbde1-74b4-4a1c-b76c-f4cf3d5a9772 tempest-TestShelveInstance-57035342 None] Terminate volume connection completed successfully.
Jul 03 01:22:21 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [req-dba15876-aab6-4844-967e-2c76cbe1fc8c req-de2dbde1-74b4-4a1c-b76c-f4cf3d5a9772 tempest-TestShelveInstance-57035342 None] Deleting attachment c10bdd90-9578-4ffa-b588-128b4c5f865b. {{(pid=86891) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 01:22:26 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-44fa49a0-2348-4630-8ff7-0830ac195b08 req-01cd1c75-18c8-45d0-9d1d-93b0f5027e41 tempest-TestShelveInstance-57035342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:22:26 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-44fa49a0-2348-4630-8ff7-0830ac195b08 req-01cd1c75-18c8-45d0-9d1d-93b0f5027e41 tempest-TestShelveInstance-57035342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:22:26 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7fba0e2-fc21-48d8-b8b5-1432ff28e31d]: (4, 'raw') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:22:26 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-44fa49a0-2348-4630-8ff7-0830ac195b08 req-01cd1c75-18c8-45d0-9d1d-93b0f5027e41 tempest-TestShelveInstance-57035342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2c9ba326-e4f6-474a-aea9-3c3d2466fcad {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:22:26 devstack sudo[102979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2c9ba326-e4f6-474a-aea9-3c3d2466fcad
Jul 03 01:22:26 devstack sudo[102979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:22:27 devstack sudo[102979]: pam_unix(sudo:session): session closed for user root
Jul 03 01:22:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-44fa49a0-2348-4630-8ff7-0830ac195b08 req-01cd1c75-18c8-45d0-9d1d-93b0f5027e41 tempest-TestShelveInstance-57035342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2c9ba326-e4f6-474a-aea9-3c3d2466fcad" returned: 0 in 0.847s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:22:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-44fa49a0-2348-4630-8ff7-0830ac195b08 req-01cd1c75-18c8-45d0-9d1d-93b0f5027e41 tempest-TestShelveInstance-57035342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2c9ba326-e4f6-474a-aea9-3c3d2466fcad {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:22:27 devstack sudo[102983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2c9ba326-e4f6-474a-aea9-3c3d2466fcad
Jul 03 01:22:27 devstack sudo[102983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:22:28 devstack sudo[102983]: pam_unix(sudo:session): session closed for user root
Jul 03 01:22:28 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-44fa49a0-2348-4630-8ff7-0830ac195b08 req-01cd1c75-18c8-45d0-9d1d-93b0f5027e41 tempest-TestShelveInstance-57035342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2c9ba326-e4f6-474a-aea9-3c3d2466fcad" returned: 1 in 0.818s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:22:28 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-44fa49a0-2348-4630-8ff7-0830ac195b08 req-01cd1c75-18c8-45d0-9d1d-93b0f5027e41 tempest-TestShelveInstance-57035342 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2c9ba326-e4f6-474a-aea9-3c3d2466fcad' failed. Not Retrying. {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 01:22:28 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-44fa49a0-2348-4630-8ff7-0830ac195b08 req-01cd1c75-18c8-45d0-9d1d-93b0f5027e41 tempest-TestShelveInstance-57035342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.707s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:22:28 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [req-44fa49a0-2348-4630-8ff7-0830ac195b08 req-01cd1c75-18c8-45d0-9d1d-93b0f5027e41 tempest-TestShelveInstance-57035342 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3', 'name': 'volume-2c9ba326-e4f6-474a-aea9-3c3d2466fcad', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '306f67c4-e483-49ca-9a03-c0bcdda2d0dd', 'enforce_multipath': True} {{(pid=86891) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 01:22:28 devstack cinder-volume[86891]: INFO cinder.volume.manager [req-44fa49a0-2348-4630-8ff7-0830ac195b08 req-01cd1c75-18c8-45d0-9d1d-93b0f5027e41 tempest-TestShelveInstance-57035342 None] attachment_update completed successfully.
Jul 03 01:22:28 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-9814efc5-07b6-4c34-9eb9-d3535ddc48ac tempest-TestServerVolumeAttachmentScenario-2032709709 None] Acquiring lock "cinder-246917a6-5f5b-4119-b879-cf9d7ceb3164-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:22:28 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-9814efc5-07b6-4c34-9eb9-d3535ddc48ac tempest-TestServerVolumeAttachmentScenario-2032709709 None] Lock "cinder-246917a6-5f5b-4119-b879-cf9d7ceb3164-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:22:28 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-9814efc5-07b6-4c34-9eb9-d3535ddc48ac tempest-TestServerVolumeAttachmentScenario-2032709709 None] Acquiring lock "cinder-quobyte-246917a6-5f5b-4119-b879-cf9d7ceb3164" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:22:29 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-9814efc5-07b6-4c34-9eb9-d3535ddc48ac tempest-TestServerVolumeAttachmentScenario-2032709709 None] Lock "cinder-quobyte-246917a6-5f5b-4119-b879-cf9d7ceb3164" acquired by "delete_volume" :: waited 0.014s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:22:29 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[f302708d-3f4e-496b-ae6f-6e091775fd4c]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:22:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9814efc5-07b6-4c34-9eb9-d3535ddc48ac tempest-TestServerVolumeAttachmentScenario-2032709709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-246917a6-5f5b-4119-b879-cf9d7ceb3164 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:22:29 devstack sudo[102989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-246917a6-5f5b-4119-b879-cf9d7ceb3164
Jul 03 01:22:29 devstack sudo[102989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:22:29 devstack sudo[102989]: pam_unix(sudo:session): session closed for user root
Jul 03 01:22:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9814efc5-07b6-4c34-9eb9-d3535ddc48ac tempest-TestServerVolumeAttachmentScenario-2032709709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-246917a6-5f5b-4119-b879-cf9d7ceb3164" returned: 0 in 0.742s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:22:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9814efc5-07b6-4c34-9eb9-d3535ddc48ac tempest-TestServerVolumeAttachmentScenario-2032709709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-246917a6-5f5b-4119-b879-cf9d7ceb3164 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:22:29 devstack sudo[102994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-246917a6-5f5b-4119-b879-cf9d7ceb3164
Jul 03 01:22:29 devstack sudo[102994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:22:30 devstack sudo[102994]: pam_unix(sudo:session): session closed for user root
Jul 03 01:22:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9814efc5-07b6-4c34-9eb9-d3535ddc48ac tempest-TestServerVolumeAttachmentScenario-2032709709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-246917a6-5f5b-4119-b879-cf9d7ceb3164" returned: 0 in 0.618s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:22:30 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-9814efc5-07b6-4c34-9eb9-d3535ddc48ac tempest-TestServerVolumeAttachmentScenario-2032709709 None] Lock "cinder-quobyte-246917a6-5f5b-4119-b879-cf9d7ceb3164" released by "delete_volume" :: held 1.395s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:22:30 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-9814efc5-07b6-4c34-9eb9-d3535ddc48ac tempest-TestServerVolumeAttachmentScenario-2032709709 None] Created reservations ['17b3f44f-eba1-4bcb-8cdf-e723e80e5899', 'd6d2c70a-f017-45f2-8383-df9898a2679c', '41afbafc-e122-4212-a169-3af8784b015c', 'a12f50e9-1343-4390-a19a-90fccafe415e'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:22:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-9814efc5-07b6-4c34-9eb9-d3535ddc48ac tempest-TestServerVolumeAttachmentScenario-2032709709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:22:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-9814efc5-07b6-4c34-9eb9-d3535ddc48ac tempest-TestServerVolumeAttachmentScenario-2032709709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:22:30 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-9814efc5-07b6-4c34-9eb9-d3535ddc48ac tempest-TestServerVolumeAttachmentScenario-2032709709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:22:30 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-9814efc5-07b6-4c34-9eb9-d3535ddc48ac tempest-TestServerVolumeAttachmentScenario-2032709709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:22:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-9814efc5-07b6-4c34-9eb9-d3535ddc48ac tempest-TestServerVolumeAttachmentScenario-2032709709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:22:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9814efc5-07b6-4c34-9eb9-d3535ddc48ac tempest-TestServerVolumeAttachmentScenario-2032709709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:22:30 devstack sudo[102997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:22:30 devstack sudo[102997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:22:31 devstack sudo[102997]: pam_unix(sudo:session): session closed for user root
Jul 03 01:22:31 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9814efc5-07b6-4c34-9eb9-d3535ddc48ac tempest-TestServerVolumeAttachmentScenario-2032709709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.640s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:22:31 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-9814efc5-07b6-4c34-9eb9-d3535ddc48ac tempest-TestServerVolumeAttachmentScenario-2032709709 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:22:31 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-9814efc5-07b6-4c34-9eb9-d3535ddc48ac tempest-TestServerVolumeAttachmentScenario-2032709709 None] Deleted volume successfully.
Jul 03 01:22:31 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-27cc475a-3f9e-4729-89b9-fa5e5dcb0a9a tempest-TestServerVolumeAttachmentScenario-2032709709 None] Acquiring lock "cinder-cde6dbba-bd4d-4b73-bb5f-e484b1890e5e-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:22:31 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-9814efc5-07b6-4c34-9eb9-d3535ddc48ac tempest-TestServerVolumeAttachmentScenario-2032709709 None] Lock "cinder-246917a6-5f5b-4119-b879-cf9d7ceb3164-delete_volume" released by "delete_volume" :: held 2.244s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:22:31 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-27cc475a-3f9e-4729-89b9-fa5e5dcb0a9a tempest-TestServerVolumeAttachmentScenario-2032709709 None] Lock "cinder-cde6dbba-bd4d-4b73-bb5f-e484b1890e5e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:22:31 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-27cc475a-3f9e-4729-89b9-fa5e5dcb0a9a tempest-TestServerVolumeAttachmentScenario-2032709709 None] Acquiring lock "cinder-quobyte-cde6dbba-bd4d-4b73-bb5f-e484b1890e5e" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:22:31 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-27cc475a-3f9e-4729-89b9-fa5e5dcb0a9a tempest-TestServerVolumeAttachmentScenario-2032709709 None] Lock "cinder-quobyte-cde6dbba-bd4d-4b73-bb5f-e484b1890e5e" acquired by "delete_volume" :: waited 0.017s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:22:31 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aae9e10-a235-485c-98e2-aeb2907180a2]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:22:31 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-27cc475a-3f9e-4729-89b9-fa5e5dcb0a9a tempest-TestServerVolumeAttachmentScenario-2032709709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cde6dbba-bd4d-4b73-bb5f-e484b1890e5e {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:22:31 devstack sudo[103000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cde6dbba-bd4d-4b73-bb5f-e484b1890e5e
Jul 03 01:22:31 devstack sudo[103000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:22:32 devstack sudo[103000]: pam_unix(sudo:session): session closed for user root
Jul 03 01:22:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-27cc475a-3f9e-4729-89b9-fa5e5dcb0a9a tempest-TestServerVolumeAttachmentScenario-2032709709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cde6dbba-bd4d-4b73-bb5f-e484b1890e5e" returned: 0 in 0.770s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:22:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-27cc475a-3f9e-4729-89b9-fa5e5dcb0a9a tempest-TestServerVolumeAttachmentScenario-2032709709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cde6dbba-bd4d-4b73-bb5f-e484b1890e5e {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:22:32 devstack sudo[103041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cde6dbba-bd4d-4b73-bb5f-e484b1890e5e
Jul 03 01:22:32 devstack sudo[103041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:22:32 devstack sudo[103041]: pam_unix(sudo:session): session closed for user root
Jul 03 01:22:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-27cc475a-3f9e-4729-89b9-fa5e5dcb0a9a tempest-TestServerVolumeAttachmentScenario-2032709709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cde6dbba-bd4d-4b73-bb5f-e484b1890e5e" returned: 0 in 0.675s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:22:32 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-27cc475a-3f9e-4729-89b9-fa5e5dcb0a9a tempest-TestServerVolumeAttachmentScenario-2032709709 None] Lock "cinder-quobyte-cde6dbba-bd4d-4b73-bb5f-e484b1890e5e" released by "delete_volume" :: held 1.480s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:22:32 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-27cc475a-3f9e-4729-89b9-fa5e5dcb0a9a tempest-TestServerVolumeAttachmentScenario-2032709709 None] Created reservations ['b2d94e7d-d23f-4cb6-b4a3-8131d6e1f97d', 'ef04b887-e3b2-4ff2-ad30-52e9cbee6237', '57bd5815-e39f-4a57-8f95-7560631ae856', '4cacd471-0da5-4975-a89e-dfc82ae9d5fe'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:22:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-27cc475a-3f9e-4729-89b9-fa5e5dcb0a9a tempest-TestServerVolumeAttachmentScenario-2032709709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:22:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-27cc475a-3f9e-4729-89b9-fa5e5dcb0a9a tempest-TestServerVolumeAttachmentScenario-2032709709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:22:32 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-27cc475a-3f9e-4729-89b9-fa5e5dcb0a9a tempest-TestServerVolumeAttachmentScenario-2032709709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:22:32 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-27cc475a-3f9e-4729-89b9-fa5e5dcb0a9a tempest-TestServerVolumeAttachmentScenario-2032709709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:22:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-27cc475a-3f9e-4729-89b9-fa5e5dcb0a9a tempest-TestServerVolumeAttachmentScenario-2032709709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:22:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-27cc475a-3f9e-4729-89b9-fa5e5dcb0a9a tempest-TestServerVolumeAttachmentScenario-2032709709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:22:32 devstack sudo[103044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:22:32 devstack sudo[103044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:22:33 devstack sudo[103044]: pam_unix(sudo:session): session closed for user root
Jul 03 01:22:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-27cc475a-3f9e-4729-89b9-fa5e5dcb0a9a tempest-TestServerVolumeAttachmentScenario-2032709709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.681s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:22:33 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-27cc475a-3f9e-4729-89b9-fa5e5dcb0a9a tempest-TestServerVolumeAttachmentScenario-2032709709 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:22:33 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-27cc475a-3f9e-4729-89b9-fa5e5dcb0a9a tempest-TestServerVolumeAttachmentScenario-2032709709 None] Deleted volume successfully.
Jul 03 01:22:33 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-27cc475a-3f9e-4729-89b9-fa5e5dcb0a9a tempest-TestServerVolumeAttachmentScenario-2032709709 None] Lock "cinder-cde6dbba-bd4d-4b73-bb5f-e484b1890e5e-delete_volume" released by "delete_volume" :: held 2.392s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:22:42 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:SELECT=29,cinder:UPDATE=23,cinder:INSERT=3 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:22:43 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:SELECT=30,cinder:UPDATE=18,cinder:INSERT=5,cinder:DELETE=2 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:22:45 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-54e450a6-57d7-4eb8-8187-92d42277ad0f tempest-CinderUnicodeTest-2109859919 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:22:45 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-54e450a6-57d7-4eb8-8187-92d42277ad0f tempest-CinderUnicodeTest-2109859919 None] Flow 'volume_create_manager' (26849373-527a-4b62-8c72-ed0801d9058c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:22:45 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-54e450a6-57d7-4eb8-8187-92d42277ad0f tempest-CinderUnicodeTest-2109859919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17556ed5-c602-4038-a0bf-1f0af5726142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:22:45 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-54e450a6-57d7-4eb8-8187-92d42277ad0f tempest-CinderUnicodeTest-2109859919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17556ed5-c602-4038-a0bf-1f0af5726142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:22:45Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb8223d6-73e4-43c5-83af-c785ded608a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62812d0c52a94c8c92a34ecd924f51f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:22:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:22:45Z,use_quota=True,user_id='c04ae883ef2f47e98eb4a3fd21a3beaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:22:45 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-54e450a6-57d7-4eb8-8187-92d42277ad0f tempest-CinderUnicodeTest-2109859919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (057fb97d-d3a1-4286-8d67-792df5bacafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:22:45 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-54e450a6-57d7-4eb8-8187-92d42277ad0f tempest-CinderUnicodeTest-2109859919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (057fb97d-d3a1-4286-8d67-792df5bacafe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:22:45 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-54e450a6-57d7-4eb8-8187-92d42277ad0f tempest-CinderUnicodeTest-2109859919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be083046-b40e-42db-8fef-773e5f097dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:22:45 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-54e450a6-57d7-4eb8-8187-92d42277ad0f tempest-CinderUnicodeTest-2109859919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be083046-b40e-42db-8fef-773e5f097dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb8223d6-73e4-43c5-83af-c785ded608a7', 'volume_name': 'volume-cb8223d6-73e4-43c5-83af-c785ded608a7', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:22:45 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-54e450a6-57d7-4eb8-8187-92d42277ad0f tempest-CinderUnicodeTest-2109859919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edf03b6c-755d-4387-ad2b-e59d947cf566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:22:45 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-54e450a6-57d7-4eb8-8187-92d42277ad0f tempest-CinderUnicodeTest-2109859919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edf03b6c-755d-4387-ad2b-e59d947cf566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:22:45 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-54e450a6-57d7-4eb8-8187-92d42277ad0f tempest-CinderUnicodeTest-2109859919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffc7b114-356e-4d75-ab05-5ab9e7dd5f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:22:45 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-54e450a6-57d7-4eb8-8187-92d42277ad0f tempest-CinderUnicodeTest-2109859919 None] Volume cb8223d6-73e4-43c5-83af-c785ded608a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb8223d6-73e4-43c5-83af-c785ded608a7', 'volume_size': 1}
Jul 03 01:22:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-54e450a6-57d7-4eb8-8187-92d42277ad0f tempest-CinderUnicodeTest-2109859919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:22:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-54e450a6-57d7-4eb8-8187-92d42277ad0f tempest-CinderUnicodeTest-2109859919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:22:45 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-54e450a6-57d7-4eb8-8187-92d42277ad0f tempest-CinderUnicodeTest-2109859919 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:22:45Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb8223d6-73e4-43c5-83af-c785ded608a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62812d0c52a94c8c92a34ecd924f51f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:22:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:22:45Z,use_quota=True,user_id='c04ae883ef2f47e98eb4a3fd21a3beaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:22:45 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-54e450a6-57d7-4eb8-8187-92d42277ad0f tempest-CinderUnicodeTest-2109859919 None] Creating volume cb8223d6-73e4-43c5-83af-c785ded608a7 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:22:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-54e450a6-57d7-4eb8-8187-92d42277ad0f tempest-CinderUnicodeTest-2109859919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:22:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-54e450a6-57d7-4eb8-8187-92d42277ad0f tempest-CinderUnicodeTest-2109859919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:22:45 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-54e450a6-57d7-4eb8-8187-92d42277ad0f tempest-CinderUnicodeTest-2109859919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:22:45 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-54e450a6-57d7-4eb8-8187-92d42277ad0f tempest-CinderUnicodeTest-2109859919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:22:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-54e450a6-57d7-4eb8-8187-92d42277ad0f tempest-CinderUnicodeTest-2109859919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:22:45 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-54e450a6-57d7-4eb8-8187-92d42277ad0f tempest-CinderUnicodeTest-2109859919 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:22:45 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-54e450a6-57d7-4eb8-8187-92d42277ad0f tempest-CinderUnicodeTest-2109859919 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:22:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-54e450a6-57d7-4eb8-8187-92d42277ad0f tempest-CinderUnicodeTest-2109859919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cb8223d6-73e4-43c5-83af-c785ded608a7 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:22:45 devstack sudo[103508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cb8223d6-73e4-43c5-83af-c785ded608a7 1073741824
Jul 03 01:22:45 devstack sudo[103508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:22:46 devstack sudo[103508]: pam_unix(sudo:session): session closed for user root
Jul 03 01:22:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-54e450a6-57d7-4eb8-8187-92d42277ad0f tempest-CinderUnicodeTest-2109859919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cb8223d6-73e4-43c5-83af-c785ded608a7 1073741824" returned: 0 in 0.902s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:22:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-54e450a6-57d7-4eb8-8187-92d42277ad0f tempest-CinderUnicodeTest-2109859919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cb8223d6-73e4-43c5-83af-c785ded608a7 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:22:46 devstack sudo[103514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cb8223d6-73e4-43c5-83af-c785ded608a7
Jul 03 01:22:46 devstack sudo[103514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:22:47 devstack sudo[103514]: pam_unix(sudo:session): session closed for user root
Jul 03 01:22:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-54e450a6-57d7-4eb8-8187-92d42277ad0f tempest-CinderUnicodeTest-2109859919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cb8223d6-73e4-43c5-83af-c785ded608a7" returned: 0 in 0.645s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:22:47 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-54e450a6-57d7-4eb8-8187-92d42277ad0f tempest-CinderUnicodeTest-2109859919 None] <== create_volume: return (1598ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:22:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-54e450a6-57d7-4eb8-8187-92d42277ad0f tempest-CinderUnicodeTest-2109859919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.601s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:22:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-54e450a6-57d7-4eb8-8187-92d42277ad0f tempest-CinderUnicodeTest-2109859919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffc7b114-356e-4d75-ab05-5ab9e7dd5f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb8223d6-73e4-43c5-83af-c785ded608a7', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:22:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-54e450a6-57d7-4eb8-8187-92d42277ad0f tempest-CinderUnicodeTest-2109859919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6057cc1-4255-4e83-b518-0db94d7ae075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:22:47 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-54e450a6-57d7-4eb8-8187-92d42277ad0f tempest-CinderUnicodeTest-2109859919 None] Volume volume-cb8223d6-73e4-43c5-83af-c785ded608a7 (cb8223d6-73e4-43c5-83af-c785ded608a7): created successfully
Jul 03 01:22:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-54e450a6-57d7-4eb8-8187-92d42277ad0f tempest-CinderUnicodeTest-2109859919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6057cc1-4255-4e83-b518-0db94d7ae075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:22:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-54e450a6-57d7-4eb8-8187-92d42277ad0f tempest-CinderUnicodeTest-2109859919 None] Flow 'volume_create_manager' (26849373-527a-4b62-8c72-ed0801d9058c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:22:47 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-54e450a6-57d7-4eb8-8187-92d42277ad0f tempest-CinderUnicodeTest-2109859919 None] Created volume successfully.
Jul 03 01:22:47 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7db72fe-0c5f-4c86-bb5d-b2cee8c4ac50 tempest-CinderUnicodeTest-2109859919 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:22:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f7db72fe-0c5f-4c86-bb5d-b2cee8c4ac50 tempest-CinderUnicodeTest-2109859919 None] Flow 'volume_create_manager' (06830e47-ce28-4296-b791-30d11782bbc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:22:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f7db72fe-0c5f-4c86-bb5d-b2cee8c4ac50 tempest-CinderUnicodeTest-2109859919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a722206-ec30-446f-817d-32eb73e27b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:22:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f7db72fe-0c5f-4c86-bb5d-b2cee8c4ac50 tempest-CinderUnicodeTest-2109859919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a722206-ec30-446f-817d-32eb73e27b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:22:48Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-360097930',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cae11ede-cf88-4d64-a356-f24b0a56dab8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62812d0c52a94c8c92a34ecd924f51f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:22:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:22:48Z,use_quota=True,user_id='c04ae883ef2f47e98eb4a3fd21a3beaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:22:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f7db72fe-0c5f-4c86-bb5d-b2cee8c4ac50 tempest-CinderUnicodeTest-2109859919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a5eb979-8a1f-4dc3-909f-89de071896ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:22:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f7db72fe-0c5f-4c86-bb5d-b2cee8c4ac50 tempest-CinderUnicodeTest-2109859919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a5eb979-8a1f-4dc3-909f-89de071896ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:22:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f7db72fe-0c5f-4c86-bb5d-b2cee8c4ac50 tempest-CinderUnicodeTest-2109859919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b04d344b-b8ca-430f-9113-2eb1e2de72a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:22:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f7db72fe-0c5f-4c86-bb5d-b2cee8c4ac50 tempest-CinderUnicodeTest-2109859919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b04d344b-b8ca-430f-9113-2eb1e2de72a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cae11ede-cf88-4d64-a356-f24b0a56dab8', 'volume_name': 'volume-cae11ede-cf88-4d64-a356-f24b0a56dab8', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:22:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f7db72fe-0c5f-4c86-bb5d-b2cee8c4ac50 tempest-CinderUnicodeTest-2109859919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a1c301b-69cf-4134-bb0e-caf87227c39a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:22:48 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f7db72fe-0c5f-4c86-bb5d-b2cee8c4ac50 tempest-CinderUnicodeTest-2109859919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a1c301b-69cf-4134-bb0e-caf87227c39a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:22:48 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f7db72fe-0c5f-4c86-bb5d-b2cee8c4ac50 tempest-CinderUnicodeTest-2109859919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad8f793e-45e7-4e91-b7e2-b325a7aa1fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:22:48 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-f7db72fe-0c5f-4c86-bb5d-b2cee8c4ac50 tempest-CinderUnicodeTest-2109859919 None] Volume cae11ede-cf88-4d64-a356-f24b0a56dab8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cae11ede-cf88-4d64-a356-f24b0a56dab8', 'volume_size': 1}
Jul 03 01:22:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f7db72fe-0c5f-4c86-bb5d-b2cee8c4ac50 tempest-CinderUnicodeTest-2109859919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:22:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f7db72fe-0c5f-4c86-bb5d-b2cee8c4ac50 tempest-CinderUnicodeTest-2109859919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:22:48 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-f7db72fe-0c5f-4c86-bb5d-b2cee8c4ac50 tempest-CinderUnicodeTest-2109859919 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:22:48Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-360097930',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cae11ede-cf88-4d64-a356-f24b0a56dab8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62812d0c52a94c8c92a34ecd924f51f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:22:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:22:48Z,use_quota=True,user_id='c04ae883ef2f47e98eb4a3fd21a3beaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:22:48 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-f7db72fe-0c5f-4c86-bb5d-b2cee8c4ac50 tempest-CinderUnicodeTest-2109859919 None] Creating volume cae11ede-cf88-4d64-a356-f24b0a56dab8 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:22:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f7db72fe-0c5f-4c86-bb5d-b2cee8c4ac50 tempest-CinderUnicodeTest-2109859919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:22:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f7db72fe-0c5f-4c86-bb5d-b2cee8c4ac50 tempest-CinderUnicodeTest-2109859919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:22:48 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-f7db72fe-0c5f-4c86-bb5d-b2cee8c4ac50 tempest-CinderUnicodeTest-2109859919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:22:48 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-f7db72fe-0c5f-4c86-bb5d-b2cee8c4ac50 tempest-CinderUnicodeTest-2109859919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:22:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f7db72fe-0c5f-4c86-bb5d-b2cee8c4ac50 tempest-CinderUnicodeTest-2109859919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:22:48 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-f7db72fe-0c5f-4c86-bb5d-b2cee8c4ac50 tempest-CinderUnicodeTest-2109859919 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:22:48 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-f7db72fe-0c5f-4c86-bb5d-b2cee8c4ac50 tempest-CinderUnicodeTest-2109859919 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:22:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f7db72fe-0c5f-4c86-bb5d-b2cee8c4ac50 tempest-CinderUnicodeTest-2109859919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cae11ede-cf88-4d64-a356-f24b0a56dab8 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:22:48 devstack sudo[103517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cae11ede-cf88-4d64-a356-f24b0a56dab8 1073741824
Jul 03 01:22:48 devstack sudo[103517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:22:48 devstack sudo[103517]: pam_unix(sudo:session): session closed for user root
Jul 03 01:22:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f7db72fe-0c5f-4c86-bb5d-b2cee8c4ac50 tempest-CinderUnicodeTest-2109859919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cae11ede-cf88-4d64-a356-f24b0a56dab8 1073741824" returned: 0 in 0.831s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:22:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f7db72fe-0c5f-4c86-bb5d-b2cee8c4ac50 tempest-CinderUnicodeTest-2109859919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cae11ede-cf88-4d64-a356-f24b0a56dab8 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:22:48 devstack sudo[103523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cae11ede-cf88-4d64-a356-f24b0a56dab8
Jul 03 01:22:48 devstack sudo[103523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:22:49 devstack sudo[103523]: pam_unix(sudo:session): session closed for user root
Jul 03 01:22:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f7db72fe-0c5f-4c86-bb5d-b2cee8c4ac50 tempest-CinderUnicodeTest-2109859919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cae11ede-cf88-4d64-a356-f24b0a56dab8" returned: 0 in 0.638s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:22:49 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-f7db72fe-0c5f-4c86-bb5d-b2cee8c4ac50 tempest-CinderUnicodeTest-2109859919 None] <== create_volume: return (1523ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:22:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f7db72fe-0c5f-4c86-bb5d-b2cee8c4ac50 tempest-CinderUnicodeTest-2109859919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.527s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:22:49 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f7db72fe-0c5f-4c86-bb5d-b2cee8c4ac50 tempest-CinderUnicodeTest-2109859919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad8f793e-45e7-4e91-b7e2-b325a7aa1fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cae11ede-cf88-4d64-a356-f24b0a56dab8', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:22:49 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f7db72fe-0c5f-4c86-bb5d-b2cee8c4ac50 tempest-CinderUnicodeTest-2109859919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66a27c82-3c2a-4f0c-8db4-3d24dab91bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:22:49 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-f7db72fe-0c5f-4c86-bb5d-b2cee8c4ac50 tempest-CinderUnicodeTest-2109859919 None] Volume volume-cae11ede-cf88-4d64-a356-f24b0a56dab8 (cae11ede-cf88-4d64-a356-f24b0a56dab8): created successfully
Jul 03 01:22:49 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f7db72fe-0c5f-4c86-bb5d-b2cee8c4ac50 tempest-CinderUnicodeTest-2109859919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66a27c82-3c2a-4f0c-8db4-3d24dab91bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:22:49 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f7db72fe-0c5f-4c86-bb5d-b2cee8c4ac50 tempest-CinderUnicodeTest-2109859919 None] Flow 'volume_create_manager' (06830e47-ce28-4296-b791-30d11782bbc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:22:49 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-f7db72fe-0c5f-4c86-bb5d-b2cee8c4ac50 tempest-CinderUnicodeTest-2109859919 None] Created volume successfully.
Jul 03 01:22:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-2f7ad1c2-2849-4a1d-81f3-2bfb729959cc tempest-CinderUnicodeTest-2109859919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:22:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-2f7ad1c2-2849-4a1d-81f3-2bfb729959cc tempest-CinderUnicodeTest-2109859919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:22:50 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-2f7ad1c2-2849-4a1d-81f3-2bfb729959cc tempest-CinderUnicodeTest-2109859919 None] Creating offline snapshot aab3b68e-81fd-4fc5-962a-75df35e6aea3 of volume cae11ede-cf88-4d64-a356-f24b0a56dab8 {{(pid=86891) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 01:22:50 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[60063603-e489-495d-ba4f-f1c7ed110587]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:22:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-2f7ad1c2-2849-4a1d-81f3-2bfb729959cc tempest-CinderUnicodeTest-2109859919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cae11ede-cf88-4d64-a356-f24b0a56dab8 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:22:50 devstack sudo[103526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cae11ede-cf88-4d64-a356-f24b0a56dab8
Jul 03 01:22:50 devstack sudo[103526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:22:51 devstack sudo[103526]: pam_unix(sudo:session): session closed for user root
Jul 03 01:22:51 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-2f7ad1c2-2849-4a1d-81f3-2bfb729959cc tempest-CinderUnicodeTest-2109859919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cae11ede-cf88-4d64-a356-f24b0a56dab8" returned: 0 in 0.788s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:22:51 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-2f7ad1c2-2849-4a1d-81f3-2bfb729959cc tempest-CinderUnicodeTest-2109859919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cae11ede-cf88-4d64-a356-f24b0a56dab8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cae11ede-cf88-4d64-a356-f24b0a56dab8.aab3b68e-81fd-4fc5-962a-75df35e6aea3 1G {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:22:51 devstack sudo[103531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cae11ede-cf88-4d64-a356-f24b0a56dab8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cae11ede-cf88-4d64-a356-f24b0a56dab8.aab3b68e-81fd-4fc5-962a-75df35e6aea3 1G
Jul 03 01:22:51 devstack sudo[103531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:22:51 devstack sudo[103531]: pam_unix(sudo:session): session closed for user root
Jul 03 01:22:51 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-2f7ad1c2-2849-4a1d-81f3-2bfb729959cc tempest-CinderUnicodeTest-2109859919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cae11ede-cf88-4d64-a356-f24b0a56dab8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cae11ede-cf88-4d64-a356-f24b0a56dab8.aab3b68e-81fd-4fc5-962a-75df35e6aea3 1G" returned: 0 in 0.842s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:22:51 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-2f7ad1c2-2849-4a1d-81f3-2bfb729959cc tempest-CinderUnicodeTest-2109859919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cae11ede-cf88-4d64-a356-f24b0a56dab8 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cae11ede-cf88-4d64-a356-f24b0a56dab8.aab3b68e-81fd-4fc5-962a-75df35e6aea3 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:22:51 devstack sudo[103536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cae11ede-cf88-4d64-a356-f24b0a56dab8 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cae11ede-cf88-4d64-a356-f24b0a56dab8.aab3b68e-81fd-4fc5-962a-75df35e6aea3
Jul 03 01:22:51 devstack sudo[103536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:22:52 devstack sudo[103536]: pam_unix(sudo:session): session closed for user root
Jul 03 01:22:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-2f7ad1c2-2849-4a1d-81f3-2bfb729959cc tempest-CinderUnicodeTest-2109859919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cae11ede-cf88-4d64-a356-f24b0a56dab8 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cae11ede-cf88-4d64-a356-f24b0a56dab8.aab3b68e-81fd-4fc5-962a-75df35e6aea3" returned: 0 in 0.681s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:22:52 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-2f7ad1c2-2849-4a1d-81f3-2bfb729959cc tempest-CinderUnicodeTest-2109859919 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cae11ede-cf88-4d64-a356-f24b0a56dab8.aab3b68e-81fd-4fc5-962a-75df35e6aea3 is being set with open permissions: ugo+rw
Jul 03 01:22:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-2f7ad1c2-2849-4a1d-81f3-2bfb729959cc tempest-CinderUnicodeTest-2109859919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cae11ede-cf88-4d64-a356-f24b0a56dab8.aab3b68e-81fd-4fc5-962a-75df35e6aea3 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:22:52 devstack sudo[103541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cae11ede-cf88-4d64-a356-f24b0a56dab8.aab3b68e-81fd-4fc5-962a-75df35e6aea3
Jul 03 01:22:52 devstack sudo[103541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:22:53 devstack sudo[103541]: pam_unix(sudo:session): session closed for user root
Jul 03 01:22:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-2f7ad1c2-2849-4a1d-81f3-2bfb729959cc tempest-CinderUnicodeTest-2109859919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cae11ede-cf88-4d64-a356-f24b0a56dab8.aab3b68e-81fd-4fc5-962a-75df35e6aea3" returned: 0 in 0.641s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:22:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-2f7ad1c2-2849-4a1d-81f3-2bfb729959cc tempest-CinderUnicodeTest-2109859919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cae11ede-cf88-4d64-a356-f24b0a56dab8.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:22:53 devstack sudo[103544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cae11ede-cf88-4d64-a356-f24b0a56dab8.info
Jul 03 01:22:53 devstack sudo[103544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:22:53 devstack sudo[103544]: pam_unix(sudo:session): session closed for user root
Jul 03 01:22:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-2f7ad1c2-2849-4a1d-81f3-2bfb729959cc tempest-CinderUnicodeTest-2109859919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cae11ede-cf88-4d64-a356-f24b0a56dab8.info" returned: 0 in 0.624s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:22:53 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-2f7ad1c2-2849-4a1d-81f3-2bfb729959cc tempest-CinderUnicodeTest-2109859919 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cae11ede-cf88-4d64-a356-f24b0a56dab8.info is being set with open permissions: ugo+rw
Jul 03 01:22:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-2f7ad1c2-2849-4a1d-81f3-2bfb729959cc tempest-CinderUnicodeTest-2109859919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cae11ede-cf88-4d64-a356-f24b0a56dab8.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:22:53 devstack sudo[103547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cae11ede-cf88-4d64-a356-f24b0a56dab8.info
Jul 03 01:22:53 devstack sudo[103547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:22:54 devstack sudo[103547]: pam_unix(sudo:session): session closed for user root
Jul 03 01:22:54 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-2f7ad1c2-2849-4a1d-81f3-2bfb729959cc tempest-CinderUnicodeTest-2109859919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cae11ede-cf88-4d64-a356-f24b0a56dab8.info" returned: 0 in 0.629s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:22:54 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-2f7ad1c2-2849-4a1d-81f3-2bfb729959cc tempest-CinderUnicodeTest-2109859919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.298s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:22:54 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-2f7ad1c2-2849-4a1d-81f3-2bfb729959cc tempest-CinderUnicodeTest-2109859919 None] Create snapshot completed successfully
Jul 03 01:22:55 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-ee9b2747-116a-4c52-bbfe-290633ea469d tempest-CinderUnicodeTest-2109859919 None] Acquiring lock "cinder-aab3b68e-81fd-4fc5-962a-75df35e6aea3-delete_snapshot" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:22:55 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-ee9b2747-116a-4c52-bbfe-290633ea469d tempest-CinderUnicodeTest-2109859919 None] Lock "cinder-aab3b68e-81fd-4fc5-962a-75df35e6aea3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:22:55 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-ee9b2747-116a-4c52-bbfe-290633ea469d tempest-CinderUnicodeTest-2109859919 None] Acquiring lock "cinder-quobyte-cae11ede-cf88-4d64-a356-f24b0a56dab8" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:22:55 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-ee9b2747-116a-4c52-bbfe-290633ea469d tempest-CinderUnicodeTest-2109859919 None] Lock "cinder-quobyte-cae11ede-cf88-4d64-a356-f24b0a56dab8" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:22:55 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-ee9b2747-116a-4c52-bbfe-290633ea469d tempest-CinderUnicodeTest-2109859919 None] Acquiring lock "cinder-quobyte-aab3b68e-81fd-4fc5-962a-75df35e6aea3" by "_delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:22:55 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-ee9b2747-116a-4c52-bbfe-290633ea469d tempest-CinderUnicodeTest-2109859919 None] Lock "cinder-quobyte-aab3b68e-81fd-4fc5-962a-75df35e6aea3" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:22:55 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-ee9b2747-116a-4c52-bbfe-290633ea469d tempest-CinderUnicodeTest-2109859919 None] Deleting offline snapshot aab3b68e-81fd-4fc5-962a-75df35e6aea3 of volume cae11ede-cf88-4d64-a356-f24b0a56dab8 {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 01:22:55 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-ee9b2747-116a-4c52-bbfe-290633ea469d tempest-CinderUnicodeTest-2109859919 None] snapshot_file for this snap is: volume-cae11ede-cf88-4d64-a356-f24b0a56dab8.aab3b68e-81fd-4fc5-962a-75df35e6aea3 {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 01:22:55 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0923f43-8b02-474f-9a5f-35a675c70779]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:22:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-ee9b2747-116a-4c52-bbfe-290633ea469d tempest-CinderUnicodeTest-2109859919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cae11ede-cf88-4d64-a356-f24b0a56dab8.aab3b68e-81fd-4fc5-962a-75df35e6aea3 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:22:55 devstack sudo[103555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cae11ede-cf88-4d64-a356-f24b0a56dab8.aab3b68e-81fd-4fc5-962a-75df35e6aea3
Jul 03 01:22:55 devstack sudo[103555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:22:56 devstack sudo[103555]: pam_unix(sudo:session): session closed for user root
Jul 03 01:22:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-ee9b2747-116a-4c52-bbfe-290633ea469d tempest-CinderUnicodeTest-2109859919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cae11ede-cf88-4d64-a356-f24b0a56dab8.aab3b68e-81fd-4fc5-962a-75df35e6aea3" returned: 0 in 0.715s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:22:56 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-ee9b2747-116a-4c52-bbfe-290633ea469d tempest-CinderUnicodeTest-2109859919 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cae11ede-cf88-4d64-a356-f24b0a56dab8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:22:56 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ff7998-f3d4-460f-81b8-456564923fbb]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:22:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-ee9b2747-116a-4c52-bbfe-290633ea469d tempest-CinderUnicodeTest-2109859919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cae11ede-cf88-4d64-a356-f24b0a56dab8 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:22:56 devstack sudo[103560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cae11ede-cf88-4d64-a356-f24b0a56dab8
Jul 03 01:22:56 devstack sudo[103560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:22:57 devstack sudo[103560]: pam_unix(sudo:session): session closed for user root
Jul 03 01:22:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-ee9b2747-116a-4c52-bbfe-290633ea469d tempest-CinderUnicodeTest-2109859919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cae11ede-cf88-4d64-a356-f24b0a56dab8" returned: 0 in 0.730s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:22:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-ee9b2747-116a-4c52-bbfe-290633ea469d tempest-CinderUnicodeTest-2109859919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cae11ede-cf88-4d64-a356-f24b0a56dab8.aab3b68e-81fd-4fc5-962a-75df35e6aea3 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:22:57 devstack sudo[103589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cae11ede-cf88-4d64-a356-f24b0a56dab8.aab3b68e-81fd-4fc5-962a-75df35e6aea3
Jul 03 01:22:57 devstack sudo[103589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:22:57 devstack sudo[103589]: pam_unix(sudo:session): session closed for user root
Jul 03 01:22:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-ee9b2747-116a-4c52-bbfe-290633ea469d tempest-CinderUnicodeTest-2109859919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cae11ede-cf88-4d64-a356-f24b0a56dab8.aab3b68e-81fd-4fc5-962a-75df35e6aea3" returned: 0 in 0.738s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:22:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-ee9b2747-116a-4c52-bbfe-290633ea469d tempest-CinderUnicodeTest-2109859919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cae11ede-cf88-4d64-a356-f24b0a56dab8.aab3b68e-81fd-4fc5-962a-75df35e6aea3 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:22:57 devstack sudo[103594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cae11ede-cf88-4d64-a356-f24b0a56dab8.aab3b68e-81fd-4fc5-962a-75df35e6aea3
Jul 03 01:22:57 devstack sudo[103594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:22:58 devstack sudo[103594]: pam_unix(sudo:session): session closed for user root
Jul 03 01:22:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-ee9b2747-116a-4c52-bbfe-290633ea469d tempest-CinderUnicodeTest-2109859919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cae11ede-cf88-4d64-a356-f24b0a56dab8.aab3b68e-81fd-4fc5-962a-75df35e6aea3" returned: 0 in 0.614s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:22:58 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-ee9b2747-116a-4c52-bbfe-290633ea469d tempest-CinderUnicodeTest-2109859919 None] Lock "cinder-quobyte-aab3b68e-81fd-4fc5-962a-75df35e6aea3" released by "_delete_snapshot" :: held 2.901s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:22:58 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-ee9b2747-116a-4c52-bbfe-290633ea469d tempest-CinderUnicodeTest-2109859919 None] Lock "cinder-quobyte-cae11ede-cf88-4d64-a356-f24b0a56dab8" released by "delete_snapshot" :: held 2.923s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:22:58 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-ee9b2747-116a-4c52-bbfe-290633ea469d tempest-CinderUnicodeTest-2109859919 None] Created reservations ['b0b6e4df-7b70-4056-90a3-3d3883208927', 'e9b238f3-f312-49eb-b69a-2f0149dcd107', '4009e3e1-cbe1-42f8-bf60-489d294e77b3', '9d25bfc5-c796-4590-9104-54c603e1b331'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:22:58 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-ee9b2747-116a-4c52-bbfe-290633ea469d tempest-CinderUnicodeTest-2109859919 None] Delete snapshot completed successfully.
Jul 03 01:22:58 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-ee9b2747-116a-4c52-bbfe-290633ea469d tempest-CinderUnicodeTest-2109859919 None] Lock "cinder-aab3b68e-81fd-4fc5-962a-75df35e6aea3-delete_snapshot" released by "delete_snapshot" :: held 3.042s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:22:58 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-0bf551e4-6441-4005-91d4-84ffd25b6cbb tempest-CinderUnicodeTest-2109859919 None] Acquiring lock "cinder-cae11ede-cf88-4d64-a356-f24b0a56dab8-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:22:58 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-0bf551e4-6441-4005-91d4-84ffd25b6cbb tempest-CinderUnicodeTest-2109859919 None] Lock "cinder-cae11ede-cf88-4d64-a356-f24b0a56dab8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:22:58 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-0bf551e4-6441-4005-91d4-84ffd25b6cbb tempest-CinderUnicodeTest-2109859919 None] Acquiring lock "cinder-quobyte-cae11ede-cf88-4d64-a356-f24b0a56dab8" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:22:58 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-0bf551e4-6441-4005-91d4-84ffd25b6cbb tempest-CinderUnicodeTest-2109859919 None] Lock "cinder-quobyte-cae11ede-cf88-4d64-a356-f24b0a56dab8" acquired by "delete_volume" :: waited 0.013s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:22:58 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[3700e5ff-8f5b-4245-bb5f-6533fda61495]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:22:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0bf551e4-6441-4005-91d4-84ffd25b6cbb tempest-CinderUnicodeTest-2109859919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cae11ede-cf88-4d64-a356-f24b0a56dab8 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:22:58 devstack sudo[103598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cae11ede-cf88-4d64-a356-f24b0a56dab8
Jul 03 01:22:58 devstack sudo[103598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:22:59 devstack sudo[103598]: pam_unix(sudo:session): session closed for user root
Jul 03 01:22:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0bf551e4-6441-4005-91d4-84ffd25b6cbb tempest-CinderUnicodeTest-2109859919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cae11ede-cf88-4d64-a356-f24b0a56dab8" returned: 0 in 0.723s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:22:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0bf551e4-6441-4005-91d4-84ffd25b6cbb tempest-CinderUnicodeTest-2109859919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cae11ede-cf88-4d64-a356-f24b0a56dab8 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:22:59 devstack sudo[103603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cae11ede-cf88-4d64-a356-f24b0a56dab8
Jul 03 01:22:59 devstack sudo[103603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:23:00 devstack sudo[103603]: pam_unix(sudo:session): session closed for user root
Jul 03 01:23:00 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0bf551e4-6441-4005-91d4-84ffd25b6cbb tempest-CinderUnicodeTest-2109859919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cae11ede-cf88-4d64-a356-f24b0a56dab8" returned: 0 in 0.602s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:23:00 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-0bf551e4-6441-4005-91d4-84ffd25b6cbb tempest-CinderUnicodeTest-2109859919 None] Lock "cinder-quobyte-cae11ede-cf88-4d64-a356-f24b0a56dab8" released by "delete_volume" :: held 1.379s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:23:00 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-0bf551e4-6441-4005-91d4-84ffd25b6cbb tempest-CinderUnicodeTest-2109859919 None] Created reservations ['b7c6c6ff-6ebf-45f6-ac6f-cb2c0cd78cef', '867a6b74-69c5-4797-a234-b37d9d5c32a5', '876ea9d1-ec0b-4051-afbb-d49c879a196a', '96d76b83-309e-4b95-a541-8d89ea63619b'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:23:00 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-0bf551e4-6441-4005-91d4-84ffd25b6cbb tempest-CinderUnicodeTest-2109859919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:23:00 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-0bf551e4-6441-4005-91d4-84ffd25b6cbb tempest-CinderUnicodeTest-2109859919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:23:00 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-0bf551e4-6441-4005-91d4-84ffd25b6cbb tempest-CinderUnicodeTest-2109859919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:23:00 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-0bf551e4-6441-4005-91d4-84ffd25b6cbb tempest-CinderUnicodeTest-2109859919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:23:00 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-0bf551e4-6441-4005-91d4-84ffd25b6cbb tempest-CinderUnicodeTest-2109859919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:23:00 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0bf551e4-6441-4005-91d4-84ffd25b6cbb tempest-CinderUnicodeTest-2109859919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:23:00 devstack sudo[103606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:23:00 devstack sudo[103606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:23:00 devstack sudo[103606]: pam_unix(sudo:session): session closed for user root
Jul 03 01:23:00 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0bf551e4-6441-4005-91d4-84ffd25b6cbb tempest-CinderUnicodeTest-2109859919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.613s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:23:00 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-0bf551e4-6441-4005-91d4-84ffd25b6cbb tempest-CinderUnicodeTest-2109859919 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:23:00 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-0bf551e4-6441-4005-91d4-84ffd25b6cbb tempest-CinderUnicodeTest-2109859919 None] Deleted volume successfully.
Jul 03 01:23:00 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-0bf551e4-6441-4005-91d4-84ffd25b6cbb tempest-CinderUnicodeTest-2109859919 None] Lock "cinder-cae11ede-cf88-4d64-a356-f24b0a56dab8-delete_volume" released by "delete_volume" :: held 2.171s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:23:00 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-37ee993c-8dd7-4a4b-ad3a-5b29ab1a965c tempest-CinderUnicodeTest-2109859919 None] Acquiring lock "cinder-cb8223d6-73e4-43c5-83af-c785ded608a7-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:23:00 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-37ee993c-8dd7-4a4b-ad3a-5b29ab1a965c tempest-CinderUnicodeTest-2109859919 None] Lock "cinder-cb8223d6-73e4-43c5-83af-c785ded608a7-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:23:00 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-37ee993c-8dd7-4a4b-ad3a-5b29ab1a965c tempest-CinderUnicodeTest-2109859919 None] Acquiring lock "cinder-quobyte-cb8223d6-73e4-43c5-83af-c785ded608a7" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:23:00 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-37ee993c-8dd7-4a4b-ad3a-5b29ab1a965c tempest-CinderUnicodeTest-2109859919 None] Lock "cinder-quobyte-cb8223d6-73e4-43c5-83af-c785ded608a7" acquired by "delete_volume" :: waited 0.013s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:23:01 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[909ea504-e7cb-4791-8795-b91e2e294754]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:23:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-37ee993c-8dd7-4a4b-ad3a-5b29ab1a965c tempest-CinderUnicodeTest-2109859919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cb8223d6-73e4-43c5-83af-c785ded608a7 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:23:01 devstack sudo[103609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cb8223d6-73e4-43c5-83af-c785ded608a7
Jul 03 01:23:01 devstack sudo[103609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:23:01 devstack sudo[103609]: pam_unix(sudo:session): session closed for user root
Jul 03 01:23:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-37ee993c-8dd7-4a4b-ad3a-5b29ab1a965c tempest-CinderUnicodeTest-2109859919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cb8223d6-73e4-43c5-83af-c785ded608a7" returned: 0 in 0.843s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:23:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-37ee993c-8dd7-4a4b-ad3a-5b29ab1a965c tempest-CinderUnicodeTest-2109859919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cb8223d6-73e4-43c5-83af-c785ded608a7 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:23:01 devstack sudo[103614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cb8223d6-73e4-43c5-83af-c785ded608a7
Jul 03 01:23:01 devstack sudo[103614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:23:01 devstack cinder-volume[86891]: DEBUG oslo_service.periodic_task [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86891) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 01:23:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:23:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:23:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:23:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:23:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:23:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:23:01 devstack sudo[103616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:23:01 devstack sudo[103616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:23:02 devstack sudo[103614]: pam_unix(sudo:session): session closed for user root
Jul 03 01:23:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-37ee993c-8dd7-4a4b-ad3a-5b29ab1a965c tempest-CinderUnicodeTest-2109859919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cb8223d6-73e4-43c5-83af-c785ded608a7" returned: 0 in 0.748s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:23:02 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-37ee993c-8dd7-4a4b-ad3a-5b29ab1a965c tempest-CinderUnicodeTest-2109859919 None] Lock "cinder-quobyte-cb8223d6-73e4-43c5-83af-c785ded608a7" released by "delete_volume" :: held 1.632s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:23:02 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-37ee993c-8dd7-4a4b-ad3a-5b29ab1a965c tempest-CinderUnicodeTest-2109859919 None] Created reservations ['e3e6b627-3a8b-450e-b3e9-1879def4e4d2', '9dc0a567-4ac6-4245-8fc6-a6b3053826a3', '3bdf9cc4-3b06-4571-81dd-c563c26be2ff', '34bc0bb3-4603-4437-8c36-38dc860ade4a'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:23:02 devstack sudo[103616]: pam_unix(sudo:session): session closed for user root
Jul 03 01:23:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.750s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:23:02 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:23:02 devstack cinder-volume[86891]: DEBUG oslo_service.periodic_task [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running periodic task VolumeManager._thread_info {{(pid=86891) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 01:23:02 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] thread count: 28 {{(pid=86891) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 01:23:02 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] thread info: [<_MainThread(MainThread, started 136731296534656)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136731184953280)>, <Thread(Thread-3 (stat_writer), started daemon 136731184058816)>, <Thread(Rabbit-heartbeat, started daemon 136731184846080)>, <Thread(Thread-5 (_runner), started daemon 136731182936576)>, <Thread(Thread-7 (_runner), started daemon 136731182954944)>, <Thread(fd_logger, started daemon 136731181916416)>, <Thread(privsep_reader, started daemon 136731180942208)>, <Thread(tpool_thread_0, started daemon 136731172161216)>, <Thread(tpool_thread_1, started daemon 136731163768512)>, <Thread(tpool_thread_2, started daemon 136731155375808)>, <Thread(tpool_thread_3, started daemon 136731146983104)>, <Thread(tpool_thread_4, started daemon 136731138590400)>, <Thread(tpool_thread_5, started daemon 136731130197696)>, <Thread(tpool_thread_6, started daemon 136731121804992)>, <Thread(tpool_thread_7, started daemon 136731113412288)>, <Thread(tpool_thread_8, started daemon 136731105003200)>, <Thread(tpool_thread_9, started daemon 136731096594112)>, <Thread(tpool_thread_10, started daemon 136731088185024)>, <Thread(tpool_thread_11, started daemon 136731079775936)>, <Thread(tpool_thread_12, started daemon 136731071366848)>, <Thread(tpool_thread_13, started daemon 136731062957760)>, <Thread(tpool_thread_14, started daemon 136731054548672)>, <Thread(tpool_thread_15, started daemon 136731046139584)>, <Thread(tpool_thread_16, started daemon 136731037730496)>, <Thread(tpool_thread_17, started daemon 136731029321408)>, <Thread(tpool_thread_18, started daemon 136731020912320)>, <Thread(tpool_thread_19, started daemon 136731012503232)>] {{(pid=86891) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 01:23:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-37ee993c-8dd7-4a4b-ad3a-5b29ab1a965c tempest-CinderUnicodeTest-2109859919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:23:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-37ee993c-8dd7-4a4b-ad3a-5b29ab1a965c tempest-CinderUnicodeTest-2109859919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:23:02 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-37ee993c-8dd7-4a4b-ad3a-5b29ab1a965c tempest-CinderUnicodeTest-2109859919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:23:02 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-37ee993c-8dd7-4a4b-ad3a-5b29ab1a965c tempest-CinderUnicodeTest-2109859919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:23:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-37ee993c-8dd7-4a4b-ad3a-5b29ab1a965c tempest-CinderUnicodeTest-2109859919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:23:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-37ee993c-8dd7-4a4b-ad3a-5b29ab1a965c tempest-CinderUnicodeTest-2109859919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:23:02 devstack sudo[103620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:23:02 devstack sudo[103620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:23:03 devstack sudo[103620]: pam_unix(sudo:session): session closed for user root
Jul 03 01:23:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-37ee993c-8dd7-4a4b-ad3a-5b29ab1a965c tempest-CinderUnicodeTest-2109859919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.734s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:23:03 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-37ee993c-8dd7-4a4b-ad3a-5b29ab1a965c tempest-CinderUnicodeTest-2109859919 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:23:03 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-37ee993c-8dd7-4a4b-ad3a-5b29ab1a965c tempest-CinderUnicodeTest-2109859919 None] Deleted volume successfully.
Jul 03 01:23:03 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-37ee993c-8dd7-4a4b-ad3a-5b29ab1a965c tempest-CinderUnicodeTest-2109859919 None] Lock "cinder-cb8223d6-73e4-43c5-83af-c785ded608a7-delete_volume" released by "delete_volume" :: held 2.599s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:23:12 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:SELECT=24,cinder:UPDATE=32,cinder:INSERT=8,cinder:DELETE=1 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:23:13 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:SELECT=23,cinder:UPDATE=27,cinder:DELETE=4,cinder:INSERT=7 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:23:24 devstack cinder-volume[86891]: INFO cinder.volume.manager [req-c78d6666-ba13-4e12-a819-4001a354239b req-c28b22de-2ad3-47ae-9b1d-f4cf2f04c1e2 tempest-TestShelveInstance-57035342 None] Terminate volume connection completed successfully.
Jul 03 01:23:24 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [req-c78d6666-ba13-4e12-a819-4001a354239b req-c28b22de-2ad3-47ae-9b1d-f4cf2f04c1e2 tempest-TestShelveInstance-57035342 None] Deleting attachment 306f67c4-e483-49ca-9a03-c0bcdda2d0dd. {{(pid=86891) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 01:23:24 devstack cinder-volume[86891]: DEBUG cinder.coordination [req-c78d6666-ba13-4e12-a819-4001a354239b req-b2d12887-875e-4e4f-8cad-69d9a131547a tempest-TestShelveInstance-57035342 None] Acquiring lock "cinder-2c9ba326-e4f6-474a-aea9-3c3d2466fcad-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:23:25 devstack cinder-volume[86891]: DEBUG cinder.coordination [req-c78d6666-ba13-4e12-a819-4001a354239b req-b2d12887-875e-4e4f-8cad-69d9a131547a tempest-TestShelveInstance-57035342 None] Lock "cinder-2c9ba326-e4f6-474a-aea9-3c3d2466fcad-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:23:25 devstack cinder-volume[86891]: DEBUG cinder.coordination [req-c78d6666-ba13-4e12-a819-4001a354239b req-b2d12887-875e-4e4f-8cad-69d9a131547a tempest-TestShelveInstance-57035342 None] Acquiring lock "cinder-quobyte-2c9ba326-e4f6-474a-aea9-3c3d2466fcad" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:23:25 devstack cinder-volume[86891]: DEBUG cinder.coordination [req-c78d6666-ba13-4e12-a819-4001a354239b req-b2d12887-875e-4e4f-8cad-69d9a131547a tempest-TestShelveInstance-57035342 None] Lock "cinder-quobyte-2c9ba326-e4f6-474a-aea9-3c3d2466fcad" acquired by "delete_volume" :: waited 0.016s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:23:25 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[4138732c-a9c1-496b-b928-689e5c5eb5fe]: (4, 'raw') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:23:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-c78d6666-ba13-4e12-a819-4001a354239b req-b2d12887-875e-4e4f-8cad-69d9a131547a tempest-TestShelveInstance-57035342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2c9ba326-e4f6-474a-aea9-3c3d2466fcad {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:23:25 devstack sudo[103686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2c9ba326-e4f6-474a-aea9-3c3d2466fcad
Jul 03 01:23:25 devstack sudo[103686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:23:25 devstack sudo[103686]: pam_unix(sudo:session): session closed for user root
Jul 03 01:23:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-c78d6666-ba13-4e12-a819-4001a354239b req-b2d12887-875e-4e4f-8cad-69d9a131547a tempest-TestShelveInstance-57035342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2c9ba326-e4f6-474a-aea9-3c3d2466fcad" returned: 0 in 0.756s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:23:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-c78d6666-ba13-4e12-a819-4001a354239b req-b2d12887-875e-4e4f-8cad-69d9a131547a tempest-TestShelveInstance-57035342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2c9ba326-e4f6-474a-aea9-3c3d2466fcad {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:23:25 devstack sudo[103690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2c9ba326-e4f6-474a-aea9-3c3d2466fcad
Jul 03 01:23:25 devstack sudo[103690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:23:26 devstack sudo[103690]: pam_unix(sudo:session): session closed for user root
Jul 03 01:23:26 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-c78d6666-ba13-4e12-a819-4001a354239b req-b2d12887-875e-4e4f-8cad-69d9a131547a tempest-TestShelveInstance-57035342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2c9ba326-e4f6-474a-aea9-3c3d2466fcad" returned: 1 in 0.743s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:23:26 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-c78d6666-ba13-4e12-a819-4001a354239b req-b2d12887-875e-4e4f-8cad-69d9a131547a tempest-TestShelveInstance-57035342 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2c9ba326-e4f6-474a-aea9-3c3d2466fcad' failed. Not Retrying. {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 01:23:26 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-c78d6666-ba13-4e12-a819-4001a354239b req-b2d12887-875e-4e4f-8cad-69d9a131547a tempest-TestShelveInstance-57035342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2c9ba326-e4f6-474a-aea9-3c3d2466fcad {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:23:26 devstack sudo[103695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2c9ba326-e4f6-474a-aea9-3c3d2466fcad
Jul 03 01:23:26 devstack sudo[103695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:23:27 devstack sudo[103695]: pam_unix(sudo:session): session closed for user root
Jul 03 01:23:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-c78d6666-ba13-4e12-a819-4001a354239b req-b2d12887-875e-4e4f-8cad-69d9a131547a tempest-TestShelveInstance-57035342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2c9ba326-e4f6-474a-aea9-3c3d2466fcad" returned: 0 in 0.730s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:23:27 devstack cinder-volume[86891]: DEBUG cinder.coordination [req-c78d6666-ba13-4e12-a819-4001a354239b req-b2d12887-875e-4e4f-8cad-69d9a131547a tempest-TestShelveInstance-57035342 None] Lock "cinder-quobyte-2c9ba326-e4f6-474a-aea9-3c3d2466fcad" released by "delete_volume" :: held 2.308s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:23:27 devstack cinder-volume[86891]: DEBUG cinder.quota [req-c78d6666-ba13-4e12-a819-4001a354239b req-b2d12887-875e-4e4f-8cad-69d9a131547a tempest-TestShelveInstance-57035342 None] Created reservations ['46f53e2a-9848-4751-a7e0-984aa8dbd12e', '4c001dfb-2662-42e8-9cd1-c02cefac059b', '49b7dbe3-9f1a-4f4b-907f-1f259c5dbea9', '6786df45-6b49-4ed5-bc64-1674755c1c46'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:23:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-c78d6666-ba13-4e12-a819-4001a354239b req-b2d12887-875e-4e4f-8cad-69d9a131547a tempest-TestShelveInstance-57035342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:23:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-c78d6666-ba13-4e12-a819-4001a354239b req-b2d12887-875e-4e4f-8cad-69d9a131547a tempest-TestShelveInstance-57035342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:23:27 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [req-c78d6666-ba13-4e12-a819-4001a354239b req-b2d12887-875e-4e4f-8cad-69d9a131547a tempest-TestShelveInstance-57035342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:23:27 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [req-c78d6666-ba13-4e12-a819-4001a354239b req-b2d12887-875e-4e4f-8cad-69d9a131547a tempest-TestShelveInstance-57035342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:23:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-c78d6666-ba13-4e12-a819-4001a354239b req-b2d12887-875e-4e4f-8cad-69d9a131547a tempest-TestShelveInstance-57035342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:23:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-c78d6666-ba13-4e12-a819-4001a354239b req-b2d12887-875e-4e4f-8cad-69d9a131547a tempest-TestShelveInstance-57035342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:23:27 devstack sudo[103698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:23:27 devstack sudo[103698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:23:28 devstack sudo[103698]: pam_unix(sudo:session): session closed for user root
Jul 03 01:23:28 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-c78d6666-ba13-4e12-a819-4001a354239b req-b2d12887-875e-4e4f-8cad-69d9a131547a tempest-TestShelveInstance-57035342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.693s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:23:28 devstack cinder-volume[86891]: DEBUG cinder.manager [req-c78d6666-ba13-4e12-a819-4001a354239b req-b2d12887-875e-4e4f-8cad-69d9a131547a tempest-TestShelveInstance-57035342 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:23:28 devstack cinder-volume[86891]: INFO cinder.volume.manager [req-c78d6666-ba13-4e12-a819-4001a354239b req-b2d12887-875e-4e4f-8cad-69d9a131547a tempest-TestShelveInstance-57035342 None] Deleted volume successfully.
Jul 03 01:23:28 devstack cinder-volume[86891]: DEBUG cinder.coordination [req-c78d6666-ba13-4e12-a819-4001a354239b req-b2d12887-875e-4e4f-8cad-69d9a131547a tempest-TestShelveInstance-57035342 None] Lock "cinder-2c9ba326-e4f6-474a-aea9-3c3d2466fcad-delete_volume" released by "delete_volume" :: held 3.219s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:23:34 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-fee9c687-37f5-445e-b0ee-dda8920c2767 tempest-SnapshotDependencyTests-1725742164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:23:34 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fee9c687-37f5-445e-b0ee-dda8920c2767 tempest-SnapshotDependencyTests-1725742164 None] Flow 'volume_create_manager' (3b21c87f-7d90-4612-86fa-7afc412dab57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:23:34 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fee9c687-37f5-445e-b0ee-dda8920c2767 tempest-SnapshotDependencyTests-1725742164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04c49b81-9d33-41d2-9bf4-84c59de0fab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:23:34 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fee9c687-37f5-445e-b0ee-dda8920c2767 tempest-SnapshotDependencyTests-1725742164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04c49b81-9d33-41d2-9bf4-84c59de0fab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:23:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-71922802',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f578b5f-de77-4e3a-9788-60e995a7828f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48f0278e51e14cf3a1ff0ce55e040de3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:23:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:23:34Z,use_quota=True,user_id='6edb10b1786a4379a359b5b25560be81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:23:34 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fee9c687-37f5-445e-b0ee-dda8920c2767 tempest-SnapshotDependencyTests-1725742164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f8ea13c-5058-427d-92a3-d3e16be7cb4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:23:34 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fee9c687-37f5-445e-b0ee-dda8920c2767 tempest-SnapshotDependencyTests-1725742164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f8ea13c-5058-427d-92a3-d3e16be7cb4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:23:34 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fee9c687-37f5-445e-b0ee-dda8920c2767 tempest-SnapshotDependencyTests-1725742164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01dd3bc1-5393-4b0e-993e-6307d50bcb82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:23:34 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fee9c687-37f5-445e-b0ee-dda8920c2767 tempest-SnapshotDependencyTests-1725742164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01dd3bc1-5393-4b0e-993e-6307d50bcb82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f578b5f-de77-4e3a-9788-60e995a7828f', 'volume_name': 'volume-2f578b5f-de77-4e3a-9788-60e995a7828f', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:23:34 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fee9c687-37f5-445e-b0ee-dda8920c2767 tempest-SnapshotDependencyTests-1725742164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a64c715-bd32-4dce-b7db-229e5849e530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:23:34 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fee9c687-37f5-445e-b0ee-dda8920c2767 tempest-SnapshotDependencyTests-1725742164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a64c715-bd32-4dce-b7db-229e5849e530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:23:34 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fee9c687-37f5-445e-b0ee-dda8920c2767 tempest-SnapshotDependencyTests-1725742164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc952996-3581-4b5f-926a-b4c9a0b1eb31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:23:34 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-fee9c687-37f5-445e-b0ee-dda8920c2767 tempest-SnapshotDependencyTests-1725742164 None] Volume 2f578b5f-de77-4e3a-9788-60e995a7828f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f578b5f-de77-4e3a-9788-60e995a7828f', 'volume_size': 1}
Jul 03 01:23:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-fee9c687-37f5-445e-b0ee-dda8920c2767 tempest-SnapshotDependencyTests-1725742164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:23:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-fee9c687-37f5-445e-b0ee-dda8920c2767 tempest-SnapshotDependencyTests-1725742164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:23:34 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-fee9c687-37f5-445e-b0ee-dda8920c2767 tempest-SnapshotDependencyTests-1725742164 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:23:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-71922802',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f578b5f-de77-4e3a-9788-60e995a7828f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48f0278e51e14cf3a1ff0ce55e040de3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:23:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:23:34Z,use_quota=True,user_id='6edb10b1786a4379a359b5b25560be81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:23:34 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-fee9c687-37f5-445e-b0ee-dda8920c2767 tempest-SnapshotDependencyTests-1725742164 None] Creating volume 2f578b5f-de77-4e3a-9788-60e995a7828f {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:23:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-fee9c687-37f5-445e-b0ee-dda8920c2767 tempest-SnapshotDependencyTests-1725742164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:23:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-fee9c687-37f5-445e-b0ee-dda8920c2767 tempest-SnapshotDependencyTests-1725742164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:23:34 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-fee9c687-37f5-445e-b0ee-dda8920c2767 tempest-SnapshotDependencyTests-1725742164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:23:34 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-fee9c687-37f5-445e-b0ee-dda8920c2767 tempest-SnapshotDependencyTests-1725742164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:23:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-fee9c687-37f5-445e-b0ee-dda8920c2767 tempest-SnapshotDependencyTests-1725742164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:23:34 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-fee9c687-37f5-445e-b0ee-dda8920c2767 tempest-SnapshotDependencyTests-1725742164 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:23:34 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-fee9c687-37f5-445e-b0ee-dda8920c2767 tempest-SnapshotDependencyTests-1725742164 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:23:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-fee9c687-37f5-445e-b0ee-dda8920c2767 tempest-SnapshotDependencyTests-1725742164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2f578b5f-de77-4e3a-9788-60e995a7828f 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:23:34 devstack sudo[103740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2f578b5f-de77-4e3a-9788-60e995a7828f 1073741824
Jul 03 01:23:34 devstack sudo[103740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:23:35 devstack sudo[103740]: pam_unix(sudo:session): session closed for user root
Jul 03 01:23:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-fee9c687-37f5-445e-b0ee-dda8920c2767 tempest-SnapshotDependencyTests-1725742164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2f578b5f-de77-4e3a-9788-60e995a7828f 1073741824" returned: 0 in 0.851s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:23:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-fee9c687-37f5-445e-b0ee-dda8920c2767 tempest-SnapshotDependencyTests-1725742164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2f578b5f-de77-4e3a-9788-60e995a7828f {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:23:35 devstack sudo[103745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2f578b5f-de77-4e3a-9788-60e995a7828f
Jul 03 01:23:35 devstack sudo[103745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:23:36 devstack sudo[103745]: pam_unix(sudo:session): session closed for user root
Jul 03 01:23:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-fee9c687-37f5-445e-b0ee-dda8920c2767 tempest-SnapshotDependencyTests-1725742164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2f578b5f-de77-4e3a-9788-60e995a7828f" returned: 0 in 0.688s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:23:36 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-fee9c687-37f5-445e-b0ee-dda8920c2767 tempest-SnapshotDependencyTests-1725742164 None] <== create_volume: return (1581ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:23:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-fee9c687-37f5-445e-b0ee-dda8920c2767 tempest-SnapshotDependencyTests-1725742164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.584s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:23:36 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fee9c687-37f5-445e-b0ee-dda8920c2767 tempest-SnapshotDependencyTests-1725742164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc952996-3581-4b5f-926a-b4c9a0b1eb31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f578b5f-de77-4e3a-9788-60e995a7828f', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:23:36 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fee9c687-37f5-445e-b0ee-dda8920c2767 tempest-SnapshotDependencyTests-1725742164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a05280d-4ca3-4aec-a54f-98a85412e694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:23:36 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-fee9c687-37f5-445e-b0ee-dda8920c2767 tempest-SnapshotDependencyTests-1725742164 None] Volume volume-2f578b5f-de77-4e3a-9788-60e995a7828f (2f578b5f-de77-4e3a-9788-60e995a7828f): created successfully
Jul 03 01:23:36 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fee9c687-37f5-445e-b0ee-dda8920c2767 tempest-SnapshotDependencyTests-1725742164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a05280d-4ca3-4aec-a54f-98a85412e694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:23:36 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fee9c687-37f5-445e-b0ee-dda8920c2767 tempest-SnapshotDependencyTests-1725742164 None] Flow 'volume_create_manager' (3b21c87f-7d90-4612-86fa-7afc412dab57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:23:36 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-fee9c687-37f5-445e-b0ee-dda8920c2767 tempest-SnapshotDependencyTests-1725742164 None] Created volume successfully.
Jul 03 01:23:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-5971060a-58de-490a-ab0b-81750d2c0550 tempest-SnapshotDependencyTests-1725742164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:23:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-5971060a-58de-490a-ab0b-81750d2c0550 tempest-SnapshotDependencyTests-1725742164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:23:36 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-5971060a-58de-490a-ab0b-81750d2c0550 tempest-SnapshotDependencyTests-1725742164 None] Creating offline snapshot c991a0a9-37c9-4c6b-89eb-4f1afb2a2bc5 of volume 2f578b5f-de77-4e3a-9788-60e995a7828f {{(pid=86891) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 01:23:36 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee5875e-8563-42d3-89de-51ca4fe2019b]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:23:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5971060a-58de-490a-ab0b-81750d2c0550 tempest-SnapshotDependencyTests-1725742164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2f578b5f-de77-4e3a-9788-60e995a7828f {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:23:37 devstack sudo[103749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2f578b5f-de77-4e3a-9788-60e995a7828f
Jul 03 01:23:37 devstack sudo[103749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:23:37 devstack sudo[103749]: pam_unix(sudo:session): session closed for user root
Jul 03 01:23:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5971060a-58de-490a-ab0b-81750d2c0550 tempest-SnapshotDependencyTests-1725742164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2f578b5f-de77-4e3a-9788-60e995a7828f" returned: 0 in 0.873s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:23:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5971060a-58de-490a-ab0b-81750d2c0550 tempest-SnapshotDependencyTests-1725742164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2f578b5f-de77-4e3a-9788-60e995a7828f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2f578b5f-de77-4e3a-9788-60e995a7828f.c991a0a9-37c9-4c6b-89eb-4f1afb2a2bc5 1G {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:23:37 devstack sudo[103754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2f578b5f-de77-4e3a-9788-60e995a7828f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2f578b5f-de77-4e3a-9788-60e995a7828f.c991a0a9-37c9-4c6b-89eb-4f1afb2a2bc5 1G
Jul 03 01:23:37 devstack sudo[103754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:23:38 devstack sudo[103754]: pam_unix(sudo:session): session closed for user root
Jul 03 01:23:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5971060a-58de-490a-ab0b-81750d2c0550 tempest-SnapshotDependencyTests-1725742164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2f578b5f-de77-4e3a-9788-60e995a7828f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2f578b5f-de77-4e3a-9788-60e995a7828f.c991a0a9-37c9-4c6b-89eb-4f1afb2a2bc5 1G" returned: 0 in 0.855s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:23:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5971060a-58de-490a-ab0b-81750d2c0550 tempest-SnapshotDependencyTests-1725742164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f578b5f-de77-4e3a-9788-60e995a7828f -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2f578b5f-de77-4e3a-9788-60e995a7828f.c991a0a9-37c9-4c6b-89eb-4f1afb2a2bc5 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:23:38 devstack sudo[103762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f578b5f-de77-4e3a-9788-60e995a7828f -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2f578b5f-de77-4e3a-9788-60e995a7828f.c991a0a9-37c9-4c6b-89eb-4f1afb2a2bc5
Jul 03 01:23:38 devstack sudo[103762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:23:39 devstack sudo[103762]: pam_unix(sudo:session): session closed for user root
Jul 03 01:23:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5971060a-58de-490a-ab0b-81750d2c0550 tempest-SnapshotDependencyTests-1725742164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f578b5f-de77-4e3a-9788-60e995a7828f -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2f578b5f-de77-4e3a-9788-60e995a7828f.c991a0a9-37c9-4c6b-89eb-4f1afb2a2bc5" returned: 0 in 0.708s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:23:39 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-5971060a-58de-490a-ab0b-81750d2c0550 tempest-SnapshotDependencyTests-1725742164 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2f578b5f-de77-4e3a-9788-60e995a7828f.c991a0a9-37c9-4c6b-89eb-4f1afb2a2bc5 is being set with open permissions: ugo+rw
Jul 03 01:23:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5971060a-58de-490a-ab0b-81750d2c0550 tempest-SnapshotDependencyTests-1725742164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2f578b5f-de77-4e3a-9788-60e995a7828f.c991a0a9-37c9-4c6b-89eb-4f1afb2a2bc5 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:23:39 devstack sudo[103767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2f578b5f-de77-4e3a-9788-60e995a7828f.c991a0a9-37c9-4c6b-89eb-4f1afb2a2bc5
Jul 03 01:23:39 devstack sudo[103767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:23:40 devstack sudo[103767]: pam_unix(sudo:session): session closed for user root
Jul 03 01:23:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5971060a-58de-490a-ab0b-81750d2c0550 tempest-SnapshotDependencyTests-1725742164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2f578b5f-de77-4e3a-9788-60e995a7828f.c991a0a9-37c9-4c6b-89eb-4f1afb2a2bc5" returned: 0 in 0.737s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:23:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5971060a-58de-490a-ab0b-81750d2c0550 tempest-SnapshotDependencyTests-1725742164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2f578b5f-de77-4e3a-9788-60e995a7828f.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:23:40 devstack sudo[103770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2f578b5f-de77-4e3a-9788-60e995a7828f.info
Jul 03 01:23:40 devstack sudo[103770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:23:40 devstack sudo[103770]: pam_unix(sudo:session): session closed for user root
Jul 03 01:23:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5971060a-58de-490a-ab0b-81750d2c0550 tempest-SnapshotDependencyTests-1725742164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2f578b5f-de77-4e3a-9788-60e995a7828f.info" returned: 0 in 0.662s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:23:40 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-5971060a-58de-490a-ab0b-81750d2c0550 tempest-SnapshotDependencyTests-1725742164 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2f578b5f-de77-4e3a-9788-60e995a7828f.info is being set with open permissions: ugo+rw
Jul 03 01:23:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5971060a-58de-490a-ab0b-81750d2c0550 tempest-SnapshotDependencyTests-1725742164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2f578b5f-de77-4e3a-9788-60e995a7828f.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:23:40 devstack sudo[103779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2f578b5f-de77-4e3a-9788-60e995a7828f.info
Jul 03 01:23:40 devstack sudo[103779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:23:41 devstack sudo[103779]: pam_unix(sudo:session): session closed for user root
Jul 03 01:23:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5971060a-58de-490a-ab0b-81750d2c0550 tempest-SnapshotDependencyTests-1725742164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2f578b5f-de77-4e3a-9788-60e995a7828f.info" returned: 0 in 0.636s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:23:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-5971060a-58de-490a-ab0b-81750d2c0550 tempest-SnapshotDependencyTests-1725742164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.604s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:23:41 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-5971060a-58de-490a-ab0b-81750d2c0550 tempest-SnapshotDependencyTests-1725742164 None] Create snapshot completed successfully
Jul 03 01:23:42 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-52225d9a-4571-4642-92bd-8e5c4eaea499 tempest-SnapshotDependencyTests-1725742164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:23:42 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-52225d9a-4571-4642-92bd-8e5c4eaea499 tempest-SnapshotDependencyTests-1725742164 None] Flow 'volume_create_manager' (20baa2a3-15cc-4240-b9a5-09f32f588f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:23:42 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-52225d9a-4571-4642-92bd-8e5c4eaea499 tempest-SnapshotDependencyTests-1725742164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f94297a8-88c8-41b7-bd2c-f129a8694994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:23:42 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-52225d9a-4571-4642-92bd-8e5c4eaea499 tempest-SnapshotDependencyTests-1725742164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f94297a8-88c8-41b7-bd2c-f129a8694994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:23:42Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=352730a4-9b0b-4320-aa1e-3c68979108b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48f0278e51e14cf3a1ff0ce55e040de3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:23:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c991a0a9-37c9-4c6b-89eb-4f1afb2a2bc5,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:23:43Z,use_quota=True,user_id='6edb10b1786a4379a359b5b25560be81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:23:42 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-52225d9a-4571-4642-92bd-8e5c4eaea499 tempest-SnapshotDependencyTests-1725742164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ca55e6f-d086-4e15-b76c-cedb5487debd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:23:42 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-52225d9a-4571-4642-92bd-8e5c4eaea499 tempest-SnapshotDependencyTests-1725742164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ca55e6f-d086-4e15-b76c-cedb5487debd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:23:42 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-52225d9a-4571-4642-92bd-8e5c4eaea499 tempest-SnapshotDependencyTests-1725742164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdad8db9-9ef3-4b5d-a903-9da2a2c56291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:23:42 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-52225d9a-4571-4642-92bd-8e5c4eaea499 tempest-SnapshotDependencyTests-1725742164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdad8db9-9ef3-4b5d-a903-9da2a2c56291) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '352730a4-9b0b-4320-aa1e-3c68979108b2', 'volume_name': 'volume-352730a4-9b0b-4320-aa1e-3c68979108b2', 'volume_size': 1, 'snapshot_id': 'c991a0a9-37c9-4c6b-89eb-4f1afb2a2bc5'}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:23:42 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-52225d9a-4571-4642-92bd-8e5c4eaea499 tempest-SnapshotDependencyTests-1725742164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15ca61f4-c891-4ed4-94af-fdc310fe8ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:23:42 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-52225d9a-4571-4642-92bd-8e5c4eaea499 tempest-SnapshotDependencyTests-1725742164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15ca61f4-c891-4ed4-94af-fdc310fe8ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:23:42 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-52225d9a-4571-4642-92bd-8e5c4eaea499 tempest-SnapshotDependencyTests-1725742164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7996bae0-a317-4fd5-8c10-6b81ddc2f808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:23:42 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-52225d9a-4571-4642-92bd-8e5c4eaea499 tempest-SnapshotDependencyTests-1725742164 None] Volume 352730a4-9b0b-4320-aa1e-3c68979108b2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-352730a4-9b0b-4320-aa1e-3c68979108b2', 'volume_size': 1, 'snapshot_id': 'c991a0a9-37c9-4c6b-89eb-4f1afb2a2bc5'}
Jul 03 01:23:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-52225d9a-4571-4642-92bd-8e5c4eaea499 tempest-SnapshotDependencyTests-1725742164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:23:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-52225d9a-4571-4642-92bd-8e5c4eaea499 tempest-SnapshotDependencyTests-1725742164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:23:42 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-52225d9a-4571-4642-92bd-8e5c4eaea499 tempest-SnapshotDependencyTests-1725742164 None] Acquiring lock "cinder-quobyte-c991a0a9-37c9-4c6b-89eb-4f1afb2a2bc5-352730a4-9b0b-4320-aa1e-3c68979108b2" by "_create_volume_from_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:23:42 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-52225d9a-4571-4642-92bd-8e5c4eaea499 tempest-SnapshotDependencyTests-1725742164 None] Lock "cinder-quobyte-c991a0a9-37c9-4c6b-89eb-4f1afb2a2bc5-352730a4-9b0b-4320-aa1e-3c68979108b2" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:23:42 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-52225d9a-4571-4642-92bd-8e5c4eaea499 tempest-SnapshotDependencyTests-1725742164 None] Creating volume 352730a4-9b0b-4320-aa1e-3c68979108b2 from snapshot c991a0a9-37c9-4c6b-89eb-4f1afb2a2bc5 {{(pid=86891) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 03 01:23:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-52225d9a-4571-4642-92bd-8e5c4eaea499 tempest-SnapshotDependencyTests-1725742164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:23:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-52225d9a-4571-4642-92bd-8e5c4eaea499 tempest-SnapshotDependencyTests-1725742164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:23:42 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-52225d9a-4571-4642-92bd-8e5c4eaea499 tempest-SnapshotDependencyTests-1725742164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:23:42 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-52225d9a-4571-4642-92bd-8e5c4eaea499 tempest-SnapshotDependencyTests-1725742164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:23:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-52225d9a-4571-4642-92bd-8e5c4eaea499 tempest-SnapshotDependencyTests-1725742164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:23:42 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-52225d9a-4571-4642-92bd-8e5c4eaea499 tempest-SnapshotDependencyTests-1725742164 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:23:42 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-52225d9a-4571-4642-92bd-8e5c4eaea499 tempest-SnapshotDependencyTests-1725742164 None] Acquiring lock "cinder-quobyte-352730a4-9b0b-4320-aa1e-3c68979108b2" by "_copy_volume_from_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:23:42 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-52225d9a-4571-4642-92bd-8e5c4eaea499 tempest-SnapshotDependencyTests-1725742164 None] Lock "cinder-quobyte-352730a4-9b0b-4320-aa1e-3c68979108b2" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:23:42 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-52225d9a-4571-4642-92bd-8e5c4eaea499 tempest-SnapshotDependencyTests-1725742164 None] snapshot: c991a0a9-37c9-4c6b-89eb-4f1afb2a2bc5, volume: 352730a4-9b0b-4320-aa1e-3c68979108b2,  {{(pid=86891) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 03 01:23:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-52225d9a-4571-4642-92bd-8e5c4eaea499 tempest-SnapshotDependencyTests-1725742164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:23:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-52225d9a-4571-4642-92bd-8e5c4eaea499 tempest-SnapshotDependencyTests-1725742164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:23:42 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-52225d9a-4571-4642-92bd-8e5c4eaea499 tempest-SnapshotDependencyTests-1725742164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:23:42 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-52225d9a-4571-4642-92bd-8e5c4eaea499 tempest-SnapshotDependencyTests-1725742164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:23:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-52225d9a-4571-4642-92bd-8e5c4eaea499 tempest-SnapshotDependencyTests-1725742164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:23:42 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70b6917-ad07-40d8-b598-63de303289ed]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:23:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-52225d9a-4571-4642-92bd-8e5c4eaea499 tempest-SnapshotDependencyTests-1725742164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2f578b5f-de77-4e3a-9788-60e995a7828f.c991a0a9-37c9-4c6b-89eb-4f1afb2a2bc5 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:23:42 devstack sudo[103782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2f578b5f-de77-4e3a-9788-60e995a7828f.c991a0a9-37c9-4c6b-89eb-4f1afb2a2bc5
Jul 03 01:23:42 devstack sudo[103782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:23:43 devstack sudo[103782]: pam_unix(sudo:session): session closed for user root
Jul 03 01:23:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-52225d9a-4571-4642-92bd-8e5c4eaea499 tempest-SnapshotDependencyTests-1725742164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2f578b5f-de77-4e3a-9788-60e995a7828f.c991a0a9-37c9-4c6b-89eb-4f1afb2a2bc5" returned: 0 in 0.797s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:23:43 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-52225d9a-4571-4642-92bd-8e5c4eaea499 tempest-SnapshotDependencyTests-1725742164 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f578b5f-de77-4e3a-9788-60e995a7828f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:23:43 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-52225d9a-4571-4642-92bd-8e5c4eaea499 tempest-SnapshotDependencyTests-1725742164 None] will copy from snapshot at /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2f578b5f-de77-4e3a-9788-60e995a7828f {{(pid=86891) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 03 01:23:43 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-52225d9a-4571-4642-92bd-8e5c4eaea499 tempest-SnapshotDependencyTests-1725742164 None] Creating direct copy from snapshot {{(pid=86891) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 03 01:23:43 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0469e5c-e297-4f18-83b5-5a6d15d33741]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:23:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-52225d9a-4571-4642-92bd-8e5c4eaea499 tempest-SnapshotDependencyTests-1725742164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2f578b5f-de77-4e3a-9788-60e995a7828f {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:23:43 devstack sudo[103787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2f578b5f-de77-4e3a-9788-60e995a7828f
Jul 03 01:23:43 devstack sudo[103787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:23:44 devstack sudo[103787]: pam_unix(sudo:session): session closed for user root
Jul 03 01:23:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-52225d9a-4571-4642-92bd-8e5c4eaea499 tempest-SnapshotDependencyTests-1725742164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2f578b5f-de77-4e3a-9788-60e995a7828f" returned: 0 in 0.823s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:23:44 devstack cinder-volume[86891]: DEBUG cinder.utils [None req-52225d9a-4571-4642-92bd-8e5c4eaea499 tempest-SnapshotDependencyTests-1725742164 None] Path /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-352730a4-9b0b-4320-aa1e-3c68979108b2 not found in is_blk_device check {{(pid=86891) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 03 01:23:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-52225d9a-4571-4642-92bd-8e5c4eaea499 tempest-SnapshotDependencyTests-1725742164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2f578b5f-de77-4e3a-9788-60e995a7828f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-352730a4-9b0b-4320-aa1e-3c68979108b2 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:23:44 devstack sudo[103792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2f578b5f-de77-4e3a-9788-60e995a7828f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-352730a4-9b0b-4320-aa1e-3c68979108b2
Jul 03 01:23:44 devstack sudo[103792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:23:50 devstack sudo[103792]: pam_unix(sudo:session): session closed for user root
Jul 03 01:23:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-52225d9a-4571-4642-92bd-8e5c4eaea499 tempest-SnapshotDependencyTests-1725742164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2f578b5f-de77-4e3a-9788-60e995a7828f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-352730a4-9b0b-4320-aa1e-3c68979108b2" returned: 0 in 5.553s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:23:50 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4af20d-659a-4f4b-bdb8-96e3dab38b3d]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:23:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-52225d9a-4571-4642-92bd-8e5c4eaea499 tempest-SnapshotDependencyTests-1725742164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2f578b5f-de77-4e3a-9788-60e995a7828f {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:23:50 devstack sudo[103806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2f578b5f-de77-4e3a-9788-60e995a7828f
Jul 03 01:23:50 devstack sudo[103806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:23:51 devstack sudo[103806]: pam_unix(sudo:session): session closed for user root
Jul 03 01:23:51 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-52225d9a-4571-4642-92bd-8e5c4eaea499 tempest-SnapshotDependencyTests-1725742164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2f578b5f-de77-4e3a-9788-60e995a7828f" returned: 0 in 1.036s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:23:51 devstack cinder-volume[86891]: DEBUG cinder.image.image_utils [None req-52225d9a-4571-4642-92bd-8e5c4eaea499 tempest-SnapshotDependencyTests-1725742164 None] Image conversion details: src /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2f578b5f-de77-4e3a-9788-60e995a7828f, size 1024.00 MB, duration 5.55 sec, destination /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-352730a4-9b0b-4320-aa1e-3c68979108b2 {{(pid=86891) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 03 01:23:51 devstack cinder-volume[86891]: INFO cinder.image.image_utils [None req-52225d9a-4571-4642-92bd-8e5c4eaea499 tempest-SnapshotDependencyTests-1725742164 None] Converted 1024.00 MB image at 184.37 MB/s
Jul 03 01:23:51 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-52225d9a-4571-4642-92bd-8e5c4eaea499 tempest-SnapshotDependencyTests-1725742164 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-352730a4-9b0b-4320-aa1e-3c68979108b2 is being set with open permissions: ugo+rw
Jul 03 01:23:51 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-52225d9a-4571-4642-92bd-8e5c4eaea499 tempest-SnapshotDependencyTests-1725742164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-352730a4-9b0b-4320-aa1e-3c68979108b2 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:23:51 devstack sudo[103811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-352730a4-9b0b-4320-aa1e-3c68979108b2
Jul 03 01:23:51 devstack sudo[103811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:23:51 devstack sudo[103811]: pam_unix(sudo:session): session closed for user root
Jul 03 01:23:51 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-52225d9a-4571-4642-92bd-8e5c4eaea499 tempest-SnapshotDependencyTests-1725742164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-352730a4-9b0b-4320-aa1e-3c68979108b2" returned: 0 in 0.676s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:23:51 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-52225d9a-4571-4642-92bd-8e5c4eaea499 tempest-SnapshotDependencyTests-1725742164 None] Lock "cinder-quobyte-352730a4-9b0b-4320-aa1e-3c68979108b2" released by "_copy_volume_from_snapshot" :: held 8.991s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:23:51 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-52225d9a-4571-4642-92bd-8e5c4eaea499 tempest-SnapshotDependencyTests-1725742164 None] Lock "cinder-quobyte-c991a0a9-37c9-4c6b-89eb-4f1afb2a2bc5-352730a4-9b0b-4320-aa1e-3c68979108b2" released by "_create_volume_from_snapshot" :: held 9.022s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:23:51 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-52225d9a-4571-4642-92bd-8e5c4eaea499 tempest-SnapshotDependencyTests-1725742164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.039s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:23:51 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-52225d9a-4571-4642-92bd-8e5c4eaea499 tempest-SnapshotDependencyTests-1725742164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7996bae0-a317-4fd5-8c10-6b81ddc2f808) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-352730a4-9b0b-4320-aa1e-3c68979108b2', 'volume_size': 1, 'snapshot_id': 'c991a0a9-37c9-4c6b-89eb-4f1afb2a2bc5'}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:23:51 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-52225d9a-4571-4642-92bd-8e5c4eaea499 tempest-SnapshotDependencyTests-1725742164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db82f303-50bc-4077-8320-3d31eb7e6537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:23:51 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-52225d9a-4571-4642-92bd-8e5c4eaea499 tempest-SnapshotDependencyTests-1725742164 None] Volume volume-352730a4-9b0b-4320-aa1e-3c68979108b2 (352730a4-9b0b-4320-aa1e-3c68979108b2): created successfully
Jul 03 01:23:51 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-52225d9a-4571-4642-92bd-8e5c4eaea499 tempest-SnapshotDependencyTests-1725742164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db82f303-50bc-4077-8320-3d31eb7e6537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:23:51 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-52225d9a-4571-4642-92bd-8e5c4eaea499 tempest-SnapshotDependencyTests-1725742164 None] Flow 'volume_create_manager' (20baa2a3-15cc-4240-b9a5-09f32f588f09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:23:51 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-52225d9a-4571-4642-92bd-8e5c4eaea499 tempest-SnapshotDependencyTests-1725742164 None] Created volume successfully.
Jul 03 01:23:52 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-efd53ee1-fd63-4413-a4cc-2cd8f1efeecb tempest-SnapshotDependencyTests-1725742164 None] Acquiring lock "cinder-c991a0a9-37c9-4c6b-89eb-4f1afb2a2bc5-delete_snapshot" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:23:52 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-efd53ee1-fd63-4413-a4cc-2cd8f1efeecb tempest-SnapshotDependencyTests-1725742164 None] Lock "cinder-c991a0a9-37c9-4c6b-89eb-4f1afb2a2bc5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:23:52 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-efd53ee1-fd63-4413-a4cc-2cd8f1efeecb tempest-SnapshotDependencyTests-1725742164 None] Acquiring lock "cinder-quobyte-2f578b5f-de77-4e3a-9788-60e995a7828f" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:23:52 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-efd53ee1-fd63-4413-a4cc-2cd8f1efeecb tempest-SnapshotDependencyTests-1725742164 None] Lock "cinder-quobyte-2f578b5f-de77-4e3a-9788-60e995a7828f" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:23:52 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-efd53ee1-fd63-4413-a4cc-2cd8f1efeecb tempest-SnapshotDependencyTests-1725742164 None] Acquiring lock "cinder-quobyte-c991a0a9-37c9-4c6b-89eb-4f1afb2a2bc5" by "_delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:23:52 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-efd53ee1-fd63-4413-a4cc-2cd8f1efeecb tempest-SnapshotDependencyTests-1725742164 None] Lock "cinder-quobyte-c991a0a9-37c9-4c6b-89eb-4f1afb2a2bc5" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:23:52 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-efd53ee1-fd63-4413-a4cc-2cd8f1efeecb tempest-SnapshotDependencyTests-1725742164 None] Deleting offline snapshot c991a0a9-37c9-4c6b-89eb-4f1afb2a2bc5 of volume 2f578b5f-de77-4e3a-9788-60e995a7828f {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 01:23:52 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-efd53ee1-fd63-4413-a4cc-2cd8f1efeecb tempest-SnapshotDependencyTests-1725742164 None] snapshot_file for this snap is: volume-2f578b5f-de77-4e3a-9788-60e995a7828f.c991a0a9-37c9-4c6b-89eb-4f1afb2a2bc5 {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 01:23:52 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[21bfac08-c27f-4caa-9d95-770d42017f72]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:23:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-efd53ee1-fd63-4413-a4cc-2cd8f1efeecb tempest-SnapshotDependencyTests-1725742164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2f578b5f-de77-4e3a-9788-60e995a7828f.c991a0a9-37c9-4c6b-89eb-4f1afb2a2bc5 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:23:52 devstack sudo[103814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2f578b5f-de77-4e3a-9788-60e995a7828f.c991a0a9-37c9-4c6b-89eb-4f1afb2a2bc5
Jul 03 01:23:52 devstack sudo[103814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:23:53 devstack sudo[103814]: pam_unix(sudo:session): session closed for user root
Jul 03 01:23:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-efd53ee1-fd63-4413-a4cc-2cd8f1efeecb tempest-SnapshotDependencyTests-1725742164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2f578b5f-de77-4e3a-9788-60e995a7828f.c991a0a9-37c9-4c6b-89eb-4f1afb2a2bc5" returned: 0 in 0.791s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:23:53 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-efd53ee1-fd63-4413-a4cc-2cd8f1efeecb tempest-SnapshotDependencyTests-1725742164 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f578b5f-de77-4e3a-9788-60e995a7828f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:23:53 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[3328613c-0b92-4d1a-b9cc-a291832b6a67]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:23:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-efd53ee1-fd63-4413-a4cc-2cd8f1efeecb tempest-SnapshotDependencyTests-1725742164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2f578b5f-de77-4e3a-9788-60e995a7828f {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:23:53 devstack sudo[103819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2f578b5f-de77-4e3a-9788-60e995a7828f
Jul 03 01:23:53 devstack sudo[103819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:23:54 devstack sudo[103819]: pam_unix(sudo:session): session closed for user root
Jul 03 01:23:54 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-efd53ee1-fd63-4413-a4cc-2cd8f1efeecb tempest-SnapshotDependencyTests-1725742164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2f578b5f-de77-4e3a-9788-60e995a7828f" returned: 0 in 0.822s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:23:54 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-efd53ee1-fd63-4413-a4cc-2cd8f1efeecb tempest-SnapshotDependencyTests-1725742164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2f578b5f-de77-4e3a-9788-60e995a7828f.c991a0a9-37c9-4c6b-89eb-4f1afb2a2bc5 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:23:54 devstack sudo[103824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2f578b5f-de77-4e3a-9788-60e995a7828f.c991a0a9-37c9-4c6b-89eb-4f1afb2a2bc5
Jul 03 01:23:54 devstack sudo[103824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:23:55 devstack sudo[103824]: pam_unix(sudo:session): session closed for user root
Jul 03 01:23:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-efd53ee1-fd63-4413-a4cc-2cd8f1efeecb tempest-SnapshotDependencyTests-1725742164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2f578b5f-de77-4e3a-9788-60e995a7828f.c991a0a9-37c9-4c6b-89eb-4f1afb2a2bc5" returned: 0 in 0.774s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:23:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-efd53ee1-fd63-4413-a4cc-2cd8f1efeecb tempest-SnapshotDependencyTests-1725742164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2f578b5f-de77-4e3a-9788-60e995a7828f.c991a0a9-37c9-4c6b-89eb-4f1afb2a2bc5 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:23:55 devstack sudo[103829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2f578b5f-de77-4e3a-9788-60e995a7828f.c991a0a9-37c9-4c6b-89eb-4f1afb2a2bc5
Jul 03 01:23:55 devstack sudo[103829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:23:55 devstack sudo[103829]: pam_unix(sudo:session): session closed for user root
Jul 03 01:23:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-efd53ee1-fd63-4413-a4cc-2cd8f1efeecb tempest-SnapshotDependencyTests-1725742164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2f578b5f-de77-4e3a-9788-60e995a7828f.c991a0a9-37c9-4c6b-89eb-4f1afb2a2bc5" returned: 0 in 0.629s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:23:55 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-efd53ee1-fd63-4413-a4cc-2cd8f1efeecb tempest-SnapshotDependencyTests-1725742164 None] Lock "cinder-quobyte-c991a0a9-37c9-4c6b-89eb-4f1afb2a2bc5" released by "_delete_snapshot" :: held 3.115s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:23:55 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-efd53ee1-fd63-4413-a4cc-2cd8f1efeecb tempest-SnapshotDependencyTests-1725742164 None] Lock "cinder-quobyte-2f578b5f-de77-4e3a-9788-60e995a7828f" released by "delete_snapshot" :: held 3.145s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:23:55 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-efd53ee1-fd63-4413-a4cc-2cd8f1efeecb tempest-SnapshotDependencyTests-1725742164 None] Created reservations ['26adb41d-bf2a-40c9-aaf0-3eee967a8d45', 'cdbedeca-6e84-4663-9714-28bb7e0539cc', '07ba5086-5068-493e-ac6e-ada3621e5c50', '0922dc41-c673-4b62-8afb-e0d0a4bf052d'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:23:55 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-efd53ee1-fd63-4413-a4cc-2cd8f1efeecb tempest-SnapshotDependencyTests-1725742164 None] Delete snapshot completed successfully.
Jul 03 01:23:55 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-efd53ee1-fd63-4413-a4cc-2cd8f1efeecb tempest-SnapshotDependencyTests-1725742164 None] Lock "cinder-c991a0a9-37c9-4c6b-89eb-4f1afb2a2bc5-delete_snapshot" released by "delete_snapshot" :: held 3.322s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:23:56 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-baa9cb03-110b-47f9-8e47-756f6d9a33a8 tempest-SnapshotDependencyTests-1725742164 None] Acquiring lock "cinder-2f578b5f-de77-4e3a-9788-60e995a7828f-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:23:56 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-baa9cb03-110b-47f9-8e47-756f6d9a33a8 tempest-SnapshotDependencyTests-1725742164 None] Lock "cinder-2f578b5f-de77-4e3a-9788-60e995a7828f-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:23:57 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-baa9cb03-110b-47f9-8e47-756f6d9a33a8 tempest-SnapshotDependencyTests-1725742164 None] Acquiring lock "cinder-quobyte-2f578b5f-de77-4e3a-9788-60e995a7828f" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:23:57 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-baa9cb03-110b-47f9-8e47-756f6d9a33a8 tempest-SnapshotDependencyTests-1725742164 None] Lock "cinder-quobyte-2f578b5f-de77-4e3a-9788-60e995a7828f" acquired by "delete_volume" :: waited 0.019s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:23:57 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6d3fcd-b62a-40b4-b8a0-9a2f9126327e]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:23:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-baa9cb03-110b-47f9-8e47-756f6d9a33a8 tempest-SnapshotDependencyTests-1725742164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2f578b5f-de77-4e3a-9788-60e995a7828f {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:23:57 devstack sudo[103832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2f578b5f-de77-4e3a-9788-60e995a7828f
Jul 03 01:23:57 devstack sudo[103832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:23:57 devstack sudo[103832]: pam_unix(sudo:session): session closed for user root
Jul 03 01:23:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-baa9cb03-110b-47f9-8e47-756f6d9a33a8 tempest-SnapshotDependencyTests-1725742164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2f578b5f-de77-4e3a-9788-60e995a7828f" returned: 0 in 0.816s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:23:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-baa9cb03-110b-47f9-8e47-756f6d9a33a8 tempest-SnapshotDependencyTests-1725742164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2f578b5f-de77-4e3a-9788-60e995a7828f {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:23:57 devstack sudo[103838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2f578b5f-de77-4e3a-9788-60e995a7828f
Jul 03 01:23:57 devstack sudo[103838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:23:58 devstack sudo[103838]: pam_unix(sudo:session): session closed for user root
Jul 03 01:23:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-baa9cb03-110b-47f9-8e47-756f6d9a33a8 tempest-SnapshotDependencyTests-1725742164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2f578b5f-de77-4e3a-9788-60e995a7828f" returned: 0 in 0.691s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:23:58 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-baa9cb03-110b-47f9-8e47-756f6d9a33a8 tempest-SnapshotDependencyTests-1725742164 None] Lock "cinder-quobyte-2f578b5f-de77-4e3a-9788-60e995a7828f" released by "delete_volume" :: held 1.570s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:23:58 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-baa9cb03-110b-47f9-8e47-756f6d9a33a8 tempest-SnapshotDependencyTests-1725742164 None] Created reservations ['1ed2a2f2-4481-4e21-bf92-0f30841c81c5', '24e5a528-cd91-4f2e-819b-f6321bc25a5d', '1d707ff8-a661-4e69-8ec9-4a2fe9848b37', '23c94ab9-ca92-46d3-aebd-daafc9cf8404'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:23:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-baa9cb03-110b-47f9-8e47-756f6d9a33a8 tempest-SnapshotDependencyTests-1725742164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:23:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-baa9cb03-110b-47f9-8e47-756f6d9a33a8 tempest-SnapshotDependencyTests-1725742164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:23:58 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-baa9cb03-110b-47f9-8e47-756f6d9a33a8 tempest-SnapshotDependencyTests-1725742164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:23:58 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-baa9cb03-110b-47f9-8e47-756f6d9a33a8 tempest-SnapshotDependencyTests-1725742164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:23:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-baa9cb03-110b-47f9-8e47-756f6d9a33a8 tempest-SnapshotDependencyTests-1725742164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:23:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-baa9cb03-110b-47f9-8e47-756f6d9a33a8 tempest-SnapshotDependencyTests-1725742164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:23:58 devstack sudo[103842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:23:58 devstack sudo[103842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:23:59 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-681ccc00-2e22-467a-afcc-3f97aed24c56 tempest-SnapshotDependencyTests-1725742164 None] Acquiring lock "cinder-352730a4-9b0b-4320-aa1e-3c68979108b2-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:23:59 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-681ccc00-2e22-467a-afcc-3f97aed24c56 tempest-SnapshotDependencyTests-1725742164 None] Lock "cinder-352730a4-9b0b-4320-aa1e-3c68979108b2-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:23:59 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-681ccc00-2e22-467a-afcc-3f97aed24c56 tempest-SnapshotDependencyTests-1725742164 None] Acquiring lock "cinder-quobyte-352730a4-9b0b-4320-aa1e-3c68979108b2" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:23:59 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-681ccc00-2e22-467a-afcc-3f97aed24c56 tempest-SnapshotDependencyTests-1725742164 None] Lock "cinder-quobyte-352730a4-9b0b-4320-aa1e-3c68979108b2" acquired by "delete_volume" :: waited 0.019s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:23:59 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[123f1cb2-3335-4243-b98f-6bc7fb45537f]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:23:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-681ccc00-2e22-467a-afcc-3f97aed24c56 tempest-SnapshotDependencyTests-1725742164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-352730a4-9b0b-4320-aa1e-3c68979108b2 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:23:59 devstack sudo[103844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-352730a4-9b0b-4320-aa1e-3c68979108b2
Jul 03 01:23:59 devstack sudo[103844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:23:59 devstack sudo[103842]: pam_unix(sudo:session): session closed for user root
Jul 03 01:23:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-baa9cb03-110b-47f9-8e47-756f6d9a33a8 tempest-SnapshotDependencyTests-1725742164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.712s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:23:59 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-baa9cb03-110b-47f9-8e47-756f6d9a33a8 tempest-SnapshotDependencyTests-1725742164 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:23:59 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-baa9cb03-110b-47f9-8e47-756f6d9a33a8 tempest-SnapshotDependencyTests-1725742164 None] Deleted volume successfully.
Jul 03 01:23:59 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-baa9cb03-110b-47f9-8e47-756f6d9a33a8 tempest-SnapshotDependencyTests-1725742164 None] Lock "cinder-2f578b5f-de77-4e3a-9788-60e995a7828f-delete_volume" released by "delete_volume" :: held 2.571s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:24:00 devstack sudo[103844]: pam_unix(sudo:session): session closed for user root
Jul 03 01:24:00 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-681ccc00-2e22-467a-afcc-3f97aed24c56 tempest-SnapshotDependencyTests-1725742164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-352730a4-9b0b-4320-aa1e-3c68979108b2" returned: 0 in 0.896s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:24:00 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-681ccc00-2e22-467a-afcc-3f97aed24c56 tempest-SnapshotDependencyTests-1725742164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-352730a4-9b0b-4320-aa1e-3c68979108b2 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:24:00 devstack sudo[103850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-352730a4-9b0b-4320-aa1e-3c68979108b2
Jul 03 01:24:00 devstack sudo[103850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:24:00 devstack sudo[103850]: pam_unix(sudo:session): session closed for user root
Jul 03 01:24:00 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-681ccc00-2e22-467a-afcc-3f97aed24c56 tempest-SnapshotDependencyTests-1725742164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-352730a4-9b0b-4320-aa1e-3c68979108b2" returned: 0 in 0.686s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:24:00 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-681ccc00-2e22-467a-afcc-3f97aed24c56 tempest-SnapshotDependencyTests-1725742164 None] Lock "cinder-quobyte-352730a4-9b0b-4320-aa1e-3c68979108b2" released by "delete_volume" :: held 1.635s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:24:00 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-681ccc00-2e22-467a-afcc-3f97aed24c56 tempest-SnapshotDependencyTests-1725742164 None] Created reservations ['93b7432a-84fd-4f6e-96e3-1b72b8bc353a', '4a30146f-f0a7-495f-8e30-40cafff87972', '73fb1f61-4721-40e4-a0f1-7b4e96b761c8', '851d2d90-0eec-4a15-b1aa-7e37be3da1ec'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:24:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-681ccc00-2e22-467a-afcc-3f97aed24c56 tempest-SnapshotDependencyTests-1725742164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:24:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-681ccc00-2e22-467a-afcc-3f97aed24c56 tempest-SnapshotDependencyTests-1725742164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:24:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-681ccc00-2e22-467a-afcc-3f97aed24c56 tempest-SnapshotDependencyTests-1725742164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:24:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-681ccc00-2e22-467a-afcc-3f97aed24c56 tempest-SnapshotDependencyTests-1725742164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:24:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-681ccc00-2e22-467a-afcc-3f97aed24c56 tempest-SnapshotDependencyTests-1725742164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:24:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-681ccc00-2e22-467a-afcc-3f97aed24c56 tempest-SnapshotDependencyTests-1725742164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:24:01 devstack sudo[103853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:24:01 devstack sudo[103853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:24:01 devstack sudo[103853]: pam_unix(sudo:session): session closed for user root
Jul 03 01:24:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-681ccc00-2e22-467a-afcc-3f97aed24c56 tempest-SnapshotDependencyTests-1725742164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.717s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:24:01 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-681ccc00-2e22-467a-afcc-3f97aed24c56 tempest-SnapshotDependencyTests-1725742164 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:24:01 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-681ccc00-2e22-467a-afcc-3f97aed24c56 tempest-SnapshotDependencyTests-1725742164 None] Deleted volume successfully.
Jul 03 01:24:01 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-681ccc00-2e22-467a-afcc-3f97aed24c56 tempest-SnapshotDependencyTests-1725742164 None] Lock "cinder-352730a4-9b0b-4320-aa1e-3c68979108b2-delete_volume" released by "delete_volume" :: held 2.606s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:24:01 devstack cinder-volume[86891]: DEBUG oslo_service.periodic_task [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86891) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 01:24:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:24:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:24:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:24:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:24:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:24:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:24:01 devstack sudo[103856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:24:01 devstack sudo[103856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:24:02 devstack sudo[103856]: pam_unix(sudo:session): session closed for user root
Jul 03 01:24:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.675s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:24:02 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:24:02 devstack cinder-volume[86891]: DEBUG oslo_service.periodic_task [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running periodic task VolumeManager._thread_info {{(pid=86891) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 01:24:02 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] thread count: 28 {{(pid=86891) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 01:24:02 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] thread info: [<_MainThread(MainThread, started 136731296534656)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136731184953280)>, <Thread(Thread-3 (stat_writer), started daemon 136731184058816)>, <Thread(Rabbit-heartbeat, started daemon 136731184846080)>, <Thread(Thread-5 (_runner), started daemon 136731182936576)>, <Thread(Thread-7 (_runner), started daemon 136731182954944)>, <Thread(fd_logger, started daemon 136731181916416)>, <Thread(privsep_reader, started daemon 136731180942208)>, <Thread(tpool_thread_0, started daemon 136731172161216)>, <Thread(tpool_thread_1, started daemon 136731163768512)>, <Thread(tpool_thread_2, started daemon 136731155375808)>, <Thread(tpool_thread_3, started daemon 136731146983104)>, <Thread(tpool_thread_4, started daemon 136731138590400)>, <Thread(tpool_thread_5, started daemon 136731130197696)>, <Thread(tpool_thread_6, started daemon 136731121804992)>, <Thread(tpool_thread_7, started daemon 136731113412288)>, <Thread(tpool_thread_8, started daemon 136731105003200)>, <Thread(tpool_thread_9, started daemon 136731096594112)>, <Thread(tpool_thread_10, started daemon 136731088185024)>, <Thread(tpool_thread_11, started daemon 136731079775936)>, <Thread(tpool_thread_12, started daemon 136731071366848)>, <Thread(tpool_thread_13, started daemon 136731062957760)>, <Thread(tpool_thread_14, started daemon 136731054548672)>, <Thread(tpool_thread_15, started daemon 136731046139584)>, <Thread(tpool_thread_16, started daemon 136731037730496)>, <Thread(tpool_thread_17, started daemon 136731029321408)>, <Thread(tpool_thread_18, started daemon 136731020912320)>, <Thread(tpool_thread_19, started daemon 136731012503232)>] {{(pid=86891) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 01:24:06 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-669f14f3-d030-4d39-80c0-71fcd842ecf9 tempest-TestStampPattern-1029179603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:24:06 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-669f14f3-d030-4d39-80c0-71fcd842ecf9 tempest-TestStampPattern-1029179603 None] Flow 'volume_create_manager' (454c8e40-920d-4adc-951e-c1c64aea67ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:24:06 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-669f14f3-d030-4d39-80c0-71fcd842ecf9 tempest-TestStampPattern-1029179603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8b4d8e2-cb70-4c29-81f8-c6542b7bc333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:24:06 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-669f14f3-d030-4d39-80c0-71fcd842ecf9 tempest-TestStampPattern-1029179603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8b4d8e2-cb70-4c29-81f8-c6542b7bc333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:24:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-384899261',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49fd2d61-10ca-4766-be98-84ae0ee76ccd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7d16442fcf44d8f9f675ed2cdf76c46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:24:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:24:07Z,use_quota=True,user_id='dda386cd99234672b6b7c7b066020888',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:24:06 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-669f14f3-d030-4d39-80c0-71fcd842ecf9 tempest-TestStampPattern-1029179603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ecdfc11-c346-4be1-864f-81e18af2a1bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:24:06 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-669f14f3-d030-4d39-80c0-71fcd842ecf9 tempest-TestStampPattern-1029179603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ecdfc11-c346-4be1-864f-81e18af2a1bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:24:06 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-669f14f3-d030-4d39-80c0-71fcd842ecf9 tempest-TestStampPattern-1029179603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2f2012b-3eef-422d-bc04-6eacb1125a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:24:06 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-669f14f3-d030-4d39-80c0-71fcd842ecf9 tempest-TestStampPattern-1029179603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2f2012b-3eef-422d-bc04-6eacb1125a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49fd2d61-10ca-4766-be98-84ae0ee76ccd', 'volume_name': 'volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:24:06 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-669f14f3-d030-4d39-80c0-71fcd842ecf9 tempest-TestStampPattern-1029179603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (817fd5b8-785b-4a92-8215-d365f89c6245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:24:06 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-669f14f3-d030-4d39-80c0-71fcd842ecf9 tempest-TestStampPattern-1029179603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (817fd5b8-785b-4a92-8215-d365f89c6245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:24:06 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-669f14f3-d030-4d39-80c0-71fcd842ecf9 tempest-TestStampPattern-1029179603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (783fb766-36fe-455e-974d-728f63a10448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:24:06 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-669f14f3-d030-4d39-80c0-71fcd842ecf9 tempest-TestStampPattern-1029179603 None] Volume 49fd2d61-10ca-4766-be98-84ae0ee76ccd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd', 'volume_size': 1}
Jul 03 01:24:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-669f14f3-d030-4d39-80c0-71fcd842ecf9 tempest-TestStampPattern-1029179603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:24:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-669f14f3-d030-4d39-80c0-71fcd842ecf9 tempest-TestStampPattern-1029179603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:24:06 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-669f14f3-d030-4d39-80c0-71fcd842ecf9 tempest-TestStampPattern-1029179603 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:24:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-384899261',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49fd2d61-10ca-4766-be98-84ae0ee76ccd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7d16442fcf44d8f9f675ed2cdf76c46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:24:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:24:07Z,use_quota=True,user_id='dda386cd99234672b6b7c7b066020888',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:24:06 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-669f14f3-d030-4d39-80c0-71fcd842ecf9 tempest-TestStampPattern-1029179603 None] Creating volume 49fd2d61-10ca-4766-be98-84ae0ee76ccd {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:24:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-669f14f3-d030-4d39-80c0-71fcd842ecf9 tempest-TestStampPattern-1029179603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:24:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-669f14f3-d030-4d39-80c0-71fcd842ecf9 tempest-TestStampPattern-1029179603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:24:06 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-669f14f3-d030-4d39-80c0-71fcd842ecf9 tempest-TestStampPattern-1029179603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:24:06 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-669f14f3-d030-4d39-80c0-71fcd842ecf9 tempest-TestStampPattern-1029179603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:24:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-669f14f3-d030-4d39-80c0-71fcd842ecf9 tempest-TestStampPattern-1029179603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:24:06 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-669f14f3-d030-4d39-80c0-71fcd842ecf9 tempest-TestStampPattern-1029179603 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:24:06 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-669f14f3-d030-4d39-80c0-71fcd842ecf9 tempest-TestStampPattern-1029179603 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:24:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-669f14f3-d030-4d39-80c0-71fcd842ecf9 tempest-TestStampPattern-1029179603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:24:06 devstack sudo[103862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd 1073741824
Jul 03 01:24:06 devstack sudo[103862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:24:07 devstack sudo[103862]: pam_unix(sudo:session): session closed for user root
Jul 03 01:24:07 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-669f14f3-d030-4d39-80c0-71fcd842ecf9 tempest-TestStampPattern-1029179603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd 1073741824" returned: 0 in 1.054s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:24:07 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-669f14f3-d030-4d39-80c0-71fcd842ecf9 tempest-TestStampPattern-1029179603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:24:07 devstack sudo[103871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd
Jul 03 01:24:07 devstack sudo[103871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:24:08 devstack sudo[103871]: pam_unix(sudo:session): session closed for user root
Jul 03 01:24:08 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-669f14f3-d030-4d39-80c0-71fcd842ecf9 tempest-TestStampPattern-1029179603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd" returned: 0 in 0.735s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:24:08 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-669f14f3-d030-4d39-80c0-71fcd842ecf9 tempest-TestStampPattern-1029179603 None] <== create_volume: return (1838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:24:08 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-669f14f3-d030-4d39-80c0-71fcd842ecf9 tempest-TestStampPattern-1029179603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.842s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:24:08 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-669f14f3-d030-4d39-80c0-71fcd842ecf9 tempest-TestStampPattern-1029179603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (783fb766-36fe-455e-974d-728f63a10448) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:24:08 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-669f14f3-d030-4d39-80c0-71fcd842ecf9 tempest-TestStampPattern-1029179603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8538cfba-db36-41cd-b962-7e0be0633f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:24:08 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-669f14f3-d030-4d39-80c0-71fcd842ecf9 tempest-TestStampPattern-1029179603 None] Volume volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd (49fd2d61-10ca-4766-be98-84ae0ee76ccd): created successfully
Jul 03 01:24:08 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-669f14f3-d030-4d39-80c0-71fcd842ecf9 tempest-TestStampPattern-1029179603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8538cfba-db36-41cd-b962-7e0be0633f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:24:08 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-669f14f3-d030-4d39-80c0-71fcd842ecf9 tempest-TestStampPattern-1029179603 None] Flow 'volume_create_manager' (454c8e40-920d-4adc-951e-c1c64aea67ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:24:08 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-669f14f3-d030-4d39-80c0-71fcd842ecf9 tempest-TestStampPattern-1029179603 None] Created volume successfully.
Jul 03 01:24:18 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:SELECT=30,cinder:UPDATE=34,cinder:INSERT=14,cinder:DELETE=4 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:24:18 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:SELECT=33,cinder:INSERT=5,cinder:UPDATE=44,cinder:DELETE=3 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:24:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-e8b252ef-79b1-4c30-9229-53f7e5baa69a req-56ebfd43-4dd7-4370-b79c-dd81a54b25cc tempest-TestStampPattern-1029179603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:24:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-e8b252ef-79b1-4c30-9229-53f7e5baa69a req-56ebfd43-4dd7-4370-b79c-dd81a54b25cc tempest-TestStampPattern-1029179603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:24:47 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56287a9-7bf6-4690-86d7-0434e568fb6b]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:24:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-e8b252ef-79b1-4c30-9229-53f7e5baa69a req-56ebfd43-4dd7-4370-b79c-dd81a54b25cc tempest-TestStampPattern-1029179603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:24:47 devstack sudo[104048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd
Jul 03 01:24:47 devstack sudo[104048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:24:48 devstack sudo[104048]: pam_unix(sudo:session): session closed for user root
Jul 03 01:24:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-e8b252ef-79b1-4c30-9229-53f7e5baa69a req-56ebfd43-4dd7-4370-b79c-dd81a54b25cc tempest-TestStampPattern-1029179603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd" returned: 0 in 0.811s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:24:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-e8b252ef-79b1-4c30-9229-53f7e5baa69a req-56ebfd43-4dd7-4370-b79c-dd81a54b25cc tempest-TestStampPattern-1029179603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.828s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:24:48 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [req-e8b252ef-79b1-4c30-9229-53f7e5baa69a req-56ebfd43-4dd7-4370-b79c-dd81a54b25cc tempest-TestStampPattern-1029179603 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3', 'name': 'volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '00296c29-2227-47d7-b4f4-f41ab1b9d55a', 'enforce_multipath': True} {{(pid=86891) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 01:24:48 devstack cinder-volume[86891]: INFO cinder.volume.manager [req-e8b252ef-79b1-4c30-9229-53f7e5baa69a req-56ebfd43-4dd7-4370-b79c-dd81a54b25cc tempest-TestStampPattern-1029179603 None] attachment_update completed successfully.
Jul 03 01:24:56 devstack cinder-volume[86891]: INFO cinder.volume.manager [req-cb0f3440-29da-4c91-b231-cc90abc12b8f req-f9c09517-2320-4d96-b733-c9837078faa6 tempest-TestStampPattern-1029179603 None] Terminate volume connection completed successfully.
Jul 03 01:24:56 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [req-cb0f3440-29da-4c91-b231-cc90abc12b8f req-f9c09517-2320-4d96-b733-c9837078faa6 tempest-TestStampPattern-1029179603 None] Deleting attachment 00296c29-2227-47d7-b4f4-f41ab1b9d55a. {{(pid=86891) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 01:24:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-867c570e-e205-4a12-907b-3244c3291114 tempest-TestStampPattern-1029179603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:24:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-867c570e-e205-4a12-907b-3244c3291114 tempest-TestStampPattern-1029179603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:24:58 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-867c570e-e205-4a12-907b-3244c3291114 tempest-TestStampPattern-1029179603 None] Creating offline snapshot 955886d4-03ab-43a6-ab7c-051747ac9b71 of volume 49fd2d61-10ca-4766-be98-84ae0ee76ccd {{(pid=86891) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 01:24:58 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[9beae681-e3bf-408f-b880-7a87bcf66dc1]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:24:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-867c570e-e205-4a12-907b-3244c3291114 tempest-TestStampPattern-1029179603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:24:58 devstack sudo[104485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd
Jul 03 01:24:58 devstack sudo[104485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:24:59 devstack sudo[104485]: pam_unix(sudo:session): session closed for user root
Jul 03 01:24:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-867c570e-e205-4a12-907b-3244c3291114 tempest-TestStampPattern-1029179603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd" returned: 0 in 0.734s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:24:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-867c570e-e205-4a12-907b-3244c3291114 tempest-TestStampPattern-1029179603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd.955886d4-03ab-43a6-ab7c-051747ac9b71 1G {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:24:59 devstack sudo[104491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd.955886d4-03ab-43a6-ab7c-051747ac9b71 1G
Jul 03 01:24:59 devstack sudo[104491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:24:59 devstack sudo[104491]: pam_unix(sudo:session): session closed for user root
Jul 03 01:24:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-867c570e-e205-4a12-907b-3244c3291114 tempest-TestStampPattern-1029179603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd.955886d4-03ab-43a6-ab7c-051747ac9b71 1G" returned: 0 in 0.753s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:24:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-867c570e-e205-4a12-907b-3244c3291114 tempest-TestStampPattern-1029179603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd.955886d4-03ab-43a6-ab7c-051747ac9b71 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:24:59 devstack sudo[104497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd.955886d4-03ab-43a6-ab7c-051747ac9b71
Jul 03 01:24:59 devstack sudo[104497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:25:00 devstack sudo[104497]: pam_unix(sudo:session): session closed for user root
Jul 03 01:25:00 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-867c570e-e205-4a12-907b-3244c3291114 tempest-TestStampPattern-1029179603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd.955886d4-03ab-43a6-ab7c-051747ac9b71" returned: 0 in 0.688s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:25:00 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-867c570e-e205-4a12-907b-3244c3291114 tempest-TestStampPattern-1029179603 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd.955886d4-03ab-43a6-ab7c-051747ac9b71 is being set with open permissions: ugo+rw
Jul 03 01:25:00 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-867c570e-e205-4a12-907b-3244c3291114 tempest-TestStampPattern-1029179603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd.955886d4-03ab-43a6-ab7c-051747ac9b71 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:25:00 devstack sudo[104502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd.955886d4-03ab-43a6-ab7c-051747ac9b71
Jul 03 01:25:00 devstack sudo[104502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:25:01 devstack sudo[104502]: pam_unix(sudo:session): session closed for user root
Jul 03 01:25:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-867c570e-e205-4a12-907b-3244c3291114 tempest-TestStampPattern-1029179603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd.955886d4-03ab-43a6-ab7c-051747ac9b71" returned: 0 in 0.640s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:25:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-867c570e-e205-4a12-907b-3244c3291114 tempest-TestStampPattern-1029179603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:25:01 devstack sudo[104508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd.info
Jul 03 01:25:01 devstack sudo[104508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:25:01 devstack sudo[104508]: pam_unix(sudo:session): session closed for user root
Jul 03 01:25:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-867c570e-e205-4a12-907b-3244c3291114 tempest-TestStampPattern-1029179603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd.info" returned: 0 in 0.620s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:25:01 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-867c570e-e205-4a12-907b-3244c3291114 tempest-TestStampPattern-1029179603 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd.info is being set with open permissions: ugo+rw
Jul 03 01:25:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-867c570e-e205-4a12-907b-3244c3291114 tempest-TestStampPattern-1029179603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:25:01 devstack sudo[104511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd.info
Jul 03 01:25:01 devstack sudo[104511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:25:01 devstack cinder-volume[86891]: DEBUG oslo_service.periodic_task [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86891) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 01:25:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:25:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:25:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:25:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:25:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:25:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:25:01 devstack sudo[104513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:25:01 devstack sudo[104513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:25:02 devstack sudo[104511]: pam_unix(sudo:session): session closed for user root
Jul 03 01:25:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-867c570e-e205-4a12-907b-3244c3291114 tempest-TestStampPattern-1029179603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd.info" returned: 0 in 0.637s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:25:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-867c570e-e205-4a12-907b-3244c3291114 tempest-TestStampPattern-1029179603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.151s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:25:02 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-867c570e-e205-4a12-907b-3244c3291114 tempest-TestStampPattern-1029179603 None] Create snapshot completed successfully
Jul 03 01:25:02 devstack sudo[104513]: pam_unix(sudo:session): session closed for user root
Jul 03 01:25:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.660s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:25:02 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:25:02 devstack cinder-volume[86891]: DEBUG oslo_service.periodic_task [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running periodic task VolumeManager._thread_info {{(pid=86891) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 01:25:02 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] thread count: 28 {{(pid=86891) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 01:25:02 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] thread info: [<_MainThread(MainThread, started 136731296534656)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136731184953280)>, <Thread(Thread-3 (stat_writer), started daemon 136731184058816)>, <Thread(Rabbit-heartbeat, started daemon 136731184846080)>, <Thread(Thread-5 (_runner), started daemon 136731182936576)>, <Thread(Thread-7 (_runner), started daemon 136731182954944)>, <Thread(fd_logger, started daemon 136731181916416)>, <Thread(privsep_reader, started daemon 136731180942208)>, <Thread(tpool_thread_0, started daemon 136731172161216)>, <Thread(tpool_thread_1, started daemon 136731163768512)>, <Thread(tpool_thread_2, started daemon 136731155375808)>, <Thread(tpool_thread_3, started daemon 136731146983104)>, <Thread(tpool_thread_4, started daemon 136731138590400)>, <Thread(tpool_thread_5, started daemon 136731130197696)>, <Thread(tpool_thread_6, started daemon 136731121804992)>, <Thread(tpool_thread_7, started daemon 136731113412288)>, <Thread(tpool_thread_8, started daemon 136731105003200)>, <Thread(tpool_thread_9, started daemon 136731096594112)>, <Thread(tpool_thread_10, started daemon 136731088185024)>, <Thread(tpool_thread_11, started daemon 136731079775936)>, <Thread(tpool_thread_12, started daemon 136731071366848)>, <Thread(tpool_thread_13, started daemon 136731062957760)>, <Thread(tpool_thread_14, started daemon 136731054548672)>, <Thread(tpool_thread_15, started daemon 136731046139584)>, <Thread(tpool_thread_16, started daemon 136731037730496)>, <Thread(tpool_thread_17, started daemon 136731029321408)>, <Thread(tpool_thread_18, started daemon 136731020912320)>, <Thread(tpool_thread_19, started daemon 136731012503232)>] {{(pid=86891) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 01:25:11 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:SELECT=12,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:25:12 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:SELECT=9,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:25:13 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-932f1765-f039-476a-a885-94bef7022f9f tempest-TestStampPattern-1029179603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:25:13 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-932f1765-f039-476a-a885-94bef7022f9f tempest-TestStampPattern-1029179603 None] Flow 'volume_create_manager' (9ff0fbb0-9cd1-480a-a564-39c4ae9a7aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:25:13 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-932f1765-f039-476a-a885-94bef7022f9f tempest-TestStampPattern-1029179603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b592abc-f95d-4634-b3dd-be004e9b5af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:25:13 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-932f1765-f039-476a-a885-94bef7022f9f tempest-TestStampPattern-1029179603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b592abc-f95d-4634-b3dd-be004e9b5af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:25:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1583814073',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72fcc775-86d6-4428-aed3-840cbcea8de4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7d16442fcf44d8f9f675ed2cdf76c46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:25:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=955886d4-03ab-43a6-ab7c-051747ac9b71,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:25:13Z,use_quota=True,user_id='dda386cd99234672b6b7c7b066020888',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:25:13 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-932f1765-f039-476a-a885-94bef7022f9f tempest-TestStampPattern-1029179603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a8f0cda-8cd0-40ff-a531-a1bc65876be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:25:13 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-932f1765-f039-476a-a885-94bef7022f9f tempest-TestStampPattern-1029179603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a8f0cda-8cd0-40ff-a531-a1bc65876be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:25:13 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-932f1765-f039-476a-a885-94bef7022f9f tempest-TestStampPattern-1029179603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f4fbf98-df28-472c-81c2-0e4872ef6610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:25:13 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-932f1765-f039-476a-a885-94bef7022f9f tempest-TestStampPattern-1029179603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f4fbf98-df28-472c-81c2-0e4872ef6610) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '72fcc775-86d6-4428-aed3-840cbcea8de4', 'volume_name': 'volume-72fcc775-86d6-4428-aed3-840cbcea8de4', 'volume_size': 1, 'snapshot_id': '955886d4-03ab-43a6-ab7c-051747ac9b71'}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:25:13 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-932f1765-f039-476a-a885-94bef7022f9f tempest-TestStampPattern-1029179603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15131611-b2fb-4583-bb44-6cf7af821e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:25:13 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-932f1765-f039-476a-a885-94bef7022f9f tempest-TestStampPattern-1029179603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15131611-b2fb-4583-bb44-6cf7af821e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:25:13 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-932f1765-f039-476a-a885-94bef7022f9f tempest-TestStampPattern-1029179603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (899e30bb-a133-4aaa-aefc-b907757b33c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:25:13 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-932f1765-f039-476a-a885-94bef7022f9f tempest-TestStampPattern-1029179603 None] Volume 72fcc775-86d6-4428-aed3-840cbcea8de4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-72fcc775-86d6-4428-aed3-840cbcea8de4', 'volume_size': 1, 'snapshot_id': '955886d4-03ab-43a6-ab7c-051747ac9b71'}
Jul 03 01:25:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-932f1765-f039-476a-a885-94bef7022f9f tempest-TestStampPattern-1029179603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:25:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-932f1765-f039-476a-a885-94bef7022f9f tempest-TestStampPattern-1029179603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:25:13 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-932f1765-f039-476a-a885-94bef7022f9f tempest-TestStampPattern-1029179603 None] Acquiring lock "cinder-quobyte-955886d4-03ab-43a6-ab7c-051747ac9b71-72fcc775-86d6-4428-aed3-840cbcea8de4" by "_create_volume_from_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:25:13 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-932f1765-f039-476a-a885-94bef7022f9f tempest-TestStampPattern-1029179603 None] Lock "cinder-quobyte-955886d4-03ab-43a6-ab7c-051747ac9b71-72fcc775-86d6-4428-aed3-840cbcea8de4" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:25:13 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-932f1765-f039-476a-a885-94bef7022f9f tempest-TestStampPattern-1029179603 None] Creating volume 72fcc775-86d6-4428-aed3-840cbcea8de4 from snapshot 955886d4-03ab-43a6-ab7c-051747ac9b71 {{(pid=86891) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 03 01:25:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-932f1765-f039-476a-a885-94bef7022f9f tempest-TestStampPattern-1029179603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:25:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-932f1765-f039-476a-a885-94bef7022f9f tempest-TestStampPattern-1029179603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:25:13 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-932f1765-f039-476a-a885-94bef7022f9f tempest-TestStampPattern-1029179603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:25:13 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-932f1765-f039-476a-a885-94bef7022f9f tempest-TestStampPattern-1029179603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:25:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-932f1765-f039-476a-a885-94bef7022f9f tempest-TestStampPattern-1029179603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:25:13 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-932f1765-f039-476a-a885-94bef7022f9f tempest-TestStampPattern-1029179603 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:25:13 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-932f1765-f039-476a-a885-94bef7022f9f tempest-TestStampPattern-1029179603 None] Acquiring lock "cinder-quobyte-72fcc775-86d6-4428-aed3-840cbcea8de4" by "_copy_volume_from_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:25:13 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-932f1765-f039-476a-a885-94bef7022f9f tempest-TestStampPattern-1029179603 None] Lock "cinder-quobyte-72fcc775-86d6-4428-aed3-840cbcea8de4" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:25:13 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-932f1765-f039-476a-a885-94bef7022f9f tempest-TestStampPattern-1029179603 None] snapshot: 955886d4-03ab-43a6-ab7c-051747ac9b71, volume: 72fcc775-86d6-4428-aed3-840cbcea8de4,  {{(pid=86891) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 03 01:25:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-932f1765-f039-476a-a885-94bef7022f9f tempest-TestStampPattern-1029179603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:25:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-932f1765-f039-476a-a885-94bef7022f9f tempest-TestStampPattern-1029179603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:25:13 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-932f1765-f039-476a-a885-94bef7022f9f tempest-TestStampPattern-1029179603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:25:13 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-932f1765-f039-476a-a885-94bef7022f9f tempest-TestStampPattern-1029179603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:25:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-932f1765-f039-476a-a885-94bef7022f9f tempest-TestStampPattern-1029179603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:25:13 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc6dd63-ab6b-4e04-8b14-34537bb40c71]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:25:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-932f1765-f039-476a-a885-94bef7022f9f tempest-TestStampPattern-1029179603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd.955886d4-03ab-43a6-ab7c-051747ac9b71 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:25:13 devstack sudo[104966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd.955886d4-03ab-43a6-ab7c-051747ac9b71
Jul 03 01:25:13 devstack sudo[104966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:25:14 devstack sudo[104966]: pam_unix(sudo:session): session closed for user root
Jul 03 01:25:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-932f1765-f039-476a-a885-94bef7022f9f tempest-TestStampPattern-1029179603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd.955886d4-03ab-43a6-ab7c-051747ac9b71" returned: 0 in 0.838s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:25:14 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-932f1765-f039-476a-a885-94bef7022f9f tempest-TestStampPattern-1029179603 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:25:14 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-932f1765-f039-476a-a885-94bef7022f9f tempest-TestStampPattern-1029179603 None] will copy from snapshot at /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd {{(pid=86891) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 03 01:25:14 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-932f1765-f039-476a-a885-94bef7022f9f tempest-TestStampPattern-1029179603 None] Creating direct copy from snapshot {{(pid=86891) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 03 01:25:14 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[2698d9d6-daba-4ca8-9435-d2f4e30e08f7]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:25:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-932f1765-f039-476a-a885-94bef7022f9f tempest-TestStampPattern-1029179603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:25:14 devstack sudo[104981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd
Jul 03 01:25:14 devstack sudo[104981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:25:15 devstack sudo[104981]: pam_unix(sudo:session): session closed for user root
Jul 03 01:25:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-932f1765-f039-476a-a885-94bef7022f9f tempest-TestStampPattern-1029179603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd" returned: 0 in 0.828s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:25:15 devstack cinder-volume[86891]: DEBUG cinder.utils [None req-932f1765-f039-476a-a885-94bef7022f9f tempest-TestStampPattern-1029179603 None] Path /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-72fcc775-86d6-4428-aed3-840cbcea8de4 not found in is_blk_device check {{(pid=86891) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 03 01:25:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-932f1765-f039-476a-a885-94bef7022f9f tempest-TestStampPattern-1029179603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-72fcc775-86d6-4428-aed3-840cbcea8de4 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:25:15 devstack sudo[104986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-72fcc775-86d6-4428-aed3-840cbcea8de4
Jul 03 01:25:15 devstack sudo[104986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:25:20 devstack sudo[104986]: pam_unix(sudo:session): session closed for user root
Jul 03 01:25:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-932f1765-f039-476a-a885-94bef7022f9f tempest-TestStampPattern-1029179603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-72fcc775-86d6-4428-aed3-840cbcea8de4" returned: 0 in 4.752s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:25:20 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c5ac52-11e2-441c-baa1-d06ba7dd4902]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:25:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-932f1765-f039-476a-a885-94bef7022f9f tempest-TestStampPattern-1029179603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:25:20 devstack sudo[105002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd
Jul 03 01:25:20 devstack sudo[105002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:25:21 devstack sudo[105002]: pam_unix(sudo:session): session closed for user root
Jul 03 01:25:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-932f1765-f039-476a-a885-94bef7022f9f tempest-TestStampPattern-1029179603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd" returned: 0 in 1.050s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:25:21 devstack cinder-volume[86891]: DEBUG cinder.image.image_utils [None req-932f1765-f039-476a-a885-94bef7022f9f tempest-TestStampPattern-1029179603 None] Image conversion details: src /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd, size 1024.00 MB, duration 4.75 sec, destination /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-72fcc775-86d6-4428-aed3-840cbcea8de4 {{(pid=86891) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 03 01:25:21 devstack cinder-volume[86891]: INFO cinder.image.image_utils [None req-932f1765-f039-476a-a885-94bef7022f9f tempest-TestStampPattern-1029179603 None] Converted 1024.00 MB image at 215.44 MB/s
Jul 03 01:25:21 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-932f1765-f039-476a-a885-94bef7022f9f tempest-TestStampPattern-1029179603 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-72fcc775-86d6-4428-aed3-840cbcea8de4 is being set with open permissions: ugo+rw
Jul 03 01:25:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-932f1765-f039-476a-a885-94bef7022f9f tempest-TestStampPattern-1029179603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-72fcc775-86d6-4428-aed3-840cbcea8de4 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:25:21 devstack sudo[105010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-72fcc775-86d6-4428-aed3-840cbcea8de4
Jul 03 01:25:21 devstack sudo[105010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:25:21 devstack sudo[105010]: pam_unix(sudo:session): session closed for user root
Jul 03 01:25:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-932f1765-f039-476a-a885-94bef7022f9f tempest-TestStampPattern-1029179603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-72fcc775-86d6-4428-aed3-840cbcea8de4" returned: 0 in 0.702s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:25:21 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-932f1765-f039-476a-a885-94bef7022f9f tempest-TestStampPattern-1029179603 None] Lock "cinder-quobyte-72fcc775-86d6-4428-aed3-840cbcea8de4" released by "_copy_volume_from_snapshot" :: held 8.272s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:25:21 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-932f1765-f039-476a-a885-94bef7022f9f tempest-TestStampPattern-1029179603 None] Lock "cinder-quobyte-955886d4-03ab-43a6-ab7c-051747ac9b71-72fcc775-86d6-4428-aed3-840cbcea8de4" released by "_create_volume_from_snapshot" :: held 8.303s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:25:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-932f1765-f039-476a-a885-94bef7022f9f tempest-TestStampPattern-1029179603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.319s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:25:21 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-932f1765-f039-476a-a885-94bef7022f9f tempest-TestStampPattern-1029179603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (899e30bb-a133-4aaa-aefc-b907757b33c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72fcc775-86d6-4428-aed3-840cbcea8de4', 'volume_size': 1, 'snapshot_id': '955886d4-03ab-43a6-ab7c-051747ac9b71'}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:25:21 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-932f1765-f039-476a-a885-94bef7022f9f tempest-TestStampPattern-1029179603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (973b4b20-313e-485a-bf01-39daa96f68eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:25:21 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-932f1765-f039-476a-a885-94bef7022f9f tempest-TestStampPattern-1029179603 None] Volume volume-72fcc775-86d6-4428-aed3-840cbcea8de4 (72fcc775-86d6-4428-aed3-840cbcea8de4): created successfully
Jul 03 01:25:21 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-932f1765-f039-476a-a885-94bef7022f9f tempest-TestStampPattern-1029179603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (973b4b20-313e-485a-bf01-39daa96f68eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:25:21 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-932f1765-f039-476a-a885-94bef7022f9f tempest-TestStampPattern-1029179603 None] Flow 'volume_create_manager' (9ff0fbb0-9cd1-480a-a564-39c4ae9a7aa4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:25:21 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-932f1765-f039-476a-a885-94bef7022f9f tempest-TestStampPattern-1029179603 None] Created volume successfully.
Jul 03 01:25:31 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:25:31 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:UPDATE=2,cinder:SELECT=1,cinder:DELETE=1 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:26:01 devstack cinder-volume[86891]: DEBUG oslo_service.periodic_task [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86891) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 01:26:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:26:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:26:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:26:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:26:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:26:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:26:01 devstack sudo[105143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:26:01 devstack sudo[105143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:26:02 devstack sudo[105143]: pam_unix(sudo:session): session closed for user root
Jul 03 01:26:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.664s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:26:02 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:26:02 devstack cinder-volume[86891]: DEBUG oslo_service.periodic_task [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running periodic task VolumeManager._thread_info {{(pid=86891) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 01:26:02 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] thread count: 28 {{(pid=86891) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 01:26:02 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] thread info: [<_MainThread(MainThread, started 136731296534656)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136731184953280)>, <Thread(Thread-3 (stat_writer), started daemon 136731184058816)>, <Thread(Rabbit-heartbeat, started daemon 136731184846080)>, <Thread(Thread-5 (_runner), started daemon 136731182936576)>, <Thread(Thread-7 (_runner), started daemon 136731182954944)>, <Thread(fd_logger, started daemon 136731181916416)>, <Thread(privsep_reader, started daemon 136731180942208)>, <Thread(tpool_thread_0, started daemon 136731172161216)>, <Thread(tpool_thread_1, started daemon 136731163768512)>, <Thread(tpool_thread_2, started daemon 136731155375808)>, <Thread(tpool_thread_3, started daemon 136731146983104)>, <Thread(tpool_thread_4, started daemon 136731138590400)>, <Thread(tpool_thread_5, started daemon 136731130197696)>, <Thread(tpool_thread_6, started daemon 136731121804992)>, <Thread(tpool_thread_7, started daemon 136731113412288)>, <Thread(tpool_thread_8, started daemon 136731105003200)>, <Thread(tpool_thread_9, started daemon 136731096594112)>, <Thread(tpool_thread_10, started daemon 136731088185024)>, <Thread(tpool_thread_11, started daemon 136731079775936)>, <Thread(tpool_thread_12, started daemon 136731071366848)>, <Thread(tpool_thread_13, started daemon 136731062957760)>, <Thread(tpool_thread_14, started daemon 136731054548672)>, <Thread(tpool_thread_15, started daemon 136731046139584)>, <Thread(tpool_thread_16, started daemon 136731037730496)>, <Thread(tpool_thread_17, started daemon 136731029321408)>, <Thread(tpool_thread_18, started daemon 136731020912320)>, <Thread(tpool_thread_19, started daemon 136731012503232)>] {{(pid=86891) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 01:26:10 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-c1a8264a-1534-4f0c-a95f-a12086b363a7 req-e208c959-d0e6-425a-94eb-fbaa39249ad5 tempest-TestStampPattern-1029179603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:26:10 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-c1a8264a-1534-4f0c-a95f-a12086b363a7 req-e208c959-d0e6-425a-94eb-fbaa39249ad5 tempest-TestStampPattern-1029179603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:26:10 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[100c7caa-295d-4ae6-b120-ce151f754686]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:26:10 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-c1a8264a-1534-4f0c-a95f-a12086b363a7 req-e208c959-d0e6-425a-94eb-fbaa39249ad5 tempest-TestStampPattern-1029179603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-72fcc775-86d6-4428-aed3-840cbcea8de4 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:26:10 devstack sudo[105162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-72fcc775-86d6-4428-aed3-840cbcea8de4
Jul 03 01:26:10 devstack sudo[105162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:26:11 devstack sudo[105162]: pam_unix(sudo:session): session closed for user root
Jul 03 01:26:11 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [req-c1a8264a-1534-4f0c-a95f-a12086b363a7 req-e208c959-d0e6-425a-94eb-fbaa39249ad5 tempest-TestStampPattern-1029179603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-72fcc775-86d6-4428-aed3-840cbcea8de4" returned: 0 in 0.758s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:26:11 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [req-c1a8264a-1534-4f0c-a95f-a12086b363a7 req-e208c959-d0e6-425a-94eb-fbaa39249ad5 tempest-TestStampPattern-1029179603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.776s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:26:11 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [req-c1a8264a-1534-4f0c-a95f-a12086b363a7 req-e208c959-d0e6-425a-94eb-fbaa39249ad5 tempest-TestStampPattern-1029179603 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3', 'name': 'volume-72fcc775-86d6-4428-aed3-840cbcea8de4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7b832ab5-3157-4fcb-8133-3989046a1625', 'enforce_multipath': True} {{(pid=86891) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 01:26:11 devstack cinder-volume[86891]: INFO cinder.volume.manager [req-c1a8264a-1534-4f0c-a95f-a12086b363a7 req-e208c959-d0e6-425a-94eb-fbaa39249ad5 tempest-TestStampPattern-1029179603 None] attachment_update completed successfully.
Jul 03 01:26:18 devstack cinder-volume[86891]: INFO cinder.volume.manager [req-66598ba5-ce5f-4858-ae4f-b5dc9e06bf05 req-d91878b8-1b4f-4d63-9ce0-e2b7e9b70f39 tempest-TestStampPattern-1029179603 None] Terminate volume connection completed successfully.
Jul 03 01:26:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [req-66598ba5-ce5f-4858-ae4f-b5dc9e06bf05 req-d91878b8-1b4f-4d63-9ce0-e2b7e9b70f39 tempest-TestStampPattern-1029179603 None] Deleting attachment 7b832ab5-3157-4fcb-8133-3989046a1625. {{(pid=86891) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 01:26:21 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:26:27 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-86602905-cb2a-47fc-9ae6-5ab39b5e3670 tempest-TestStampPattern-1029179603 None] Acquiring lock "cinder-72fcc775-86d6-4428-aed3-840cbcea8de4-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:26:27 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-86602905-cb2a-47fc-9ae6-5ab39b5e3670 tempest-TestStampPattern-1029179603 None] Lock "cinder-72fcc775-86d6-4428-aed3-840cbcea8de4-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:26:27 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-86602905-cb2a-47fc-9ae6-5ab39b5e3670 tempest-TestStampPattern-1029179603 None] Acquiring lock "cinder-quobyte-72fcc775-86d6-4428-aed3-840cbcea8de4" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:26:27 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-86602905-cb2a-47fc-9ae6-5ab39b5e3670 tempest-TestStampPattern-1029179603 None] Lock "cinder-quobyte-72fcc775-86d6-4428-aed3-840cbcea8de4" acquired by "delete_volume" :: waited 0.015s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:26:27 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e427c7d-e799-43e3-aef9-dc7f69c59f11]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:26:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-86602905-cb2a-47fc-9ae6-5ab39b5e3670 tempest-TestStampPattern-1029179603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-72fcc775-86d6-4428-aed3-840cbcea8de4 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:26:27 devstack sudo[105654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-72fcc775-86d6-4428-aed3-840cbcea8de4
Jul 03 01:26:27 devstack sudo[105654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:26:28 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:SELECT=8 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:26:28 devstack sudo[105654]: pam_unix(sudo:session): session closed for user root
Jul 03 01:26:28 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-86602905-cb2a-47fc-9ae6-5ab39b5e3670 tempest-TestStampPattern-1029179603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-72fcc775-86d6-4428-aed3-840cbcea8de4" returned: 0 in 0.811s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:26:28 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-86602905-cb2a-47fc-9ae6-5ab39b5e3670 tempest-TestStampPattern-1029179603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-72fcc775-86d6-4428-aed3-840cbcea8de4 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:26:28 devstack sudo[105659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-72fcc775-86d6-4428-aed3-840cbcea8de4
Jul 03 01:26:28 devstack sudo[105659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:26:29 devstack sudo[105659]: pam_unix(sudo:session): session closed for user root
Jul 03 01:26:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-86602905-cb2a-47fc-9ae6-5ab39b5e3670 tempest-TestStampPattern-1029179603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-72fcc775-86d6-4428-aed3-840cbcea8de4" returned: 0 in 0.716s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:26:29 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-86602905-cb2a-47fc-9ae6-5ab39b5e3670 tempest-TestStampPattern-1029179603 None] Lock "cinder-quobyte-72fcc775-86d6-4428-aed3-840cbcea8de4" released by "delete_volume" :: held 1.572s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:26:29 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-86602905-cb2a-47fc-9ae6-5ab39b5e3670 tempest-TestStampPattern-1029179603 None] Created reservations ['db6539e1-ff2f-4fd5-b24d-af7c00fe020d', '13752d81-6ec0-4261-bc8b-6491cccb0698', 'bb6d1a86-2f55-4977-9c79-eb3bc7847b04', '320dff91-89d6-465f-8751-2708476ef4dd'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:26:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-86602905-cb2a-47fc-9ae6-5ab39b5e3670 tempest-TestStampPattern-1029179603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:26:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-86602905-cb2a-47fc-9ae6-5ab39b5e3670 tempest-TestStampPattern-1029179603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:26:29 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-86602905-cb2a-47fc-9ae6-5ab39b5e3670 tempest-TestStampPattern-1029179603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:26:29 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-86602905-cb2a-47fc-9ae6-5ab39b5e3670 tempest-TestStampPattern-1029179603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:26:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-86602905-cb2a-47fc-9ae6-5ab39b5e3670 tempest-TestStampPattern-1029179603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:26:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-86602905-cb2a-47fc-9ae6-5ab39b5e3670 tempest-TestStampPattern-1029179603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:26:29 devstack sudo[105663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:26:29 devstack sudo[105663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:26:29 devstack sudo[105663]: pam_unix(sudo:session): session closed for user root
Jul 03 01:26:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-86602905-cb2a-47fc-9ae6-5ab39b5e3670 tempest-TestStampPattern-1029179603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.667s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:26:29 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-86602905-cb2a-47fc-9ae6-5ab39b5e3670 tempest-TestStampPattern-1029179603 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:26:29 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-86602905-cb2a-47fc-9ae6-5ab39b5e3670 tempest-TestStampPattern-1029179603 None] Deleted volume successfully.
Jul 03 01:26:29 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-86602905-cb2a-47fc-9ae6-5ab39b5e3670 tempest-TestStampPattern-1029179603 None] Lock "cinder-72fcc775-86d6-4428-aed3-840cbcea8de4-delete_volume" released by "delete_volume" :: held 2.442s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:26:29 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-17bff314-c0db-46d0-a72a-420f5c26e292 tempest-TestStampPattern-1029179603 None] Acquiring lock "cinder-955886d4-03ab-43a6-ab7c-051747ac9b71-delete_snapshot" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:26:29 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-17bff314-c0db-46d0-a72a-420f5c26e292 tempest-TestStampPattern-1029179603 None] Lock "cinder-955886d4-03ab-43a6-ab7c-051747ac9b71-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:26:29 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-17bff314-c0db-46d0-a72a-420f5c26e292 tempest-TestStampPattern-1029179603 None] Acquiring lock "cinder-quobyte-49fd2d61-10ca-4766-be98-84ae0ee76ccd" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:26:30 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-17bff314-c0db-46d0-a72a-420f5c26e292 tempest-TestStampPattern-1029179603 None] Lock "cinder-quobyte-49fd2d61-10ca-4766-be98-84ae0ee76ccd" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:26:30 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-17bff314-c0db-46d0-a72a-420f5c26e292 tempest-TestStampPattern-1029179603 None] Acquiring lock "cinder-quobyte-955886d4-03ab-43a6-ab7c-051747ac9b71" by "_delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:26:30 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-17bff314-c0db-46d0-a72a-420f5c26e292 tempest-TestStampPattern-1029179603 None] Lock "cinder-quobyte-955886d4-03ab-43a6-ab7c-051747ac9b71" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:26:30 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-17bff314-c0db-46d0-a72a-420f5c26e292 tempest-TestStampPattern-1029179603 None] Deleting offline snapshot 955886d4-03ab-43a6-ab7c-051747ac9b71 of volume 49fd2d61-10ca-4766-be98-84ae0ee76ccd {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 01:26:30 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-17bff314-c0db-46d0-a72a-420f5c26e292 tempest-TestStampPattern-1029179603 None] snapshot_file for this snap is: volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd.955886d4-03ab-43a6-ab7c-051747ac9b71 {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 01:26:30 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7ac6ab-41fe-4335-9813-786c88b5d41a]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:26:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-17bff314-c0db-46d0-a72a-420f5c26e292 tempest-TestStampPattern-1029179603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd.955886d4-03ab-43a6-ab7c-051747ac9b71 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:26:30 devstack sudo[105666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd.955886d4-03ab-43a6-ab7c-051747ac9b71
Jul 03 01:26:30 devstack sudo[105666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:26:30 devstack sudo[105666]: pam_unix(sudo:session): session closed for user root
Jul 03 01:26:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-17bff314-c0db-46d0-a72a-420f5c26e292 tempest-TestStampPattern-1029179603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd.955886d4-03ab-43a6-ab7c-051747ac9b71" returned: 0 in 0.739s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:26:30 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-17bff314-c0db-46d0-a72a-420f5c26e292 tempest-TestStampPattern-1029179603 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:26:30 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[1991e2e9-0473-4220-8019-aae3c90bc586]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:26:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-17bff314-c0db-46d0-a72a-420f5c26e292 tempest-TestStampPattern-1029179603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:26:30 devstack sudo[105671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd
Jul 03 01:26:30 devstack sudo[105671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:26:31 devstack sudo[105671]: pam_unix(sudo:session): session closed for user root
Jul 03 01:26:31 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-17bff314-c0db-46d0-a72a-420f5c26e292 tempest-TestStampPattern-1029179603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd" returned: 0 in 0.747s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:26:31 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-17bff314-c0db-46d0-a72a-420f5c26e292 tempest-TestStampPattern-1029179603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd.955886d4-03ab-43a6-ab7c-051747ac9b71 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:26:31 devstack sudo[105676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd.955886d4-03ab-43a6-ab7c-051747ac9b71
Jul 03 01:26:31 devstack sudo[105676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:26:32 devstack sudo[105676]: pam_unix(sudo:session): session closed for user root
Jul 03 01:26:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-17bff314-c0db-46d0-a72a-420f5c26e292 tempest-TestStampPattern-1029179603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd.955886d4-03ab-43a6-ab7c-051747ac9b71" returned: 0 in 0.697s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:26:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-17bff314-c0db-46d0-a72a-420f5c26e292 tempest-TestStampPattern-1029179603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd.955886d4-03ab-43a6-ab7c-051747ac9b71 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:26:32 devstack sudo[105681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd.955886d4-03ab-43a6-ab7c-051747ac9b71
Jul 03 01:26:32 devstack sudo[105681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:26:32 devstack sudo[105681]: pam_unix(sudo:session): session closed for user root
Jul 03 01:26:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-17bff314-c0db-46d0-a72a-420f5c26e292 tempest-TestStampPattern-1029179603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd.955886d4-03ab-43a6-ab7c-051747ac9b71" returned: 0 in 0.611s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:26:32 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-17bff314-c0db-46d0-a72a-420f5c26e292 tempest-TestStampPattern-1029179603 None] Lock "cinder-quobyte-955886d4-03ab-43a6-ab7c-051747ac9b71" released by "_delete_snapshot" :: held 2.888s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:26:32 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-17bff314-c0db-46d0-a72a-420f5c26e292 tempest-TestStampPattern-1029179603 None] Lock "cinder-quobyte-49fd2d61-10ca-4766-be98-84ae0ee76ccd" released by "delete_snapshot" :: held 2.909s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:26:32 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-17bff314-c0db-46d0-a72a-420f5c26e292 tempest-TestStampPattern-1029179603 None] Created reservations ['cb0ede47-3217-4444-a63b-5ada376caf20', '098d092f-7b3b-47bf-b7e4-443c16808add', 'c0019138-f79b-4d57-95bd-f97b1aaec1cb', 'bbb3e4b5-a21e-4743-b84a-d933eb05c745'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:26:33 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-17bff314-c0db-46d0-a72a-420f5c26e292 tempest-TestStampPattern-1029179603 None] Delete snapshot completed successfully.
Jul 03 01:26:33 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-17bff314-c0db-46d0-a72a-420f5c26e292 tempest-TestStampPattern-1029179603 None] Lock "cinder-955886d4-03ab-43a6-ab7c-051747ac9b71-delete_snapshot" released by "delete_snapshot" :: held 3.032s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:26:40 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-0a89f973-b78d-433d-b81b-5f08ac8bb79c tempest-TestStampPattern-1029179603 None] Acquiring lock "cinder-49fd2d61-10ca-4766-be98-84ae0ee76ccd-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:26:40 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-0a89f973-b78d-433d-b81b-5f08ac8bb79c tempest-TestStampPattern-1029179603 None] Lock "cinder-49fd2d61-10ca-4766-be98-84ae0ee76ccd-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:26:40 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-0a89f973-b78d-433d-b81b-5f08ac8bb79c tempest-TestStampPattern-1029179603 None] Acquiring lock "cinder-quobyte-49fd2d61-10ca-4766-be98-84ae0ee76ccd" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:26:40 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-0a89f973-b78d-433d-b81b-5f08ac8bb79c tempest-TestStampPattern-1029179603 None] Lock "cinder-quobyte-49fd2d61-10ca-4766-be98-84ae0ee76ccd" acquired by "delete_volume" :: waited 0.013s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:26:40 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[57538544-b634-454f-810b-58ccafa7262c]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:26:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0a89f973-b78d-433d-b81b-5f08ac8bb79c tempest-TestStampPattern-1029179603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:26:40 devstack sudo[105764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd
Jul 03 01:26:40 devstack sudo[105764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:26:41 devstack sudo[105764]: pam_unix(sudo:session): session closed for user root
Jul 03 01:26:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0a89f973-b78d-433d-b81b-5f08ac8bb79c tempest-TestStampPattern-1029179603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd" returned: 0 in 0.818s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:26:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0a89f973-b78d-433d-b81b-5f08ac8bb79c tempest-TestStampPattern-1029179603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:26:41 devstack sudo[105775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd
Jul 03 01:26:41 devstack sudo[105775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:26:41 devstack sudo[105775]: pam_unix(sudo:session): session closed for user root
Jul 03 01:26:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0a89f973-b78d-433d-b81b-5f08ac8bb79c tempest-TestStampPattern-1029179603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-49fd2d61-10ca-4766-be98-84ae0ee76ccd" returned: 0 in 0.647s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:26:41 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-0a89f973-b78d-433d-b81b-5f08ac8bb79c tempest-TestStampPattern-1029179603 None] Lock "cinder-quobyte-49fd2d61-10ca-4766-be98-84ae0ee76ccd" released by "delete_volume" :: held 1.519s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:26:41 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-0a89f973-b78d-433d-b81b-5f08ac8bb79c tempest-TestStampPattern-1029179603 None] Created reservations ['6c2ecbfb-7a31-4c2f-a303-d5d2587097dc', 'f1e7be76-f609-4bb3-aee7-41829712c544', '78b17ecf-ef3b-4802-94b9-89450df3075a', 'ccf72454-c1f8-427d-9a79-d6c606a17e6a'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:26:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-0a89f973-b78d-433d-b81b-5f08ac8bb79c tempest-TestStampPattern-1029179603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:26:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-0a89f973-b78d-433d-b81b-5f08ac8bb79c tempest-TestStampPattern-1029179603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:26:41 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-0a89f973-b78d-433d-b81b-5f08ac8bb79c tempest-TestStampPattern-1029179603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:26:41 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-0a89f973-b78d-433d-b81b-5f08ac8bb79c tempest-TestStampPattern-1029179603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:26:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-0a89f973-b78d-433d-b81b-5f08ac8bb79c tempest-TestStampPattern-1029179603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:26:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0a89f973-b78d-433d-b81b-5f08ac8bb79c tempest-TestStampPattern-1029179603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:26:41 devstack sudo[105778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:26:41 devstack sudo[105778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:26:42 devstack sudo[105778]: pam_unix(sudo:session): session closed for user root
Jul 03 01:26:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0a89f973-b78d-433d-b81b-5f08ac8bb79c tempest-TestStampPattern-1029179603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.683s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:26:42 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-0a89f973-b78d-433d-b81b-5f08ac8bb79c tempest-TestStampPattern-1029179603 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:26:42 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-0a89f973-b78d-433d-b81b-5f08ac8bb79c tempest-TestStampPattern-1029179603 None] Deleted volume successfully.
Jul 03 01:26:42 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-0a89f973-b78d-433d-b81b-5f08ac8bb79c tempest-TestStampPattern-1029179603 None] Lock "cinder-49fd2d61-10ca-4766-be98-84ae0ee76ccd-delete_volume" released by "delete_volume" :: held 2.376s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:26:51 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:SELECT=16,cinder:INSERT=6,cinder:UPDATE=23 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:26:52 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:SELECT=15,cinder:UPDATE=20,cinder:INSERT=6,cinder:DELETE=2 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:26:52 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-181d0f73-77e8-4987-8f33-770a04bdd364 tempest-CreateVolumesFromImageTest-392643813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:26:52 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-181d0f73-77e8-4987-8f33-770a04bdd364 tempest-CreateVolumesFromImageTest-392643813 None] Flow 'volume_create_manager' (1a6195df-3195-4746-bbcc-3407afa67e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:26:52 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-181d0f73-77e8-4987-8f33-770a04bdd364 tempest-CreateVolumesFromImageTest-392643813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21bf53f6-7283-4d32-a88b-424e0c39e47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:26:52 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-181d0f73-77e8-4987-8f33-770a04bdd364 tempest-CreateVolumesFromImageTest-392643813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21bf53f6-7283-4d32-a88b-424e0c39e47a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:26:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1307585032',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6180e92-1f29-4169-a264-80d52a83601f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9f80f0f15304d8bb668859fa7c6e183',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:26:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:26:53Z,use_quota=True,user_id='3545dd85753f409a86a31e7ab7f0fcf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:26:52 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-181d0f73-77e8-4987-8f33-770a04bdd364 tempest-CreateVolumesFromImageTest-392643813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76260e27-9baf-4eea-876d-5072b2c6025c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:26:52 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-181d0f73-77e8-4987-8f33-770a04bdd364 tempest-CreateVolumesFromImageTest-392643813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76260e27-9baf-4eea-876d-5072b2c6025c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:26:52 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-181d0f73-77e8-4987-8f33-770a04bdd364 tempest-CreateVolumesFromImageTest-392643813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (530be160-1910-42c1-b4d1-0a2fcd6342cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:26:52 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-181d0f73-77e8-4987-8f33-770a04bdd364 tempest-CreateVolumesFromImageTest-392643813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (530be160-1910-42c1-b4d1-0a2fcd6342cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6180e92-1f29-4169-a264-80d52a83601f', 'volume_name': 'volume-d6180e92-1f29-4169-a264-80d52a83601f', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:26:52 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-181d0f73-77e8-4987-8f33-770a04bdd364 tempest-CreateVolumesFromImageTest-392643813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2df132c0-02fc-4f3f-9076-0def994411ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:26:52 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-181d0f73-77e8-4987-8f33-770a04bdd364 tempest-CreateVolumesFromImageTest-392643813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2df132c0-02fc-4f3f-9076-0def994411ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:26:52 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-181d0f73-77e8-4987-8f33-770a04bdd364 tempest-CreateVolumesFromImageTest-392643813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddba21a3-47c8-4d0d-934b-0f38f7c285b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:26:52 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-181d0f73-77e8-4987-8f33-770a04bdd364 tempest-CreateVolumesFromImageTest-392643813 None] Volume d6180e92-1f29-4169-a264-80d52a83601f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6180e92-1f29-4169-a264-80d52a83601f', 'volume_size': 1}
Jul 03 01:26:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-181d0f73-77e8-4987-8f33-770a04bdd364 tempest-CreateVolumesFromImageTest-392643813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:26:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-181d0f73-77e8-4987-8f33-770a04bdd364 tempest-CreateVolumesFromImageTest-392643813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:26:52 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-181d0f73-77e8-4987-8f33-770a04bdd364 tempest-CreateVolumesFromImageTest-392643813 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:26:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1307585032',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6180e92-1f29-4169-a264-80d52a83601f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9f80f0f15304d8bb668859fa7c6e183',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:26:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:26:53Z,use_quota=True,user_id='3545dd85753f409a86a31e7ab7f0fcf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:26:52 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-181d0f73-77e8-4987-8f33-770a04bdd364 tempest-CreateVolumesFromImageTest-392643813 None] Creating volume d6180e92-1f29-4169-a264-80d52a83601f {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:26:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-181d0f73-77e8-4987-8f33-770a04bdd364 tempest-CreateVolumesFromImageTest-392643813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:26:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-181d0f73-77e8-4987-8f33-770a04bdd364 tempest-CreateVolumesFromImageTest-392643813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:26:52 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-181d0f73-77e8-4987-8f33-770a04bdd364 tempest-CreateVolumesFromImageTest-392643813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:26:52 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-181d0f73-77e8-4987-8f33-770a04bdd364 tempest-CreateVolumesFromImageTest-392643813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:26:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-181d0f73-77e8-4987-8f33-770a04bdd364 tempest-CreateVolumesFromImageTest-392643813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:26:52 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-181d0f73-77e8-4987-8f33-770a04bdd364 tempest-CreateVolumesFromImageTest-392643813 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:26:52 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-181d0f73-77e8-4987-8f33-770a04bdd364 tempest-CreateVolumesFromImageTest-392643813 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:26:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-181d0f73-77e8-4987-8f33-770a04bdd364 tempest-CreateVolumesFromImageTest-392643813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d6180e92-1f29-4169-a264-80d52a83601f 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:26:52 devstack sudo[105786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d6180e92-1f29-4169-a264-80d52a83601f 1073741824
Jul 03 01:26:52 devstack sudo[105786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:26:53 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-139af297-1593-47cf-9bf5-c4e6f428adc7 tempest-CreateVolumesFromImageTest-392643813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:26:53 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-139af297-1593-47cf-9bf5-c4e6f428adc7 tempest-CreateVolumesFromImageTest-392643813 None] Flow 'volume_create_manager' (37e8cd20-69c2-4d72-af09-de4b2a3cbb81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:26:53 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-139af297-1593-47cf-9bf5-c4e6f428adc7 tempest-CreateVolumesFromImageTest-392643813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5bb10df-e79d-4bd7-b211-0bc73cf06ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:26:53 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-139af297-1593-47cf-9bf5-c4e6f428adc7 tempest-CreateVolumesFromImageTest-392643813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5bb10df-e79d-4bd7-b211-0bc73cf06ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:26:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-852140226',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1144d13f-966b-4bc4-9238-8045631fdcac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9f80f0f15304d8bb668859fa7c6e183',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:26:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:26:53Z,use_quota=True,user_id='3545dd85753f409a86a31e7ab7f0fcf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:26:53 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-139af297-1593-47cf-9bf5-c4e6f428adc7 tempest-CreateVolumesFromImageTest-392643813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f697feb0-173b-4ec2-9b90-92e04bbc0d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:26:53 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-139af297-1593-47cf-9bf5-c4e6f428adc7 tempest-CreateVolumesFromImageTest-392643813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f697feb0-173b-4ec2-9b90-92e04bbc0d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:26:53 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-139af297-1593-47cf-9bf5-c4e6f428adc7 tempest-CreateVolumesFromImageTest-392643813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58504cd4-922c-4db9-b0d1-8441b777ee47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:26:53 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-139af297-1593-47cf-9bf5-c4e6f428adc7 tempest-CreateVolumesFromImageTest-392643813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58504cd4-922c-4db9-b0d1-8441b777ee47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1144d13f-966b-4bc4-9238-8045631fdcac', 'volume_name': 'volume-1144d13f-966b-4bc4-9238-8045631fdcac', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:26:53 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-139af297-1593-47cf-9bf5-c4e6f428adc7 tempest-CreateVolumesFromImageTest-392643813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55f9434e-36ab-4147-a5ad-5380217fdeac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:26:53 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-139af297-1593-47cf-9bf5-c4e6f428adc7 tempest-CreateVolumesFromImageTest-392643813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55f9434e-36ab-4147-a5ad-5380217fdeac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:26:53 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-139af297-1593-47cf-9bf5-c4e6f428adc7 tempest-CreateVolumesFromImageTest-392643813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89ae9095-f48a-4afc-a160-a0afe0858ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:26:53 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-139af297-1593-47cf-9bf5-c4e6f428adc7 tempest-CreateVolumesFromImageTest-392643813 None] Volume 1144d13f-966b-4bc4-9238-8045631fdcac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1144d13f-966b-4bc4-9238-8045631fdcac', 'volume_size': 1}
Jul 03 01:26:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-139af297-1593-47cf-9bf5-c4e6f428adc7 tempest-CreateVolumesFromImageTest-392643813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:26:53 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-94db0053-0a7f-4b5b-b5f8-ccee7b0716a6 tempest-CreateVolumesFromImageTest-392643813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:26:53 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-94db0053-0a7f-4b5b-b5f8-ccee7b0716a6 tempest-CreateVolumesFromImageTest-392643813 None] Flow 'volume_create_manager' (250fc3f5-8474-4e93-bd28-1e9906b3fcb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:26:53 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-94db0053-0a7f-4b5b-b5f8-ccee7b0716a6 tempest-CreateVolumesFromImageTest-392643813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (824efa78-1dd6-48b4-8285-be3294be88f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:26:53 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-94db0053-0a7f-4b5b-b5f8-ccee7b0716a6 tempest-CreateVolumesFromImageTest-392643813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (824efa78-1dd6-48b4-8285-be3294be88f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:26:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-383114656',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac19ff70-ff86-4c1f-99c8-d0c978a532f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9f80f0f15304d8bb668859fa7c6e183',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:26:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:26:53Z,use_quota=True,user_id='3545dd85753f409a86a31e7ab7f0fcf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:26:53 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-94db0053-0a7f-4b5b-b5f8-ccee7b0716a6 tempest-CreateVolumesFromImageTest-392643813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82c172e1-8783-4dc9-a601-9406a2a339ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:26:53 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-94db0053-0a7f-4b5b-b5f8-ccee7b0716a6 tempest-CreateVolumesFromImageTest-392643813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82c172e1-8783-4dc9-a601-9406a2a339ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:26:53 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-94db0053-0a7f-4b5b-b5f8-ccee7b0716a6 tempest-CreateVolumesFromImageTest-392643813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f67f6ae-4b9f-48ef-a9ef-329540d0bf2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:26:53 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-94db0053-0a7f-4b5b-b5f8-ccee7b0716a6 tempest-CreateVolumesFromImageTest-392643813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f67f6ae-4b9f-48ef-a9ef-329540d0bf2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac19ff70-ff86-4c1f-99c8-d0c978a532f9', 'volume_name': 'volume-ac19ff70-ff86-4c1f-99c8-d0c978a532f9', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:26:53 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-94db0053-0a7f-4b5b-b5f8-ccee7b0716a6 tempest-CreateVolumesFromImageTest-392643813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67ebcfe4-ecba-4811-b287-4e4a5a50ec02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:26:53 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-94db0053-0a7f-4b5b-b5f8-ccee7b0716a6 tempest-CreateVolumesFromImageTest-392643813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67ebcfe4-ecba-4811-b287-4e4a5a50ec02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:26:53 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-94db0053-0a7f-4b5b-b5f8-ccee7b0716a6 tempest-CreateVolumesFromImageTest-392643813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4366561-d53b-4ef3-b3d6-3bb4840e2541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:26:53 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-94db0053-0a7f-4b5b-b5f8-ccee7b0716a6 tempest-CreateVolumesFromImageTest-392643813 None] Volume ac19ff70-ff86-4c1f-99c8-d0c978a532f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac19ff70-ff86-4c1f-99c8-d0c978a532f9', 'volume_size': 1}
Jul 03 01:26:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-94db0053-0a7f-4b5b-b5f8-ccee7b0716a6 tempest-CreateVolumesFromImageTest-392643813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:26:53 devstack sudo[105786]: pam_unix(sudo:session): session closed for user root
Jul 03 01:26:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-181d0f73-77e8-4987-8f33-770a04bdd364 tempest-CreateVolumesFromImageTest-392643813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d6180e92-1f29-4169-a264-80d52a83601f 1073741824" returned: 0 in 0.919s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:26:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-181d0f73-77e8-4987-8f33-770a04bdd364 tempest-CreateVolumesFromImageTest-392643813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d6180e92-1f29-4169-a264-80d52a83601f {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:26:53 devstack sudo[105792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d6180e92-1f29-4169-a264-80d52a83601f
Jul 03 01:26:53 devstack sudo[105792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:26:53 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ab4553d-d651-4b47-9934-4ec7c1fc8e37 tempest-CreateVolumesFromImageTest-392643813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:26:53 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-0ab4553d-d651-4b47-9934-4ec7c1fc8e37 tempest-CreateVolumesFromImageTest-392643813 None] Flow 'volume_create_manager' (8d58ffd6-5541-4150-bc83-fd75fd1f3db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:26:53 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-0ab4553d-d651-4b47-9934-4ec7c1fc8e37 tempest-CreateVolumesFromImageTest-392643813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed56d7e9-dd7f-442b-88df-02e7216a2c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:26:53 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-0ab4553d-d651-4b47-9934-4ec7c1fc8e37 tempest-CreateVolumesFromImageTest-392643813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed56d7e9-dd7f-442b-88df-02e7216a2c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:26:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-404743180',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cca2d051-52d1-4559-8b25-698c8230f86f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9f80f0f15304d8bb668859fa7c6e183',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:26:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:26:54Z,use_quota=True,user_id='3545dd85753f409a86a31e7ab7f0fcf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:26:53 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-0ab4553d-d651-4b47-9934-4ec7c1fc8e37 tempest-CreateVolumesFromImageTest-392643813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b651ee7-46e8-4e73-ad0b-4599217cca46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:26:53 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-0ab4553d-d651-4b47-9934-4ec7c1fc8e37 tempest-CreateVolumesFromImageTest-392643813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b651ee7-46e8-4e73-ad0b-4599217cca46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:26:53 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-0ab4553d-d651-4b47-9934-4ec7c1fc8e37 tempest-CreateVolumesFromImageTest-392643813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e8130ac-3a1f-4217-a3ab-c5c1d922a2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:26:53 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-0ab4553d-d651-4b47-9934-4ec7c1fc8e37 tempest-CreateVolumesFromImageTest-392643813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e8130ac-3a1f-4217-a3ab-c5c1d922a2c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cca2d051-52d1-4559-8b25-698c8230f86f', 'volume_name': 'volume-cca2d051-52d1-4559-8b25-698c8230f86f', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:26:53 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-0ab4553d-d651-4b47-9934-4ec7c1fc8e37 tempest-CreateVolumesFromImageTest-392643813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04a24834-adba-47da-9a50-e285c75058e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:26:53 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-0ab4553d-d651-4b47-9934-4ec7c1fc8e37 tempest-CreateVolumesFromImageTest-392643813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04a24834-adba-47da-9a50-e285c75058e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:26:53 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-0ab4553d-d651-4b47-9934-4ec7c1fc8e37 tempest-CreateVolumesFromImageTest-392643813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fed76fef-238e-43e3-ab85-8a79468f0310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:26:53 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-0ab4553d-d651-4b47-9934-4ec7c1fc8e37 tempest-CreateVolumesFromImageTest-392643813 None] Volume cca2d051-52d1-4559-8b25-698c8230f86f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cca2d051-52d1-4559-8b25-698c8230f86f', 'volume_size': 1}
Jul 03 01:26:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-0ab4553d-d651-4b47-9934-4ec7c1fc8e37 tempest-CreateVolumesFromImageTest-392643813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:26:54 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-464a5ddd-81c1-4ec2-a334-a2967ab17de8 tempest-CreateVolumesFromImageTest-392643813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:26:54 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-464a5ddd-81c1-4ec2-a334-a2967ab17de8 tempest-CreateVolumesFromImageTest-392643813 None] Flow 'volume_create_manager' (f9c4200d-7faa-46a4-8582-4abf2768dc11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:26:54 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-464a5ddd-81c1-4ec2-a334-a2967ab17de8 tempest-CreateVolumesFromImageTest-392643813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1b5f727-543f-42eb-ba86-9effd647b046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:26:54 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-464a5ddd-81c1-4ec2-a334-a2967ab17de8 tempest-CreateVolumesFromImageTest-392643813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1b5f727-543f-42eb-ba86-9effd647b046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:26:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1463847502',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99090f1c-1a07-493f-9047-8410169d9275,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9f80f0f15304d8bb668859fa7c6e183',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:26:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:26:54Z,use_quota=True,user_id='3545dd85753f409a86a31e7ab7f0fcf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:26:54 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-464a5ddd-81c1-4ec2-a334-a2967ab17de8 tempest-CreateVolumesFromImageTest-392643813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4362a1e8-4b80-4f97-b9d9-20ed383fb1a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:26:54 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-464a5ddd-81c1-4ec2-a334-a2967ab17de8 tempest-CreateVolumesFromImageTest-392643813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4362a1e8-4b80-4f97-b9d9-20ed383fb1a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:26:54 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-464a5ddd-81c1-4ec2-a334-a2967ab17de8 tempest-CreateVolumesFromImageTest-392643813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f62ca40c-9e21-4a24-8652-7d1e4a35c35a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:26:54 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-464a5ddd-81c1-4ec2-a334-a2967ab17de8 tempest-CreateVolumesFromImageTest-392643813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f62ca40c-9e21-4a24-8652-7d1e4a35c35a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99090f1c-1a07-493f-9047-8410169d9275', 'volume_name': 'volume-99090f1c-1a07-493f-9047-8410169d9275', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:26:54 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-464a5ddd-81c1-4ec2-a334-a2967ab17de8 tempest-CreateVolumesFromImageTest-392643813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3893a81-9379-4d8c-9917-df12488b378d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:26:54 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-464a5ddd-81c1-4ec2-a334-a2967ab17de8 tempest-CreateVolumesFromImageTest-392643813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3893a81-9379-4d8c-9917-df12488b378d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:26:54 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-464a5ddd-81c1-4ec2-a334-a2967ab17de8 tempest-CreateVolumesFromImageTest-392643813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17615102-9bb5-4223-af3f-b51e8007cb2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:26:54 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-464a5ddd-81c1-4ec2-a334-a2967ab17de8 tempest-CreateVolumesFromImageTest-392643813 None] Volume 99090f1c-1a07-493f-9047-8410169d9275: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99090f1c-1a07-493f-9047-8410169d9275', 'volume_size': 1}
Jul 03 01:26:54 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-464a5ddd-81c1-4ec2-a334-a2967ab17de8 tempest-CreateVolumesFromImageTest-392643813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:26:54 devstack sudo[105792]: pam_unix(sudo:session): session closed for user root
Jul 03 01:26:54 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-181d0f73-77e8-4987-8f33-770a04bdd364 tempest-CreateVolumesFromImageTest-392643813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d6180e92-1f29-4169-a264-80d52a83601f" returned: 0 in 0.654s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:26:54 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-181d0f73-77e8-4987-8f33-770a04bdd364 tempest-CreateVolumesFromImageTest-392643813 None] <== create_volume: return (1629ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:26:54 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-181d0f73-77e8-4987-8f33-770a04bdd364 tempest-CreateVolumesFromImageTest-392643813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.631s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:26:54 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-139af297-1593-47cf-9bf5-c4e6f428adc7 tempest-CreateVolumesFromImageTest-392643813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.270s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:26:54 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-139af297-1593-47cf-9bf5-c4e6f428adc7 tempest-CreateVolumesFromImageTest-392643813 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:26:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-852140226',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1144d13f-966b-4bc4-9238-8045631fdcac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9f80f0f15304d8bb668859fa7c6e183',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:26:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:26:53Z,use_quota=True,user_id='3545dd85753f409a86a31e7ab7f0fcf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:26:54 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-139af297-1593-47cf-9bf5-c4e6f428adc7 tempest-CreateVolumesFromImageTest-392643813 None] Creating volume 1144d13f-966b-4bc4-9238-8045631fdcac {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:26:54 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-139af297-1593-47cf-9bf5-c4e6f428adc7 tempest-CreateVolumesFromImageTest-392643813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:26:54 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-139af297-1593-47cf-9bf5-c4e6f428adc7 tempest-CreateVolumesFromImageTest-392643813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:26:54 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-139af297-1593-47cf-9bf5-c4e6f428adc7 tempest-CreateVolumesFromImageTest-392643813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:26:54 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-139af297-1593-47cf-9bf5-c4e6f428adc7 tempest-CreateVolumesFromImageTest-392643813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:26:54 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-139af297-1593-47cf-9bf5-c4e6f428adc7 tempest-CreateVolumesFromImageTest-392643813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:26:54 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-139af297-1593-47cf-9bf5-c4e6f428adc7 tempest-CreateVolumesFromImageTest-392643813 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:26:54 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-139af297-1593-47cf-9bf5-c4e6f428adc7 tempest-CreateVolumesFromImageTest-392643813 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:26:54 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-139af297-1593-47cf-9bf5-c4e6f428adc7 tempest-CreateVolumesFromImageTest-392643813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1144d13f-966b-4bc4-9238-8045631fdcac 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:26:54 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-181d0f73-77e8-4987-8f33-770a04bdd364 tempest-CreateVolumesFromImageTest-392643813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddba21a3-47c8-4d0d-934b-0f38f7c285b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6180e92-1f29-4169-a264-80d52a83601f', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:26:54 devstack sudo[105795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1144d13f-966b-4bc4-9238-8045631fdcac 1073741824
Jul 03 01:26:54 devstack sudo[105795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:26:54 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-181d0f73-77e8-4987-8f33-770a04bdd364 tempest-CreateVolumesFromImageTest-392643813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09d5c227-b9f5-4cdd-a1a9-8ac1925e3722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:26:54 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-181d0f73-77e8-4987-8f33-770a04bdd364 tempest-CreateVolumesFromImageTest-392643813 None] Volume volume-d6180e92-1f29-4169-a264-80d52a83601f (d6180e92-1f29-4169-a264-80d52a83601f): created successfully
Jul 03 01:26:54 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-181d0f73-77e8-4987-8f33-770a04bdd364 tempest-CreateVolumesFromImageTest-392643813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09d5c227-b9f5-4cdd-a1a9-8ac1925e3722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:26:54 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-181d0f73-77e8-4987-8f33-770a04bdd364 tempest-CreateVolumesFromImageTest-392643813 None] Flow 'volume_create_manager' (1a6195df-3195-4746-bbcc-3407afa67e21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:26:54 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-181d0f73-77e8-4987-8f33-770a04bdd364 tempest-CreateVolumesFromImageTest-392643813 None] Created volume successfully.
Jul 03 01:26:55 devstack sudo[105795]: pam_unix(sudo:session): session closed for user root
Jul 03 01:26:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-139af297-1593-47cf-9bf5-c4e6f428adc7 tempest-CreateVolumesFromImageTest-392643813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1144d13f-966b-4bc4-9238-8045631fdcac 1073741824" returned: 0 in 0.809s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:26:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-139af297-1593-47cf-9bf5-c4e6f428adc7 tempest-CreateVolumesFromImageTest-392643813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1144d13f-966b-4bc4-9238-8045631fdcac {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:26:55 devstack sudo[105801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1144d13f-966b-4bc4-9238-8045631fdcac
Jul 03 01:26:55 devstack sudo[105801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:26:56 devstack sudo[105801]: pam_unix(sudo:session): session closed for user root
Jul 03 01:26:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-139af297-1593-47cf-9bf5-c4e6f428adc7 tempest-CreateVolumesFromImageTest-392643813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1144d13f-966b-4bc4-9238-8045631fdcac" returned: 0 in 0.687s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:26:56 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-139af297-1593-47cf-9bf5-c4e6f428adc7 tempest-CreateVolumesFromImageTest-392643813 None] <== create_volume: return (1534ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:26:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-139af297-1593-47cf-9bf5-c4e6f428adc7 tempest-CreateVolumesFromImageTest-392643813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.537s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:26:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-94db0053-0a7f-4b5b-b5f8-ccee7b0716a6 tempest-CreateVolumesFromImageTest-392643813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.436s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:26:56 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-94db0053-0a7f-4b5b-b5f8-ccee7b0716a6 tempest-CreateVolumesFromImageTest-392643813 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:26:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-383114656',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac19ff70-ff86-4c1f-99c8-d0c978a532f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9f80f0f15304d8bb668859fa7c6e183',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:26:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:26:53Z,use_quota=True,user_id='3545dd85753f409a86a31e7ab7f0fcf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:26:56 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-94db0053-0a7f-4b5b-b5f8-ccee7b0716a6 tempest-CreateVolumesFromImageTest-392643813 None] Creating volume ac19ff70-ff86-4c1f-99c8-d0c978a532f9 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:26:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-94db0053-0a7f-4b5b-b5f8-ccee7b0716a6 tempest-CreateVolumesFromImageTest-392643813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:26:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-94db0053-0a7f-4b5b-b5f8-ccee7b0716a6 tempest-CreateVolumesFromImageTest-392643813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:26:56 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-94db0053-0a7f-4b5b-b5f8-ccee7b0716a6 tempest-CreateVolumesFromImageTest-392643813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:26:56 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-94db0053-0a7f-4b5b-b5f8-ccee7b0716a6 tempest-CreateVolumesFromImageTest-392643813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:26:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-94db0053-0a7f-4b5b-b5f8-ccee7b0716a6 tempest-CreateVolumesFromImageTest-392643813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:26:56 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-94db0053-0a7f-4b5b-b5f8-ccee7b0716a6 tempest-CreateVolumesFromImageTest-392643813 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:26:56 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-94db0053-0a7f-4b5b-b5f8-ccee7b0716a6 tempest-CreateVolumesFromImageTest-392643813 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:26:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-94db0053-0a7f-4b5b-b5f8-ccee7b0716a6 tempest-CreateVolumesFromImageTest-392643813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ac19ff70-ff86-4c1f-99c8-d0c978a532f9 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:26:56 devstack sudo[105804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ac19ff70-ff86-4c1f-99c8-d0c978a532f9 1073741824
Jul 03 01:26:56 devstack sudo[105804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:26:56 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-139af297-1593-47cf-9bf5-c4e6f428adc7 tempest-CreateVolumesFromImageTest-392643813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89ae9095-f48a-4afc-a160-a0afe0858ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1144d13f-966b-4bc4-9238-8045631fdcac', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:26:56 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-139af297-1593-47cf-9bf5-c4e6f428adc7 tempest-CreateVolumesFromImageTest-392643813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c88f3e7-c685-4d86-81d8-801c9b73d7f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:26:56 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-139af297-1593-47cf-9bf5-c4e6f428adc7 tempest-CreateVolumesFromImageTest-392643813 None] Volume volume-1144d13f-966b-4bc4-9238-8045631fdcac (1144d13f-966b-4bc4-9238-8045631fdcac): created successfully
Jul 03 01:26:56 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-139af297-1593-47cf-9bf5-c4e6f428adc7 tempest-CreateVolumesFromImageTest-392643813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c88f3e7-c685-4d86-81d8-801c9b73d7f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:26:56 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-139af297-1593-47cf-9bf5-c4e6f428adc7 tempest-CreateVolumesFromImageTest-392643813 None] Flow 'volume_create_manager' (37e8cd20-69c2-4d72-af09-de4b2a3cbb81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:26:56 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-139af297-1593-47cf-9bf5-c4e6f428adc7 tempest-CreateVolumesFromImageTest-392643813 None] Created volume successfully.
Jul 03 01:26:56 devstack sudo[105804]: pam_unix(sudo:session): session closed for user root
Jul 03 01:26:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-94db0053-0a7f-4b5b-b5f8-ccee7b0716a6 tempest-CreateVolumesFromImageTest-392643813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ac19ff70-ff86-4c1f-99c8-d0c978a532f9 1073741824" returned: 0 in 0.796s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:26:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-94db0053-0a7f-4b5b-b5f8-ccee7b0716a6 tempest-CreateVolumesFromImageTest-392643813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ac19ff70-ff86-4c1f-99c8-d0c978a532f9 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:26:56 devstack sudo[105809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ac19ff70-ff86-4c1f-99c8-d0c978a532f9
Jul 03 01:26:56 devstack sudo[105809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:26:57 devstack sudo[105809]: pam_unix(sudo:session): session closed for user root
Jul 03 01:26:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-94db0053-0a7f-4b5b-b5f8-ccee7b0716a6 tempest-CreateVolumesFromImageTest-392643813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ac19ff70-ff86-4c1f-99c8-d0c978a532f9" returned: 0 in 0.650s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:26:57 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-94db0053-0a7f-4b5b-b5f8-ccee7b0716a6 tempest-CreateVolumesFromImageTest-392643813 None] <== create_volume: return (1482ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:26:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-94db0053-0a7f-4b5b-b5f8-ccee7b0716a6 tempest-CreateVolumesFromImageTest-392643813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.485s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:26:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-0ab4553d-d651-4b47-9934-4ec7c1fc8e37 tempest-CreateVolumesFromImageTest-392643813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.564s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:26:57 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-0ab4553d-d651-4b47-9934-4ec7c1fc8e37 tempest-CreateVolumesFromImageTest-392643813 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:26:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-404743180',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cca2d051-52d1-4559-8b25-698c8230f86f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9f80f0f15304d8bb668859fa7c6e183',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:26:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:26:54Z,use_quota=True,user_id='3545dd85753f409a86a31e7ab7f0fcf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:26:57 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-0ab4553d-d651-4b47-9934-4ec7c1fc8e37 tempest-CreateVolumesFromImageTest-392643813 None] Creating volume cca2d051-52d1-4559-8b25-698c8230f86f {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:26:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-0ab4553d-d651-4b47-9934-4ec7c1fc8e37 tempest-CreateVolumesFromImageTest-392643813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:26:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-0ab4553d-d651-4b47-9934-4ec7c1fc8e37 tempest-CreateVolumesFromImageTest-392643813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:26:57 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-0ab4553d-d651-4b47-9934-4ec7c1fc8e37 tempest-CreateVolumesFromImageTest-392643813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:26:57 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-0ab4553d-d651-4b47-9934-4ec7c1fc8e37 tempest-CreateVolumesFromImageTest-392643813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:26:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-0ab4553d-d651-4b47-9934-4ec7c1fc8e37 tempest-CreateVolumesFromImageTest-392643813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:26:57 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-0ab4553d-d651-4b47-9934-4ec7c1fc8e37 tempest-CreateVolumesFromImageTest-392643813 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:26:57 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-0ab4553d-d651-4b47-9934-4ec7c1fc8e37 tempest-CreateVolumesFromImageTest-392643813 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:26:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0ab4553d-d651-4b47-9934-4ec7c1fc8e37 tempest-CreateVolumesFromImageTest-392643813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cca2d051-52d1-4559-8b25-698c8230f86f 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:26:57 devstack sudo[105812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cca2d051-52d1-4559-8b25-698c8230f86f 1073741824
Jul 03 01:26:57 devstack sudo[105812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:26:57 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-94db0053-0a7f-4b5b-b5f8-ccee7b0716a6 tempest-CreateVolumesFromImageTest-392643813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4366561-d53b-4ef3-b3d6-3bb4840e2541) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac19ff70-ff86-4c1f-99c8-d0c978a532f9', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:26:57 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-94db0053-0a7f-4b5b-b5f8-ccee7b0716a6 tempest-CreateVolumesFromImageTest-392643813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af814cae-5aba-4f9a-82ed-2b549c44fe26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:26:57 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-94db0053-0a7f-4b5b-b5f8-ccee7b0716a6 tempest-CreateVolumesFromImageTest-392643813 None] Volume volume-ac19ff70-ff86-4c1f-99c8-d0c978a532f9 (ac19ff70-ff86-4c1f-99c8-d0c978a532f9): created successfully
Jul 03 01:26:57 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-94db0053-0a7f-4b5b-b5f8-ccee7b0716a6 tempest-CreateVolumesFromImageTest-392643813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af814cae-5aba-4f9a-82ed-2b549c44fe26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:26:57 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-94db0053-0a7f-4b5b-b5f8-ccee7b0716a6 tempest-CreateVolumesFromImageTest-392643813 None] Flow 'volume_create_manager' (250fc3f5-8474-4e93-bd28-1e9906b3fcb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:26:57 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-94db0053-0a7f-4b5b-b5f8-ccee7b0716a6 tempest-CreateVolumesFromImageTest-392643813 None] Created volume successfully.
Jul 03 01:26:58 devstack sudo[105812]: pam_unix(sudo:session): session closed for user root
Jul 03 01:26:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0ab4553d-d651-4b47-9934-4ec7c1fc8e37 tempest-CreateVolumesFromImageTest-392643813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cca2d051-52d1-4559-8b25-698c8230f86f 1073741824" returned: 0 in 0.797s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:26:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0ab4553d-d651-4b47-9934-4ec7c1fc8e37 tempest-CreateVolumesFromImageTest-392643813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cca2d051-52d1-4559-8b25-698c8230f86f {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:26:58 devstack sudo[105818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cca2d051-52d1-4559-8b25-698c8230f86f
Jul 03 01:26:58 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:26:59 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root
Jul 03 01:26:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0ab4553d-d651-4b47-9934-4ec7c1fc8e37 tempest-CreateVolumesFromImageTest-392643813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cca2d051-52d1-4559-8b25-698c8230f86f" returned: 0 in 0.714s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:26:59 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-0ab4553d-d651-4b47-9934-4ec7c1fc8e37 tempest-CreateVolumesFromImageTest-392643813 None] <== create_volume: return (1552ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:26:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-0ab4553d-d651-4b47-9934-4ec7c1fc8e37 tempest-CreateVolumesFromImageTest-392643813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.556s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:26:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-464a5ddd-81c1-4ec2-a334-a2967ab17de8 tempest-CreateVolumesFromImageTest-392643813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.764s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:26:59 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-464a5ddd-81c1-4ec2-a334-a2967ab17de8 tempest-CreateVolumesFromImageTest-392643813 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:26:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1463847502',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99090f1c-1a07-493f-9047-8410169d9275,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9f80f0f15304d8bb668859fa7c6e183',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:26:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:26:54Z,use_quota=True,user_id='3545dd85753f409a86a31e7ab7f0fcf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:26:59 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-464a5ddd-81c1-4ec2-a334-a2967ab17de8 tempest-CreateVolumesFromImageTest-392643813 None] Creating volume 99090f1c-1a07-493f-9047-8410169d9275 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:26:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-464a5ddd-81c1-4ec2-a334-a2967ab17de8 tempest-CreateVolumesFromImageTest-392643813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:26:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-464a5ddd-81c1-4ec2-a334-a2967ab17de8 tempest-CreateVolumesFromImageTest-392643813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:26:59 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-464a5ddd-81c1-4ec2-a334-a2967ab17de8 tempest-CreateVolumesFromImageTest-392643813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:26:59 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-464a5ddd-81c1-4ec2-a334-a2967ab17de8 tempest-CreateVolumesFromImageTest-392643813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:26:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-464a5ddd-81c1-4ec2-a334-a2967ab17de8 tempest-CreateVolumesFromImageTest-392643813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:26:59 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-464a5ddd-81c1-4ec2-a334-a2967ab17de8 tempest-CreateVolumesFromImageTest-392643813 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:26:59 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-464a5ddd-81c1-4ec2-a334-a2967ab17de8 tempest-CreateVolumesFromImageTest-392643813 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:26:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-464a5ddd-81c1-4ec2-a334-a2967ab17de8 tempest-CreateVolumesFromImageTest-392643813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-99090f1c-1a07-493f-9047-8410169d9275 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:26:59 devstack sudo[105822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-99090f1c-1a07-493f-9047-8410169d9275 1073741824
Jul 03 01:26:59 devstack sudo[105822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:26:59 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-0ab4553d-d651-4b47-9934-4ec7c1fc8e37 tempest-CreateVolumesFromImageTest-392643813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fed76fef-238e-43e3-ab85-8a79468f0310) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cca2d051-52d1-4559-8b25-698c8230f86f', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:26:59 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-0ab4553d-d651-4b47-9934-4ec7c1fc8e37 tempest-CreateVolumesFromImageTest-392643813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e364ea63-47e5-4f07-b9e5-0ca1b5e34000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:26:59 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-0ab4553d-d651-4b47-9934-4ec7c1fc8e37 tempest-CreateVolumesFromImageTest-392643813 None] Volume volume-cca2d051-52d1-4559-8b25-698c8230f86f (cca2d051-52d1-4559-8b25-698c8230f86f): created successfully
Jul 03 01:26:59 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-0ab4553d-d651-4b47-9934-4ec7c1fc8e37 tempest-CreateVolumesFromImageTest-392643813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e364ea63-47e5-4f07-b9e5-0ca1b5e34000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:26:59 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-0ab4553d-d651-4b47-9934-4ec7c1fc8e37 tempest-CreateVolumesFromImageTest-392643813 None] Flow 'volume_create_manager' (8d58ffd6-5541-4150-bc83-fd75fd1f3db8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:26:59 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-0ab4553d-d651-4b47-9934-4ec7c1fc8e37 tempest-CreateVolumesFromImageTest-392643813 None] Created volume successfully.
Jul 03 01:26:59 devstack sudo[105822]: pam_unix(sudo:session): session closed for user root
Jul 03 01:26:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-464a5ddd-81c1-4ec2-a334-a2967ab17de8 tempest-CreateVolumesFromImageTest-392643813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-99090f1c-1a07-493f-9047-8410169d9275 1073741824" returned: 0 in 0.829s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:26:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-464a5ddd-81c1-4ec2-a334-a2967ab17de8 tempest-CreateVolumesFromImageTest-392643813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-99090f1c-1a07-493f-9047-8410169d9275 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:26:59 devstack sudo[105828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-99090f1c-1a07-493f-9047-8410169d9275
Jul 03 01:26:59 devstack sudo[105828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:27:00 devstack sudo[105828]: pam_unix(sudo:session): session closed for user root
Jul 03 01:27:00 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-464a5ddd-81c1-4ec2-a334-a2967ab17de8 tempest-CreateVolumesFromImageTest-392643813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-99090f1c-1a07-493f-9047-8410169d9275" returned: 0 in 0.684s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:27:00 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-464a5ddd-81c1-4ec2-a334-a2967ab17de8 tempest-CreateVolumesFromImageTest-392643813 None] <== create_volume: return (1548ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:27:00 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-464a5ddd-81c1-4ec2-a334-a2967ab17de8 tempest-CreateVolumesFromImageTest-392643813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.550s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:27:00 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-464a5ddd-81c1-4ec2-a334-a2967ab17de8 tempest-CreateVolumesFromImageTest-392643813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17615102-9bb5-4223-af3f-b51e8007cb2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99090f1c-1a07-493f-9047-8410169d9275', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:27:00 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-464a5ddd-81c1-4ec2-a334-a2967ab17de8 tempest-CreateVolumesFromImageTest-392643813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cea67a2-1565-48f0-acd9-07dc4d9565fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:27:00 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-464a5ddd-81c1-4ec2-a334-a2967ab17de8 tempest-CreateVolumesFromImageTest-392643813 None] Volume volume-99090f1c-1a07-493f-9047-8410169d9275 (99090f1c-1a07-493f-9047-8410169d9275): created successfully
Jul 03 01:27:00 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-464a5ddd-81c1-4ec2-a334-a2967ab17de8 tempest-CreateVolumesFromImageTest-392643813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cea67a2-1565-48f0-acd9-07dc4d9565fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:27:00 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-464a5ddd-81c1-4ec2-a334-a2967ab17de8 tempest-CreateVolumesFromImageTest-392643813 None] Flow 'volume_create_manager' (f9c4200d-7faa-46a4-8582-4abf2768dc11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:27:00 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-464a5ddd-81c1-4ec2-a334-a2967ab17de8 tempest-CreateVolumesFromImageTest-392643813 None] Created volume successfully.
Jul 03 01:27:00 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-eff1fe28-3239-474e-a9c2-f386fe14ecae tempest-CreateVolumesFromImageTest-392643813 None] Acquiring lock "cinder-99090f1c-1a07-493f-9047-8410169d9275-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:27:00 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-eff1fe28-3239-474e-a9c2-f386fe14ecae tempest-CreateVolumesFromImageTest-392643813 None] Lock "cinder-99090f1c-1a07-493f-9047-8410169d9275-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:27:00 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-eff1fe28-3239-474e-a9c2-f386fe14ecae tempest-CreateVolumesFromImageTest-392643813 None] Acquiring lock "cinder-quobyte-99090f1c-1a07-493f-9047-8410169d9275" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:27:00 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-eff1fe28-3239-474e-a9c2-f386fe14ecae tempest-CreateVolumesFromImageTest-392643813 None] Lock "cinder-quobyte-99090f1c-1a07-493f-9047-8410169d9275" acquired by "delete_volume" :: waited 0.018s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:27:00 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[140bd629-7ff0-4f1f-a5fa-9ebb4ff11522]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:27:00 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-eff1fe28-3239-474e-a9c2-f386fe14ecae tempest-CreateVolumesFromImageTest-392643813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-99090f1c-1a07-493f-9047-8410169d9275 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:27:01 devstack sudo[105831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-99090f1c-1a07-493f-9047-8410169d9275
Jul 03 01:27:01 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:27:01 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root
Jul 03 01:27:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-eff1fe28-3239-474e-a9c2-f386fe14ecae tempest-CreateVolumesFromImageTest-392643813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-99090f1c-1a07-493f-9047-8410169d9275" returned: 0 in 0.795s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:27:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-eff1fe28-3239-474e-a9c2-f386fe14ecae tempest-CreateVolumesFromImageTest-392643813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-99090f1c-1a07-493f-9047-8410169d9275 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:27:01 devstack sudo[105836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-99090f1c-1a07-493f-9047-8410169d9275
Jul 03 01:27:01 devstack sudo[105836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:27:01 devstack cinder-volume[86891]: DEBUG oslo_service.periodic_task [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86891) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 01:27:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:27:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:27:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:27:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:27:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:27:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:27:01 devstack sudo[105838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:27:01 devstack sudo[105838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:27:02 devstack sudo[105836]: pam_unix(sudo:session): session closed for user root
Jul 03 01:27:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-eff1fe28-3239-474e-a9c2-f386fe14ecae tempest-CreateVolumesFromImageTest-392643813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-99090f1c-1a07-493f-9047-8410169d9275" returned: 0 in 0.672s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:27:02 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-eff1fe28-3239-474e-a9c2-f386fe14ecae tempest-CreateVolumesFromImageTest-392643813 None] Lock "cinder-quobyte-99090f1c-1a07-493f-9047-8410169d9275" released by "delete_volume" :: held 1.508s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:27:02 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-eff1fe28-3239-474e-a9c2-f386fe14ecae tempest-CreateVolumesFromImageTest-392643813 None] Created reservations ['e0087032-26d3-4a61-af76-85c4a13ac7c1', '00e8fbe1-6f1a-4073-8b5f-60a3d88d4fee', '35f6ba1f-1391-405c-b8a7-c97b8a643419', '6e3de745-c9a3-4665-ae3e-c859c14217a3'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:27:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-eff1fe28-3239-474e-a9c2-f386fe14ecae tempest-CreateVolumesFromImageTest-392643813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:27:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-eff1fe28-3239-474e-a9c2-f386fe14ecae tempest-CreateVolumesFromImageTest-392643813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:27:02 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-eff1fe28-3239-474e-a9c2-f386fe14ecae tempest-CreateVolumesFromImageTest-392643813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:27:02 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-eff1fe28-3239-474e-a9c2-f386fe14ecae tempest-CreateVolumesFromImageTest-392643813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:27:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-eff1fe28-3239-474e-a9c2-f386fe14ecae tempest-CreateVolumesFromImageTest-392643813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:27:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-eff1fe28-3239-474e-a9c2-f386fe14ecae tempest-CreateVolumesFromImageTest-392643813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:27:02 devstack sudo[105842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:27:02 devstack sudo[105842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:27:02 devstack sudo[105838]: pam_unix(sudo:session): session closed for user root
Jul 03 01:27:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.707s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:27:02 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:27:02 devstack cinder-volume[86891]: DEBUG oslo_service.periodic_task [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running periodic task VolumeManager._thread_info {{(pid=86891) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 01:27:02 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] thread count: 28 {{(pid=86891) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 01:27:02 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] thread info: [<_MainThread(MainThread, started 136731296534656)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136731184953280)>, <Thread(Thread-3 (stat_writer), started daemon 136731184058816)>, <Thread(Rabbit-heartbeat, started daemon 136731184846080)>, <Thread(Thread-5 (_runner), started daemon 136731182936576)>, <Thread(Thread-7 (_runner), started daemon 136731182954944)>, <Thread(fd_logger, started daemon 136731181916416)>, <Thread(privsep_reader, started daemon 136731180942208)>, <Thread(tpool_thread_0, started daemon 136731172161216)>, <Thread(tpool_thread_1, started daemon 136731163768512)>, <Thread(tpool_thread_2, started daemon 136731155375808)>, <Thread(tpool_thread_3, started daemon 136731146983104)>, <Thread(tpool_thread_4, started daemon 136731138590400)>, <Thread(tpool_thread_5, started daemon 136731130197696)>, <Thread(tpool_thread_6, started daemon 136731121804992)>, <Thread(tpool_thread_7, started daemon 136731113412288)>, <Thread(tpool_thread_8, started daemon 136731105003200)>, <Thread(tpool_thread_9, started daemon 136731096594112)>, <Thread(tpool_thread_10, started daemon 136731088185024)>, <Thread(tpool_thread_11, started daemon 136731079775936)>, <Thread(tpool_thread_12, started daemon 136731071366848)>, <Thread(tpool_thread_13, started daemon 136731062957760)>, <Thread(tpool_thread_14, started daemon 136731054548672)>, <Thread(tpool_thread_15, started daemon 136731046139584)>, <Thread(tpool_thread_16, started daemon 136731037730496)>, <Thread(tpool_thread_17, started daemon 136731029321408)>, <Thread(tpool_thread_18, started daemon 136731020912320)>, <Thread(tpool_thread_19, started daemon 136731012503232)>] {{(pid=86891) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 01:27:03 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-7baf6d2e-f1e2-487f-8519-16cd356a9c54 tempest-CreateVolumesFromImageTest-392643813 None] Acquiring lock "cinder-cca2d051-52d1-4559-8b25-698c8230f86f-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:27:03 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-7baf6d2e-f1e2-487f-8519-16cd356a9c54 tempest-CreateVolumesFromImageTest-392643813 None] Lock "cinder-cca2d051-52d1-4559-8b25-698c8230f86f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:27:03 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-7baf6d2e-f1e2-487f-8519-16cd356a9c54 tempest-CreateVolumesFromImageTest-392643813 None] Acquiring lock "cinder-quobyte-cca2d051-52d1-4559-8b25-698c8230f86f" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:27:03 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-7baf6d2e-f1e2-487f-8519-16cd356a9c54 tempest-CreateVolumesFromImageTest-392643813 None] Lock "cinder-quobyte-cca2d051-52d1-4559-8b25-698c8230f86f" acquired by "delete_volume" :: waited 0.016s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:27:03 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0a7e2a-e02a-4c1b-9351-b0b9e80f6348]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:27:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-7baf6d2e-f1e2-487f-8519-16cd356a9c54 tempest-CreateVolumesFromImageTest-392643813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cca2d051-52d1-4559-8b25-698c8230f86f {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:27:03 devstack sudo[105842]: pam_unix(sudo:session): session closed for user root
Jul 03 01:27:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-eff1fe28-3239-474e-a9c2-f386fe14ecae tempest-CreateVolumesFromImageTest-392643813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.736s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:27:03 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-eff1fe28-3239-474e-a9c2-f386fe14ecae tempest-CreateVolumesFromImageTest-392643813 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:27:03 devstack sudo[105845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cca2d051-52d1-4559-8b25-698c8230f86f
Jul 03 01:27:03 devstack sudo[105845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:27:03 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-eff1fe28-3239-474e-a9c2-f386fe14ecae tempest-CreateVolumesFromImageTest-392643813 None] Deleted volume successfully.
Jul 03 01:27:03 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-eff1fe28-3239-474e-a9c2-f386fe14ecae tempest-CreateVolumesFromImageTest-392643813 None] Lock "cinder-99090f1c-1a07-493f-9047-8410169d9275-delete_volume" released by "delete_volume" :: held 2.442s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:27:03 devstack sudo[105845]: pam_unix(sudo:session): session closed for user root
Jul 03 01:27:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-7baf6d2e-f1e2-487f-8519-16cd356a9c54 tempest-CreateVolumesFromImageTest-392643813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cca2d051-52d1-4559-8b25-698c8230f86f" returned: 0 in 0.769s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:27:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-7baf6d2e-f1e2-487f-8519-16cd356a9c54 tempest-CreateVolumesFromImageTest-392643813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cca2d051-52d1-4559-8b25-698c8230f86f {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:27:03 devstack sudo[105850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cca2d051-52d1-4559-8b25-698c8230f86f
Jul 03 01:27:03 devstack sudo[105850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:27:04 devstack sudo[105850]: pam_unix(sudo:session): session closed for user root
Jul 03 01:27:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-7baf6d2e-f1e2-487f-8519-16cd356a9c54 tempest-CreateVolumesFromImageTest-392643813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cca2d051-52d1-4559-8b25-698c8230f86f" returned: 0 in 0.654s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:27:04 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-7baf6d2e-f1e2-487f-8519-16cd356a9c54 tempest-CreateVolumesFromImageTest-392643813 None] Lock "cinder-quobyte-cca2d051-52d1-4559-8b25-698c8230f86f" released by "delete_volume" :: held 1.474s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:27:04 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-7baf6d2e-f1e2-487f-8519-16cd356a9c54 tempest-CreateVolumesFromImageTest-392643813 None] Created reservations ['7dca4958-9242-4bdb-9214-ffce03cbe982', 'eef440e1-cdd9-4a2b-a568-cda2b17b5ab7', '78519abc-ed4e-4358-aa9a-c300631a6984', '061672dd-ed22-4599-9fe1-e353fde7aa68'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:27:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-7baf6d2e-f1e2-487f-8519-16cd356a9c54 tempest-CreateVolumesFromImageTest-392643813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:27:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-7baf6d2e-f1e2-487f-8519-16cd356a9c54 tempest-CreateVolumesFromImageTest-392643813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:27:04 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-7baf6d2e-f1e2-487f-8519-16cd356a9c54 tempest-CreateVolumesFromImageTest-392643813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:27:04 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-7baf6d2e-f1e2-487f-8519-16cd356a9c54 tempest-CreateVolumesFromImageTest-392643813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:27:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-7baf6d2e-f1e2-487f-8519-16cd356a9c54 tempest-CreateVolumesFromImageTest-392643813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:27:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-7baf6d2e-f1e2-487f-8519-16cd356a9c54 tempest-CreateVolumesFromImageTest-392643813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:27:04 devstack sudo[105853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:27:04 devstack sudo[105853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:27:05 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-061313df-5cb4-4c71-b101-0bd87336a734 tempest-CreateVolumesFromImageTest-392643813 None] Acquiring lock "cinder-ac19ff70-ff86-4c1f-99c8-d0c978a532f9-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:27:05 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-061313df-5cb4-4c71-b101-0bd87336a734 tempest-CreateVolumesFromImageTest-392643813 None] Lock "cinder-ac19ff70-ff86-4c1f-99c8-d0c978a532f9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:27:05 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-061313df-5cb4-4c71-b101-0bd87336a734 tempest-CreateVolumesFromImageTest-392643813 None] Acquiring lock "cinder-quobyte-ac19ff70-ff86-4c1f-99c8-d0c978a532f9" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:27:05 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-061313df-5cb4-4c71-b101-0bd87336a734 tempest-CreateVolumesFromImageTest-392643813 None] Lock "cinder-quobyte-ac19ff70-ff86-4c1f-99c8-d0c978a532f9" acquired by "delete_volume" :: waited 0.015s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:27:05 devstack sudo[105853]: pam_unix(sudo:session): session closed for user root
Jul 03 01:27:05 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-7baf6d2e-f1e2-487f-8519-16cd356a9c54 tempest-CreateVolumesFromImageTest-392643813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.671s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:27:05 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-7baf6d2e-f1e2-487f-8519-16cd356a9c54 tempest-CreateVolumesFromImageTest-392643813 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:27:05 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-7baf6d2e-f1e2-487f-8519-16cd356a9c54 tempest-CreateVolumesFromImageTest-392643813 None] Deleted volume successfully.
Jul 03 01:27:05 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebeaced8-f43e-40bb-9e04-264fd9bab189]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:27:05 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-061313df-5cb4-4c71-b101-0bd87336a734 tempest-CreateVolumesFromImageTest-392643813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ac19ff70-ff86-4c1f-99c8-d0c978a532f9 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:27:05 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-7baf6d2e-f1e2-487f-8519-16cd356a9c54 tempest-CreateVolumesFromImageTest-392643813 None] Lock "cinder-cca2d051-52d1-4559-8b25-698c8230f86f-delete_volume" released by "delete_volume" :: held 2.345s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:27:05 devstack sudo[105856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ac19ff70-ff86-4c1f-99c8-d0c978a532f9
Jul 03 01:27:05 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:27:06 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root
Jul 03 01:27:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-061313df-5cb4-4c71-b101-0bd87336a734 tempest-CreateVolumesFromImageTest-392643813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ac19ff70-ff86-4c1f-99c8-d0c978a532f9" returned: 0 in 0.745s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:27:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-061313df-5cb4-4c71-b101-0bd87336a734 tempest-CreateVolumesFromImageTest-392643813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ac19ff70-ff86-4c1f-99c8-d0c978a532f9 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:27:06 devstack sudo[105861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ac19ff70-ff86-4c1f-99c8-d0c978a532f9
Jul 03 01:27:06 devstack sudo[105861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:27:06 devstack sudo[105861]: pam_unix(sudo:session): session closed for user root
Jul 03 01:27:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-061313df-5cb4-4c71-b101-0bd87336a734 tempest-CreateVolumesFromImageTest-392643813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ac19ff70-ff86-4c1f-99c8-d0c978a532f9" returned: 0 in 0.630s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:27:06 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-061313df-5cb4-4c71-b101-0bd87336a734 tempest-CreateVolumesFromImageTest-392643813 None] Lock "cinder-quobyte-ac19ff70-ff86-4c1f-99c8-d0c978a532f9" released by "delete_volume" :: held 1.421s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:27:06 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-061313df-5cb4-4c71-b101-0bd87336a734 tempest-CreateVolumesFromImageTest-392643813 None] Created reservations ['bb7731a1-43e0-4aba-a83e-f5d3303093bf', '885d56d4-ac4e-496a-b7da-3a259bf38cd5', '4d78d8d3-d56b-4d24-8dd8-9a27ca3d1dbd', '100dfd21-5c7e-4acd-842e-cf895c0dfb7a'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:27:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-061313df-5cb4-4c71-b101-0bd87336a734 tempest-CreateVolumesFromImageTest-392643813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:27:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-061313df-5cb4-4c71-b101-0bd87336a734 tempest-CreateVolumesFromImageTest-392643813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:27:06 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-061313df-5cb4-4c71-b101-0bd87336a734 tempest-CreateVolumesFromImageTest-392643813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:27:06 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-061313df-5cb4-4c71-b101-0bd87336a734 tempest-CreateVolumesFromImageTest-392643813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:27:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-061313df-5cb4-4c71-b101-0bd87336a734 tempest-CreateVolumesFromImageTest-392643813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:27:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-061313df-5cb4-4c71-b101-0bd87336a734 tempest-CreateVolumesFromImageTest-392643813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:27:06 devstack sudo[105864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:27:06 devstack sudo[105864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:27:07 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-1524b871-6ab0-43ae-9106-1798289bec6f tempest-CreateVolumesFromImageTest-392643813 None] Acquiring lock "cinder-1144d13f-966b-4bc4-9238-8045631fdcac-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:27:07 devstack sudo[105864]: pam_unix(sudo:session): session closed for user root
Jul 03 01:27:07 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-061313df-5cb4-4c71-b101-0bd87336a734 tempest-CreateVolumesFromImageTest-392643813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.651s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:27:07 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-061313df-5cb4-4c71-b101-0bd87336a734 tempest-CreateVolumesFromImageTest-392643813 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:27:07 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-1524b871-6ab0-43ae-9106-1798289bec6f tempest-CreateVolumesFromImageTest-392643813 None] Lock "cinder-1144d13f-966b-4bc4-9238-8045631fdcac-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:27:07 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-061313df-5cb4-4c71-b101-0bd87336a734 tempest-CreateVolumesFromImageTest-392643813 None] Deleted volume successfully.
Jul 03 01:27:07 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-061313df-5cb4-4c71-b101-0bd87336a734 tempest-CreateVolumesFromImageTest-392643813 None] Lock "cinder-ac19ff70-ff86-4c1f-99c8-d0c978a532f9-delete_volume" released by "delete_volume" :: held 2.268s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:27:07 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-1524b871-6ab0-43ae-9106-1798289bec6f tempest-CreateVolumesFromImageTest-392643813 None] Acquiring lock "cinder-quobyte-1144d13f-966b-4bc4-9238-8045631fdcac" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:27:07 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-1524b871-6ab0-43ae-9106-1798289bec6f tempest-CreateVolumesFromImageTest-392643813 None] Lock "cinder-quobyte-1144d13f-966b-4bc4-9238-8045631fdcac" acquired by "delete_volume" :: waited 0.015s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:27:07 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2e57cc-d3cb-4997-b03e-5b1bb4ab4b7f]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:27:07 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1524b871-6ab0-43ae-9106-1798289bec6f tempest-CreateVolumesFromImageTest-392643813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1144d13f-966b-4bc4-9238-8045631fdcac {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:27:07 devstack sudo[105867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1144d13f-966b-4bc4-9238-8045631fdcac
Jul 03 01:27:07 devstack sudo[105867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:27:08 devstack sudo[105867]: pam_unix(sudo:session): session closed for user root
Jul 03 01:27:08 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1524b871-6ab0-43ae-9106-1798289bec6f tempest-CreateVolumesFromImageTest-392643813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1144d13f-966b-4bc4-9238-8045631fdcac" returned: 0 in 0.729s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:27:08 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1524b871-6ab0-43ae-9106-1798289bec6f tempest-CreateVolumesFromImageTest-392643813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1144d13f-966b-4bc4-9238-8045631fdcac {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:27:08 devstack sudo[105872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1144d13f-966b-4bc4-9238-8045631fdcac
Jul 03 01:27:08 devstack sudo[105872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:27:09 devstack sudo[105872]: pam_unix(sudo:session): session closed for user root
Jul 03 01:27:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1524b871-6ab0-43ae-9106-1798289bec6f tempest-CreateVolumesFromImageTest-392643813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1144d13f-966b-4bc4-9238-8045631fdcac" returned: 0 in 0.623s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:27:09 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-1524b871-6ab0-43ae-9106-1798289bec6f tempest-CreateVolumesFromImageTest-392643813 None] Lock "cinder-quobyte-1144d13f-966b-4bc4-9238-8045631fdcac" released by "delete_volume" :: held 1.389s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:27:09 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-1524b871-6ab0-43ae-9106-1798289bec6f tempest-CreateVolumesFromImageTest-392643813 None] Created reservations ['17bb7ef1-ee69-45e6-9158-ceaeb3d8f62a', '5148a789-7c8b-41eb-8e16-6240b5153b74', '842e9b9d-b083-45aa-a319-550be29c4f2c', '5bcaf350-2f6b-4b5a-b194-0f467a64a6e3'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:27:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1524b871-6ab0-43ae-9106-1798289bec6f tempest-CreateVolumesFromImageTest-392643813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:27:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1524b871-6ab0-43ae-9106-1798289bec6f tempest-CreateVolumesFromImageTest-392643813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:27:09 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-1524b871-6ab0-43ae-9106-1798289bec6f tempest-CreateVolumesFromImageTest-392643813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:27:09 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-1524b871-6ab0-43ae-9106-1798289bec6f tempest-CreateVolumesFromImageTest-392643813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:27:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1524b871-6ab0-43ae-9106-1798289bec6f tempest-CreateVolumesFromImageTest-392643813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:27:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1524b871-6ab0-43ae-9106-1798289bec6f tempest-CreateVolumesFromImageTest-392643813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:27:09 devstack sudo[105876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:27:09 devstack sudo[105876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:27:09 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-55641291-0b9a-414c-a041-ddb7a09588b8 tempest-CreateVolumesFromImageTest-392643813 None] Acquiring lock "cinder-d6180e92-1f29-4169-a264-80d52a83601f-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:27:09 devstack sudo[105876]: pam_unix(sudo:session): session closed for user root
Jul 03 01:27:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1524b871-6ab0-43ae-9106-1798289bec6f tempest-CreateVolumesFromImageTest-392643813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.631s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:27:09 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-1524b871-6ab0-43ae-9106-1798289bec6f tempest-CreateVolumesFromImageTest-392643813 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:27:09 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-1524b871-6ab0-43ae-9106-1798289bec6f tempest-CreateVolumesFromImageTest-392643813 None] Deleted volume successfully.
Jul 03 01:27:09 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-55641291-0b9a-414c-a041-ddb7a09588b8 tempest-CreateVolumesFromImageTest-392643813 None] Lock "cinder-d6180e92-1f29-4169-a264-80d52a83601f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:27:09 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-1524b871-6ab0-43ae-9106-1798289bec6f tempest-CreateVolumesFromImageTest-392643813 None] Lock "cinder-1144d13f-966b-4bc4-9238-8045631fdcac-delete_volume" released by "delete_volume" :: held 2.239s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:27:09 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-55641291-0b9a-414c-a041-ddb7a09588b8 tempest-CreateVolumesFromImageTest-392643813 None] Acquiring lock "cinder-quobyte-d6180e92-1f29-4169-a264-80d52a83601f" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:27:09 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-55641291-0b9a-414c-a041-ddb7a09588b8 tempest-CreateVolumesFromImageTest-392643813 None] Lock "cinder-quobyte-d6180e92-1f29-4169-a264-80d52a83601f" acquired by "delete_volume" :: waited 0.014s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:27:09 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[99fee63f-2cdf-4e2d-8cf6-6b9607468804]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:27:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-55641291-0b9a-414c-a041-ddb7a09588b8 tempest-CreateVolumesFromImageTest-392643813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d6180e92-1f29-4169-a264-80d52a83601f {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:27:09 devstack sudo[105879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d6180e92-1f29-4169-a264-80d52a83601f
Jul 03 01:27:09 devstack sudo[105879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:27:10 devstack sudo[105879]: pam_unix(sudo:session): session closed for user root
Jul 03 01:27:10 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-55641291-0b9a-414c-a041-ddb7a09588b8 tempest-CreateVolumesFromImageTest-392643813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d6180e92-1f29-4169-a264-80d52a83601f" returned: 0 in 0.733s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:27:10 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-55641291-0b9a-414c-a041-ddb7a09588b8 tempest-CreateVolumesFromImageTest-392643813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d6180e92-1f29-4169-a264-80d52a83601f {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:27:10 devstack sudo[105884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d6180e92-1f29-4169-a264-80d52a83601f
Jul 03 01:27:10 devstack sudo[105884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:27:11 devstack sudo[105884]: pam_unix(sudo:session): session closed for user root
Jul 03 01:27:11 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-55641291-0b9a-414c-a041-ddb7a09588b8 tempest-CreateVolumesFromImageTest-392643813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d6180e92-1f29-4169-a264-80d52a83601f" returned: 0 in 0.617s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:27:11 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-55641291-0b9a-414c-a041-ddb7a09588b8 tempest-CreateVolumesFromImageTest-392643813 None] Lock "cinder-quobyte-d6180e92-1f29-4169-a264-80d52a83601f" released by "delete_volume" :: held 1.387s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:27:11 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-55641291-0b9a-414c-a041-ddb7a09588b8 tempest-CreateVolumesFromImageTest-392643813 None] Created reservations ['a88fb516-1ca3-4c22-9fe6-c5da20644157', 'd50f841b-cc2c-4e4c-a907-eae758626a79', '0c8232be-5807-4471-913a-e3ee296d5cb1', '9914d7e8-a0e4-4da3-9b89-1bc33147c4d7'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:27:11 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-55641291-0b9a-414c-a041-ddb7a09588b8 tempest-CreateVolumesFromImageTest-392643813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:27:11 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-55641291-0b9a-414c-a041-ddb7a09588b8 tempest-CreateVolumesFromImageTest-392643813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:27:11 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-55641291-0b9a-414c-a041-ddb7a09588b8 tempest-CreateVolumesFromImageTest-392643813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:27:11 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-55641291-0b9a-414c-a041-ddb7a09588b8 tempest-CreateVolumesFromImageTest-392643813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:27:11 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-55641291-0b9a-414c-a041-ddb7a09588b8 tempest-CreateVolumesFromImageTest-392643813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:27:11 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-55641291-0b9a-414c-a041-ddb7a09588b8 tempest-CreateVolumesFromImageTest-392643813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:27:11 devstack sudo[105887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:27:11 devstack sudo[105887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:27:12 devstack sudo[105887]: pam_unix(sudo:session): session closed for user root
Jul 03 01:27:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-55641291-0b9a-414c-a041-ddb7a09588b8 tempest-CreateVolumesFromImageTest-392643813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.659s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:27:12 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-55641291-0b9a-414c-a041-ddb7a09588b8 tempest-CreateVolumesFromImageTest-392643813 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:27:12 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-55641291-0b9a-414c-a041-ddb7a09588b8 tempest-CreateVolumesFromImageTest-392643813 None] Deleted volume successfully.
Jul 03 01:27:12 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-55641291-0b9a-414c-a041-ddb7a09588b8 tempest-CreateVolumesFromImageTest-392643813 None] Lock "cinder-d6180e92-1f29-4169-a264-80d52a83601f-delete_volume" released by "delete_volume" :: held 2.266s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:27:14 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-2812d2d2-be4e-42f0-bbb9-a3a86dbf7cca tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:27:14 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-2812d2d2-be4e-42f0-bbb9-a3a86dbf7cca tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Flow 'volume_create_manager' (8d15e6e7-7200-4864-be47-a6fb5b6ad8fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:27:14 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-2812d2d2-be4e-42f0-bbb9-a3a86dbf7cca tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d992fde6-d556-48dc-855a-aed37e74d8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:27:14 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-2812d2d2-be4e-42f0-bbb9-a3a86dbf7cca tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d992fde6-d556-48dc-855a-aed37e74d8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:27:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-415494562',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbd58b04-5810-4d34-b89b-63d02ce2885e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0bc2c4f910c4d33b53f1b64569f286b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:15Z,use_quota=True,user_id='292664e5914c4829a3dda24837301a07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:27:14 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-2812d2d2-be4e-42f0-bbb9-a3a86dbf7cca tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d18eb72a-ae20-4563-a509-af58992fbef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:27:14 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-2812d2d2-be4e-42f0-bbb9-a3a86dbf7cca tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d18eb72a-ae20-4563-a509-af58992fbef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:27:14 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-2812d2d2-be4e-42f0-bbb9-a3a86dbf7cca tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (440a67db-84f8-42dc-8c11-6ca555664bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:27:14 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-2812d2d2-be4e-42f0-bbb9-a3a86dbf7cca tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (440a67db-84f8-42dc-8c11-6ca555664bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbd58b04-5810-4d34-b89b-63d02ce2885e', 'volume_name': 'volume-bbd58b04-5810-4d34-b89b-63d02ce2885e', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:27:14 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-2812d2d2-be4e-42f0-bbb9-a3a86dbf7cca tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0d50563-3f50-4fa8-a632-efdafa30abb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:27:14 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-2812d2d2-be4e-42f0-bbb9-a3a86dbf7cca tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0d50563-3f50-4fa8-a632-efdafa30abb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:27:14 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-2812d2d2-be4e-42f0-bbb9-a3a86dbf7cca tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fdda85d-c065-4f0e-96bd-dde650507758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:27:14 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-2812d2d2-be4e-42f0-bbb9-a3a86dbf7cca tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Volume bbd58b04-5810-4d34-b89b-63d02ce2885e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbd58b04-5810-4d34-b89b-63d02ce2885e', 'volume_size': 1}
Jul 03 01:27:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-2812d2d2-be4e-42f0-bbb9-a3a86dbf7cca tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:27:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-2812d2d2-be4e-42f0-bbb9-a3a86dbf7cca tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:27:14 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-2812d2d2-be4e-42f0-bbb9-a3a86dbf7cca tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:27:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-415494562',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbd58b04-5810-4d34-b89b-63d02ce2885e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0bc2c4f910c4d33b53f1b64569f286b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:15Z,use_quota=True,user_id='292664e5914c4829a3dda24837301a07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:27:14 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-2812d2d2-be4e-42f0-bbb9-a3a86dbf7cca tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Creating volume bbd58b04-5810-4d34-b89b-63d02ce2885e {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:27:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-2812d2d2-be4e-42f0-bbb9-a3a86dbf7cca tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:27:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-2812d2d2-be4e-42f0-bbb9-a3a86dbf7cca tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:27:14 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-2812d2d2-be4e-42f0-bbb9-a3a86dbf7cca tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:27:14 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-2812d2d2-be4e-42f0-bbb9-a3a86dbf7cca tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:27:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-2812d2d2-be4e-42f0-bbb9-a3a86dbf7cca tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:27:14 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-2812d2d2-be4e-42f0-bbb9-a3a86dbf7cca tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:27:14 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-2812d2d2-be4e-42f0-bbb9-a3a86dbf7cca tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:27:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-2812d2d2-be4e-42f0-bbb9-a3a86dbf7cca tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-bbd58b04-5810-4d34-b89b-63d02ce2885e 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:27:14 devstack sudo[105892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-bbd58b04-5810-4d34-b89b-63d02ce2885e 1073741824
Jul 03 01:27:14 devstack sudo[105892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:27:15 devstack sudo[105892]: pam_unix(sudo:session): session closed for user root
Jul 03 01:27:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-2812d2d2-be4e-42f0-bbb9-a3a86dbf7cca tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-bbd58b04-5810-4d34-b89b-63d02ce2885e 1073741824" returned: 0 in 0.778s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:27:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-2812d2d2-be4e-42f0-bbb9-a3a86dbf7cca tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-bbd58b04-5810-4d34-b89b-63d02ce2885e {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:27:15 devstack sudo[105898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-bbd58b04-5810-4d34-b89b-63d02ce2885e
Jul 03 01:27:15 devstack sudo[105898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:27:16 devstack sudo[105898]: pam_unix(sudo:session): session closed for user root
Jul 03 01:27:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-2812d2d2-be4e-42f0-bbb9-a3a86dbf7cca tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-bbd58b04-5810-4d34-b89b-63d02ce2885e" returned: 0 in 0.639s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:27:16 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-2812d2d2-be4e-42f0-bbb9-a3a86dbf7cca tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] <== create_volume: return (1454ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:27:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-2812d2d2-be4e-42f0-bbb9-a3a86dbf7cca tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.456s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:27:16 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-2812d2d2-be4e-42f0-bbb9-a3a86dbf7cca tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fdda85d-c065-4f0e-96bd-dde650507758) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbd58b04-5810-4d34-b89b-63d02ce2885e', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:27:16 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-2812d2d2-be4e-42f0-bbb9-a3a86dbf7cca tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (471bee30-e64a-4102-bc9d-ed711577a9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:27:16 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-2812d2d2-be4e-42f0-bbb9-a3a86dbf7cca tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Volume volume-bbd58b04-5810-4d34-b89b-63d02ce2885e (bbd58b04-5810-4d34-b89b-63d02ce2885e): created successfully
Jul 03 01:27:16 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-2812d2d2-be4e-42f0-bbb9-a3a86dbf7cca tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (471bee30-e64a-4102-bc9d-ed711577a9d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:27:16 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-2812d2d2-be4e-42f0-bbb9-a3a86dbf7cca tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Flow 'volume_create_manager' (8d15e6e7-7200-4864-be47-a6fb5b6ad8fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:27:16 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-2812d2d2-be4e-42f0-bbb9-a3a86dbf7cca tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Created volume successfully.
Jul 03 01:27:17 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d7e93f0-2c4a-493e-bf33-737f7db29333 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:27:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-9d7e93f0-2c4a-493e-bf33-737f7db29333 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Flow 'volume_create_manager' (2a804ede-bae2-4181-a158-53821f109051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:27:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-9d7e93f0-2c4a-493e-bf33-737f7db29333 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (098d9d65-0c89-445d-9905-cefa87a21d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:27:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-9d7e93f0-2c4a-493e-bf33-737f7db29333 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (098d9d65-0c89-445d-9905-cefa87a21d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:27:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2097422012',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25f57c1c-6995-4815-b489-92d96678e344,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0bc2c4f910c4d33b53f1b64569f286b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:17Z,use_quota=True,user_id='292664e5914c4829a3dda24837301a07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:27:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-9d7e93f0-2c4a-493e-bf33-737f7db29333 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0554c212-4a67-4bc9-b70f-2a5bb4de7bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:27:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-9d7e93f0-2c4a-493e-bf33-737f7db29333 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0554c212-4a67-4bc9-b70f-2a5bb4de7bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:27:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-9d7e93f0-2c4a-493e-bf33-737f7db29333 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfdc854b-4bef-4be8-9cba-626f238bd5fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:27:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-9d7e93f0-2c4a-493e-bf33-737f7db29333 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfdc854b-4bef-4be8-9cba-626f238bd5fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25f57c1c-6995-4815-b489-92d96678e344', 'volume_name': 'volume-25f57c1c-6995-4815-b489-92d96678e344', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:27:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-9d7e93f0-2c4a-493e-bf33-737f7db29333 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61007ed0-a9d8-4f54-ac48-bd4621735e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:27:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-9d7e93f0-2c4a-493e-bf33-737f7db29333 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61007ed0-a9d8-4f54-ac48-bd4621735e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:27:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-9d7e93f0-2c4a-493e-bf33-737f7db29333 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc2ce154-02ce-4943-92d6-b40a960be911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:27:17 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-9d7e93f0-2c4a-493e-bf33-737f7db29333 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Volume 25f57c1c-6995-4815-b489-92d96678e344: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25f57c1c-6995-4815-b489-92d96678e344', 'volume_size': 1}
Jul 03 01:27:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-9d7e93f0-2c4a-493e-bf33-737f7db29333 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:27:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-9d7e93f0-2c4a-493e-bf33-737f7db29333 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:27:17 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-9d7e93f0-2c4a-493e-bf33-737f7db29333 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:27:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2097422012',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25f57c1c-6995-4815-b489-92d96678e344,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0bc2c4f910c4d33b53f1b64569f286b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:17Z,use_quota=True,user_id='292664e5914c4829a3dda24837301a07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:27:17 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-9d7e93f0-2c4a-493e-bf33-737f7db29333 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Creating volume 25f57c1c-6995-4815-b489-92d96678e344 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:27:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-9d7e93f0-2c4a-493e-bf33-737f7db29333 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:27:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-9d7e93f0-2c4a-493e-bf33-737f7db29333 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:27:17 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-9d7e93f0-2c4a-493e-bf33-737f7db29333 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:27:17 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-9d7e93f0-2c4a-493e-bf33-737f7db29333 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:27:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-9d7e93f0-2c4a-493e-bf33-737f7db29333 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:27:17 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-9d7e93f0-2c4a-493e-bf33-737f7db29333 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:27:17 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-9d7e93f0-2c4a-493e-bf33-737f7db29333 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:27:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9d7e93f0-2c4a-493e-bf33-737f7db29333 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-25f57c1c-6995-4815-b489-92d96678e344 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:27:17 devstack sudo[105901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-25f57c1c-6995-4815-b489-92d96678e344 1073741824
Jul 03 01:27:17 devstack sudo[105901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:27:17 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7a0e5cd-2f6e-4481-be30-2337a600a786 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:27:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-d7a0e5cd-2f6e-4481-be30-2337a600a786 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Flow 'volume_create_manager' (0b664db4-b97b-4107-b687-4b38949002f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:27:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-d7a0e5cd-2f6e-4481-be30-2337a600a786 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b01dfa3e-0ff0-42e5-b49d-3b6d9d014333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:27:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-d7a0e5cd-2f6e-4481-be30-2337a600a786 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b01dfa3e-0ff0-42e5-b49d-3b6d9d014333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:27:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-742646966',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fd3fd07-bbb4-4707-819e-f80844ca0da5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0bc2c4f910c4d33b53f1b64569f286b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:17Z,use_quota=True,user_id='292664e5914c4829a3dda24837301a07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:27:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-d7a0e5cd-2f6e-4481-be30-2337a600a786 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b49f6f0f-bd46-4602-b631-b0b60c481579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:27:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-d7a0e5cd-2f6e-4481-be30-2337a600a786 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b49f6f0f-bd46-4602-b631-b0b60c481579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:27:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-d7a0e5cd-2f6e-4481-be30-2337a600a786 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfe40808-706f-49c8-a4fe-7226b760e24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:27:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-d7a0e5cd-2f6e-4481-be30-2337a600a786 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfe40808-706f-49c8-a4fe-7226b760e24f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fd3fd07-bbb4-4707-819e-f80844ca0da5', 'volume_name': 'volume-0fd3fd07-bbb4-4707-819e-f80844ca0da5', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:27:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-d7a0e5cd-2f6e-4481-be30-2337a600a786 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f5b1f1a-1a7e-4d79-8490-b62c3ccaf749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:27:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-d7a0e5cd-2f6e-4481-be30-2337a600a786 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f5b1f1a-1a7e-4d79-8490-b62c3ccaf749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:27:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-d7a0e5cd-2f6e-4481-be30-2337a600a786 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d9adcc5-efa2-4d4a-8e9b-19705fe952b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:27:17 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-d7a0e5cd-2f6e-4481-be30-2337a600a786 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Volume 0fd3fd07-bbb4-4707-819e-f80844ca0da5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fd3fd07-bbb4-4707-819e-f80844ca0da5', 'volume_size': 1}
Jul 03 01:27:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-d7a0e5cd-2f6e-4481-be30-2337a600a786 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:27:17 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7d2bd5b-9b65-4fa0-94c5-60da4d2feaaf tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:27:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f7d2bd5b-9b65-4fa0-94c5-60da4d2feaaf tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Flow 'volume_create_manager' (4a115370-f6d2-4764-a287-62094d69fbb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:27:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f7d2bd5b-9b65-4fa0-94c5-60da4d2feaaf tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bec1e5fb-db4e-4f83-b8ea-eb9c5e66dd9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:27:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f7d2bd5b-9b65-4fa0-94c5-60da4d2feaaf tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bec1e5fb-db4e-4f83-b8ea-eb9c5e66dd9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-817795627',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6124f5c0-8d15-4ed0-9bfa-47b5ac8cc04f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0bc2c4f910c4d33b53f1b64569f286b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:18Z,use_quota=True,user_id='292664e5914c4829a3dda24837301a07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:27:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f7d2bd5b-9b65-4fa0-94c5-60da4d2feaaf tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (294818cd-28e6-49bb-beee-ba6d12f89e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:27:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f7d2bd5b-9b65-4fa0-94c5-60da4d2feaaf tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (294818cd-28e6-49bb-beee-ba6d12f89e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:27:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f7d2bd5b-9b65-4fa0-94c5-60da4d2feaaf tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00b72673-e009-48a1-9622-4e331a9342e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:27:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f7d2bd5b-9b65-4fa0-94c5-60da4d2feaaf tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00b72673-e009-48a1-9622-4e331a9342e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6124f5c0-8d15-4ed0-9bfa-47b5ac8cc04f', 'volume_name': 'volume-6124f5c0-8d15-4ed0-9bfa-47b5ac8cc04f', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:27:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f7d2bd5b-9b65-4fa0-94c5-60da4d2feaaf tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73298ac0-932c-4347-b24b-f8b6f910acb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:27:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f7d2bd5b-9b65-4fa0-94c5-60da4d2feaaf tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73298ac0-932c-4347-b24b-f8b6f910acb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:27:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f7d2bd5b-9b65-4fa0-94c5-60da4d2feaaf tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (074c8b30-e0e6-4662-a600-303005142c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:27:17 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-f7d2bd5b-9b65-4fa0-94c5-60da4d2feaaf tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Volume 6124f5c0-8d15-4ed0-9bfa-47b5ac8cc04f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6124f5c0-8d15-4ed0-9bfa-47b5ac8cc04f', 'volume_size': 1}
Jul 03 01:27:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f7d2bd5b-9b65-4fa0-94c5-60da4d2feaaf tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:27:18 devstack sudo[105901]: pam_unix(sudo:session): session closed for user root
Jul 03 01:27:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9d7e93f0-2c4a-493e-bf33-737f7db29333 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-25f57c1c-6995-4815-b489-92d96678e344 1073741824" returned: 0 in 0.895s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:27:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9d7e93f0-2c4a-493e-bf33-737f7db29333 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-25f57c1c-6995-4815-b489-92d96678e344 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:27:18 devstack sudo[105908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-25f57c1c-6995-4815-b489-92d96678e344
Jul 03 01:27:18 devstack sudo[105908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:27:18 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-012b3603-ea0d-4542-8cd0-6431a51d894c tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:27:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-012b3603-ea0d-4542-8cd0-6431a51d894c tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Flow 'volume_create_manager' (7e6e2cfd-016b-4c36-9b35-70c80581f01c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:27:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-012b3603-ea0d-4542-8cd0-6431a51d894c tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23b930d3-3f73-4f29-a857-0fa17465777e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:27:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-012b3603-ea0d-4542-8cd0-6431a51d894c tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23b930d3-3f73-4f29-a857-0fa17465777e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1506031043',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80035fed-b57f-4df0-a956-41d1e30453d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0bc2c4f910c4d33b53f1b64569f286b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:18Z,use_quota=True,user_id='292664e5914c4829a3dda24837301a07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:27:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-012b3603-ea0d-4542-8cd0-6431a51d894c tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86ecf141-6cba-4b4e-9f7d-60f36fb9ee7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:27:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-012b3603-ea0d-4542-8cd0-6431a51d894c tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86ecf141-6cba-4b4e-9f7d-60f36fb9ee7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:27:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-012b3603-ea0d-4542-8cd0-6431a51d894c tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12799450-a5ec-45e7-adb2-ea97fcb3c6cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:27:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-012b3603-ea0d-4542-8cd0-6431a51d894c tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12799450-a5ec-45e7-adb2-ea97fcb3c6cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80035fed-b57f-4df0-a956-41d1e30453d6', 'volume_name': 'volume-80035fed-b57f-4df0-a956-41d1e30453d6', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:27:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-012b3603-ea0d-4542-8cd0-6431a51d894c tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78a783bf-431e-4b2c-8c83-f6d35d8755c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:27:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-012b3603-ea0d-4542-8cd0-6431a51d894c tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78a783bf-431e-4b2c-8c83-f6d35d8755c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:27:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-012b3603-ea0d-4542-8cd0-6431a51d894c tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01919c4c-b378-454e-b1e0-62d4c9a95715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:27:18 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-012b3603-ea0d-4542-8cd0-6431a51d894c tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Volume 80035fed-b57f-4df0-a956-41d1e30453d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80035fed-b57f-4df0-a956-41d1e30453d6', 'volume_size': 1}
Jul 03 01:27:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-012b3603-ea0d-4542-8cd0-6431a51d894c tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:27:18 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-32c59781-9090-43ec-8ee6-ad539fa0bc99 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:27:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-32c59781-9090-43ec-8ee6-ad539fa0bc99 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Flow 'volume_create_manager' (19597d42-fdda-47c1-8cfa-ee674cbec6e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:27:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-32c59781-9090-43ec-8ee6-ad539fa0bc99 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86a15fd3-cc6b-4edd-8578-01967172537a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:27:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-32c59781-9090-43ec-8ee6-ad539fa0bc99 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86a15fd3-cc6b-4edd-8578-01967172537a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1066485627',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3189aa5b-f7c3-477c-ba5d-b81edf58723d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0bc2c4f910c4d33b53f1b64569f286b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:19Z,use_quota=True,user_id='292664e5914c4829a3dda24837301a07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:27:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-32c59781-9090-43ec-8ee6-ad539fa0bc99 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e788c16-4b17-4d3b-999a-e1f529b21acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:27:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-32c59781-9090-43ec-8ee6-ad539fa0bc99 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e788c16-4b17-4d3b-999a-e1f529b21acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:27:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-32c59781-9090-43ec-8ee6-ad539fa0bc99 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2f05ae9-700d-4be5-931a-27263dcd5d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:27:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-32c59781-9090-43ec-8ee6-ad539fa0bc99 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2f05ae9-700d-4be5-931a-27263dcd5d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3189aa5b-f7c3-477c-ba5d-b81edf58723d', 'volume_name': 'volume-3189aa5b-f7c3-477c-ba5d-b81edf58723d', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:27:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-32c59781-9090-43ec-8ee6-ad539fa0bc99 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (342e93ae-698f-466f-a098-b9aa1270f8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:27:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-32c59781-9090-43ec-8ee6-ad539fa0bc99 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (342e93ae-698f-466f-a098-b9aa1270f8bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:27:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-32c59781-9090-43ec-8ee6-ad539fa0bc99 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (070602af-7e72-4d97-b577-2ed44510c61f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:27:18 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-32c59781-9090-43ec-8ee6-ad539fa0bc99 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Volume 3189aa5b-f7c3-477c-ba5d-b81edf58723d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3189aa5b-f7c3-477c-ba5d-b81edf58723d', 'volume_size': 1}
Jul 03 01:27:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-32c59781-9090-43ec-8ee6-ad539fa0bc99 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:27:18 devstack sudo[105908]: pam_unix(sudo:session): session closed for user root
Jul 03 01:27:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9d7e93f0-2c4a-493e-bf33-737f7db29333 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-25f57c1c-6995-4815-b489-92d96678e344" returned: 0 in 0.658s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:27:18 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-9d7e93f0-2c4a-493e-bf33-737f7db29333 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] <== create_volume: return (1598ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:27:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-9d7e93f0-2c4a-493e-bf33-737f7db29333 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.600s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:27:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-d7a0e5cd-2f6e-4481-be30-2337a600a786 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.248s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:27:18 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-d7a0e5cd-2f6e-4481-be30-2337a600a786 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:27:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-742646966',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fd3fd07-bbb4-4707-819e-f80844ca0da5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0bc2c4f910c4d33b53f1b64569f286b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:17Z,use_quota=True,user_id='292664e5914c4829a3dda24837301a07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:27:18 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-d7a0e5cd-2f6e-4481-be30-2337a600a786 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Creating volume 0fd3fd07-bbb4-4707-819e-f80844ca0da5 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:27:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-d7a0e5cd-2f6e-4481-be30-2337a600a786 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:27:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-d7a0e5cd-2f6e-4481-be30-2337a600a786 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:27:18 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-d7a0e5cd-2f6e-4481-be30-2337a600a786 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:27:18 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-d7a0e5cd-2f6e-4481-be30-2337a600a786 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:27:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-d7a0e5cd-2f6e-4481-be30-2337a600a786 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:27:18 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-d7a0e5cd-2f6e-4481-be30-2337a600a786 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:27:18 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-d7a0e5cd-2f6e-4481-be30-2337a600a786 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:27:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d7a0e5cd-2f6e-4481-be30-2337a600a786 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0fd3fd07-bbb4-4707-819e-f80844ca0da5 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:27:18 devstack sudo[105912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0fd3fd07-bbb4-4707-819e-f80844ca0da5 1073741824
Jul 03 01:27:18 devstack sudo[105912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:27:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-9d7e93f0-2c4a-493e-bf33-737f7db29333 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc2ce154-02ce-4943-92d6-b40a960be911) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25f57c1c-6995-4815-b489-92d96678e344', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:27:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-9d7e93f0-2c4a-493e-bf33-737f7db29333 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10814d04-cde6-4928-a3e3-a6fab5ddb6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:27:18 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-9d7e93f0-2c4a-493e-bf33-737f7db29333 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Volume volume-25f57c1c-6995-4815-b489-92d96678e344 (25f57c1c-6995-4815-b489-92d96678e344): created successfully
Jul 03 01:27:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-9d7e93f0-2c4a-493e-bf33-737f7db29333 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10814d04-cde6-4928-a3e3-a6fab5ddb6a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:27:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-9d7e93f0-2c4a-493e-bf33-737f7db29333 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Flow 'volume_create_manager' (2a804ede-bae2-4181-a158-53821f109051) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:27:18 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-9d7e93f0-2c4a-493e-bf33-737f7db29333 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Created volume successfully.
Jul 03 01:27:19 devstack sudo[105912]: pam_unix(sudo:session): session closed for user root
Jul 03 01:27:19 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d7a0e5cd-2f6e-4481-be30-2337a600a786 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0fd3fd07-bbb4-4707-819e-f80844ca0da5 1073741824" returned: 0 in 0.817s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:27:19 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d7a0e5cd-2f6e-4481-be30-2337a600a786 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0fd3fd07-bbb4-4707-819e-f80844ca0da5 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:27:19 devstack sudo[105919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0fd3fd07-bbb4-4707-819e-f80844ca0da5
Jul 03 01:27:19 devstack sudo[105919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:27:20 devstack sudo[105919]: pam_unix(sudo:session): session closed for user root
Jul 03 01:27:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d7a0e5cd-2f6e-4481-be30-2337a600a786 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0fd3fd07-bbb4-4707-819e-f80844ca0da5" returned: 0 in 0.646s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:27:20 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-d7a0e5cd-2f6e-4481-be30-2337a600a786 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] <== create_volume: return (1500ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:27:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-d7a0e5cd-2f6e-4481-be30-2337a600a786 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.503s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:27:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f7d2bd5b-9b65-4fa0-94c5-60da4d2feaaf tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.356s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:27:20 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-f7d2bd5b-9b65-4fa0-94c5-60da4d2feaaf tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-817795627',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6124f5c0-8d15-4ed0-9bfa-47b5ac8cc04f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0bc2c4f910c4d33b53f1b64569f286b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:18Z,use_quota=True,user_id='292664e5914c4829a3dda24837301a07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:27:20 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-f7d2bd5b-9b65-4fa0-94c5-60da4d2feaaf tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Creating volume 6124f5c0-8d15-4ed0-9bfa-47b5ac8cc04f {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:27:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f7d2bd5b-9b65-4fa0-94c5-60da4d2feaaf tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:27:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f7d2bd5b-9b65-4fa0-94c5-60da4d2feaaf tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:27:20 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-f7d2bd5b-9b65-4fa0-94c5-60da4d2feaaf tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:27:20 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-f7d2bd5b-9b65-4fa0-94c5-60da4d2feaaf tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:27:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f7d2bd5b-9b65-4fa0-94c5-60da4d2feaaf tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:27:20 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-f7d2bd5b-9b65-4fa0-94c5-60da4d2feaaf tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:27:20 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-f7d2bd5b-9b65-4fa0-94c5-60da4d2feaaf tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:27:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f7d2bd5b-9b65-4fa0-94c5-60da4d2feaaf tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-6124f5c0-8d15-4ed0-9bfa-47b5ac8cc04f 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:27:20 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-d7a0e5cd-2f6e-4481-be30-2337a600a786 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d9adcc5-efa2-4d4a-8e9b-19705fe952b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fd3fd07-bbb4-4707-819e-f80844ca0da5', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:27:20 devstack sudo[105922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-6124f5c0-8d15-4ed0-9bfa-47b5ac8cc04f 1073741824
Jul 03 01:27:20 devstack sudo[105922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:27:20 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-d7a0e5cd-2f6e-4481-be30-2337a600a786 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (841b2b4c-4ca6-4d11-86f3-72839b7b31f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:27:20 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-d7a0e5cd-2f6e-4481-be30-2337a600a786 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Volume volume-0fd3fd07-bbb4-4707-819e-f80844ca0da5 (0fd3fd07-bbb4-4707-819e-f80844ca0da5): created successfully
Jul 03 01:27:20 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-d7a0e5cd-2f6e-4481-be30-2337a600a786 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (841b2b4c-4ca6-4d11-86f3-72839b7b31f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:27:20 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-d7a0e5cd-2f6e-4481-be30-2337a600a786 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Flow 'volume_create_manager' (0b664db4-b97b-4107-b687-4b38949002f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:27:20 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-d7a0e5cd-2f6e-4481-be30-2337a600a786 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Created volume successfully.
Jul 03 01:27:21 devstack sudo[105922]: pam_unix(sudo:session): session closed for user root
Jul 03 01:27:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f7d2bd5b-9b65-4fa0-94c5-60da4d2feaaf tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-6124f5c0-8d15-4ed0-9bfa-47b5ac8cc04f 1073741824" returned: 0 in 0.829s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:27:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f7d2bd5b-9b65-4fa0-94c5-60da4d2feaaf tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-6124f5c0-8d15-4ed0-9bfa-47b5ac8cc04f {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:27:21 devstack sudo[105929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-6124f5c0-8d15-4ed0-9bfa-47b5ac8cc04f
Jul 03 01:27:21 devstack sudo[105929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:27:21 devstack sudo[105929]: pam_unix(sudo:session): session closed for user root
Jul 03 01:27:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f7d2bd5b-9b65-4fa0-94c5-60da4d2feaaf tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-6124f5c0-8d15-4ed0-9bfa-47b5ac8cc04f" returned: 0 in 0.638s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:27:21 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-f7d2bd5b-9b65-4fa0-94c5-60da4d2feaaf tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] <== create_volume: return (1504ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:27:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f7d2bd5b-9b65-4fa0-94c5-60da4d2feaaf tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.507s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:27:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-012b3603-ea0d-4542-8cd0-6431a51d894c tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.498s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:27:21 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-012b3603-ea0d-4542-8cd0-6431a51d894c tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1506031043',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80035fed-b57f-4df0-a956-41d1e30453d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0bc2c4f910c4d33b53f1b64569f286b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:18Z,use_quota=True,user_id='292664e5914c4829a3dda24837301a07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:27:21 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-012b3603-ea0d-4542-8cd0-6431a51d894c tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Creating volume 80035fed-b57f-4df0-a956-41d1e30453d6 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:27:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-012b3603-ea0d-4542-8cd0-6431a51d894c tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:27:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-012b3603-ea0d-4542-8cd0-6431a51d894c tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:27:21 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-012b3603-ea0d-4542-8cd0-6431a51d894c tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:27:21 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-012b3603-ea0d-4542-8cd0-6431a51d894c tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:27:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-012b3603-ea0d-4542-8cd0-6431a51d894c tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:27:21 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-012b3603-ea0d-4542-8cd0-6431a51d894c tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:27:21 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-012b3603-ea0d-4542-8cd0-6431a51d894c tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:27:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-012b3603-ea0d-4542-8cd0-6431a51d894c tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-80035fed-b57f-4df0-a956-41d1e30453d6 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:27:21 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f7d2bd5b-9b65-4fa0-94c5-60da4d2feaaf tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (074c8b30-e0e6-4662-a600-303005142c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6124f5c0-8d15-4ed0-9bfa-47b5ac8cc04f', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:27:21 devstack sudo[105932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-80035fed-b57f-4df0-a956-41d1e30453d6 1073741824
Jul 03 01:27:21 devstack sudo[105932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:27:21 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f7d2bd5b-9b65-4fa0-94c5-60da4d2feaaf tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18ee35ce-2054-4549-bfd6-bd8b022c7275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:27:21 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-f7d2bd5b-9b65-4fa0-94c5-60da4d2feaaf tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Volume volume-6124f5c0-8d15-4ed0-9bfa-47b5ac8cc04f (6124f5c0-8d15-4ed0-9bfa-47b5ac8cc04f): created successfully
Jul 03 01:27:21 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f7d2bd5b-9b65-4fa0-94c5-60da4d2feaaf tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18ee35ce-2054-4549-bfd6-bd8b022c7275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:27:21 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f7d2bd5b-9b65-4fa0-94c5-60da4d2feaaf tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Flow 'volume_create_manager' (4a115370-f6d2-4764-a287-62094d69fbb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:27:21 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-f7d2bd5b-9b65-4fa0-94c5-60da4d2feaaf tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Created volume successfully.
Jul 03 01:27:22 devstack sudo[105932]: pam_unix(sudo:session): session closed for user root
Jul 03 01:27:22 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-012b3603-ea0d-4542-8cd0-6431a51d894c tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-80035fed-b57f-4df0-a956-41d1e30453d6 1073741824" returned: 0 in 0.800s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:27:22 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-012b3603-ea0d-4542-8cd0-6431a51d894c tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-80035fed-b57f-4df0-a956-41d1e30453d6 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:27:22 devstack sudo[105937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-80035fed-b57f-4df0-a956-41d1e30453d6
Jul 03 01:27:22 devstack sudo[105937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:27:23 devstack sudo[105937]: pam_unix(sudo:session): session closed for user root
Jul 03 01:27:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-012b3603-ea0d-4542-8cd0-6431a51d894c tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-80035fed-b57f-4df0-a956-41d1e30453d6" returned: 0 in 0.621s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:27:23 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-012b3603-ea0d-4542-8cd0-6431a51d894c tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] <== create_volume: return (1458ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:27:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-012b3603-ea0d-4542-8cd0-6431a51d894c tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.463s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:27:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-32c59781-9090-43ec-8ee6-ad539fa0bc99 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.618s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:27:23 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-32c59781-9090-43ec-8ee6-ad539fa0bc99 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1066485627',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3189aa5b-f7c3-477c-ba5d-b81edf58723d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0bc2c4f910c4d33b53f1b64569f286b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:19Z,use_quota=True,user_id='292664e5914c4829a3dda24837301a07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:27:23 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-32c59781-9090-43ec-8ee6-ad539fa0bc99 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Creating volume 3189aa5b-f7c3-477c-ba5d-b81edf58723d {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:27:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-32c59781-9090-43ec-8ee6-ad539fa0bc99 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:27:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-32c59781-9090-43ec-8ee6-ad539fa0bc99 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:27:23 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-32c59781-9090-43ec-8ee6-ad539fa0bc99 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:27:23 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-32c59781-9090-43ec-8ee6-ad539fa0bc99 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:27:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-32c59781-9090-43ec-8ee6-ad539fa0bc99 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:27:23 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-32c59781-9090-43ec-8ee6-ad539fa0bc99 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:27:23 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-32c59781-9090-43ec-8ee6-ad539fa0bc99 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:27:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-32c59781-9090-43ec-8ee6-ad539fa0bc99 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3189aa5b-f7c3-477c-ba5d-b81edf58723d 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:27:23 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-012b3603-ea0d-4542-8cd0-6431a51d894c tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01919c4c-b378-454e-b1e0-62d4c9a95715) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80035fed-b57f-4df0-a956-41d1e30453d6', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:27:23 devstack sudo[105940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3189aa5b-f7c3-477c-ba5d-b81edf58723d 1073741824
Jul 03 01:27:23 devstack sudo[105940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:27:23 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-012b3603-ea0d-4542-8cd0-6431a51d894c tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (150a561a-b6f7-42ea-81d8-5d41112f53d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:27:23 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-012b3603-ea0d-4542-8cd0-6431a51d894c tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Volume volume-80035fed-b57f-4df0-a956-41d1e30453d6 (80035fed-b57f-4df0-a956-41d1e30453d6): created successfully
Jul 03 01:27:23 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-012b3603-ea0d-4542-8cd0-6431a51d894c tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (150a561a-b6f7-42ea-81d8-5d41112f53d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:27:23 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-012b3603-ea0d-4542-8cd0-6431a51d894c tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Flow 'volume_create_manager' (7e6e2cfd-016b-4c36-9b35-70c80581f01c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:27:23 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-012b3603-ea0d-4542-8cd0-6431a51d894c tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Created volume successfully.
Jul 03 01:27:24 devstack sudo[105940]: pam_unix(sudo:session): session closed for user root
Jul 03 01:27:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-32c59781-9090-43ec-8ee6-ad539fa0bc99 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3189aa5b-f7c3-477c-ba5d-b81edf58723d 1073741824" returned: 0 in 0.799s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:27:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-32c59781-9090-43ec-8ee6-ad539fa0bc99 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3189aa5b-f7c3-477c-ba5d-b81edf58723d {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:27:24 devstack sudo[105945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3189aa5b-f7c3-477c-ba5d-b81edf58723d
Jul 03 01:27:24 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:27:24 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root
Jul 03 01:27:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-32c59781-9090-43ec-8ee6-ad539fa0bc99 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3189aa5b-f7c3-477c-ba5d-b81edf58723d" returned: 0 in 0.616s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:27:24 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-32c59781-9090-43ec-8ee6-ad539fa0bc99 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] <== create_volume: return (1452ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:27:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-32c59781-9090-43ec-8ee6-ad539fa0bc99 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.455s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:27:24 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-32c59781-9090-43ec-8ee6-ad539fa0bc99 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (070602af-7e72-4d97-b577-2ed44510c61f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3189aa5b-f7c3-477c-ba5d-b81edf58723d', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:27:24 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-32c59781-9090-43ec-8ee6-ad539fa0bc99 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dcb68aa-56cb-4bf4-86aa-9dbdd1621ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:27:24 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-32c59781-9090-43ec-8ee6-ad539fa0bc99 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Volume volume-3189aa5b-f7c3-477c-ba5d-b81edf58723d (3189aa5b-f7c3-477c-ba5d-b81edf58723d): created successfully
Jul 03 01:27:24 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-32c59781-9090-43ec-8ee6-ad539fa0bc99 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dcb68aa-56cb-4bf4-86aa-9dbdd1621ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:27:24 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-32c59781-9090-43ec-8ee6-ad539fa0bc99 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Flow 'volume_create_manager' (19597d42-fdda-47c1-8cfa-ee674cbec6e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:27:24 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-32c59781-9090-43ec-8ee6-ad539fa0bc99 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Created volume successfully.
Jul 03 01:27:25 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-17e82c3a-0721-4794-9883-fae358b4d09c tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Acquiring lock "cinder-3189aa5b-f7c3-477c-ba5d-b81edf58723d-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:27:25 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-17e82c3a-0721-4794-9883-fae358b4d09c tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Lock "cinder-3189aa5b-f7c3-477c-ba5d-b81edf58723d-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:27:25 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-17e82c3a-0721-4794-9883-fae358b4d09c tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Acquiring lock "cinder-quobyte-3189aa5b-f7c3-477c-ba5d-b81edf58723d" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:27:25 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-17e82c3a-0721-4794-9883-fae358b4d09c tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Lock "cinder-quobyte-3189aa5b-f7c3-477c-ba5d-b81edf58723d" acquired by "delete_volume" :: waited 0.015s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:27:25 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60664df-9fd1-4611-8280-9751cdd9f3fa]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:27:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-17e82c3a-0721-4794-9883-fae358b4d09c tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3189aa5b-f7c3-477c-ba5d-b81edf58723d {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:27:25 devstack sudo[105948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3189aa5b-f7c3-477c-ba5d-b81edf58723d
Jul 03 01:27:25 devstack sudo[105948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:27:25 devstack sudo[105948]: pam_unix(sudo:session): session closed for user root
Jul 03 01:27:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-17e82c3a-0721-4794-9883-fae358b4d09c tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3189aa5b-f7c3-477c-ba5d-b81edf58723d" returned: 0 in 0.728s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:27:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-17e82c3a-0721-4794-9883-fae358b4d09c tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3189aa5b-f7c3-477c-ba5d-b81edf58723d {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:27:25 devstack sudo[105953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3189aa5b-f7c3-477c-ba5d-b81edf58723d
Jul 03 01:27:25 devstack sudo[105953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:27:26 devstack sudo[105953]: pam_unix(sudo:session): session closed for user root
Jul 03 01:27:26 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-17e82c3a-0721-4794-9883-fae358b4d09c tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3189aa5b-f7c3-477c-ba5d-b81edf58723d" returned: 0 in 0.613s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:27:26 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-17e82c3a-0721-4794-9883-fae358b4d09c tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Lock "cinder-quobyte-3189aa5b-f7c3-477c-ba5d-b81edf58723d" released by "delete_volume" :: held 1.377s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:27:26 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-17e82c3a-0721-4794-9883-fae358b4d09c tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Created reservations ['3b45df58-9ba5-43ca-b284-e2215f41060c', '07eea97c-5190-45d3-b572-4b115343ee7e', 'bcdbae25-e56a-4a1b-a3d2-2cfe7f8b55a8', '7ef5f9f8-ca9c-4d29-8b5e-9115fd2c4b89'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:27:26 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-17e82c3a-0721-4794-9883-fae358b4d09c tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:27:26 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-17e82c3a-0721-4794-9883-fae358b4d09c tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:27:26 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-17e82c3a-0721-4794-9883-fae358b4d09c tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:27:26 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-17e82c3a-0721-4794-9883-fae358b4d09c tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:27:26 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-17e82c3a-0721-4794-9883-fae358b4d09c tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:27:26 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-17e82c3a-0721-4794-9883-fae358b4d09c tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:27:26 devstack sudo[105956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:27:26 devstack sudo[105956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:27:27 devstack sudo[105956]: pam_unix(sudo:session): session closed for user root
Jul 03 01:27:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-17e82c3a-0721-4794-9883-fae358b4d09c tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.634s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:27:27 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-17e82c3a-0721-4794-9883-fae358b4d09c tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:27:27 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-17e82c3a-0721-4794-9883-fae358b4d09c tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Deleted volume successfully.
Jul 03 01:27:27 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-17e82c3a-0721-4794-9883-fae358b4d09c tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Lock "cinder-3189aa5b-f7c3-477c-ba5d-b81edf58723d-delete_volume" released by "delete_volume" :: held 2.196s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:27:27 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-463fb484-257a-4b02-9172-16fe621d8f22 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Acquiring lock "cinder-80035fed-b57f-4df0-a956-41d1e30453d6-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:27:27 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-463fb484-257a-4b02-9172-16fe621d8f22 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Lock "cinder-80035fed-b57f-4df0-a956-41d1e30453d6-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:27:27 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-463fb484-257a-4b02-9172-16fe621d8f22 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Acquiring lock "cinder-quobyte-80035fed-b57f-4df0-a956-41d1e30453d6" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:27:27 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-463fb484-257a-4b02-9172-16fe621d8f22 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Lock "cinder-quobyte-80035fed-b57f-4df0-a956-41d1e30453d6" acquired by "delete_volume" :: waited 0.016s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:27:27 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd151410-8606-4f56-95b3-c9f36b8ea6be]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:27:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-463fb484-257a-4b02-9172-16fe621d8f22 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-80035fed-b57f-4df0-a956-41d1e30453d6 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:27:27 devstack sudo[105959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-80035fed-b57f-4df0-a956-41d1e30453d6
Jul 03 01:27:27 devstack sudo[105959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:27:28 devstack sudo[105959]: pam_unix(sudo:session): session closed for user root
Jul 03 01:27:28 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-463fb484-257a-4b02-9172-16fe621d8f22 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-80035fed-b57f-4df0-a956-41d1e30453d6" returned: 0 in 0.769s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:27:28 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-463fb484-257a-4b02-9172-16fe621d8f22 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-80035fed-b57f-4df0-a956-41d1e30453d6 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:27:28 devstack sudo[105964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-80035fed-b57f-4df0-a956-41d1e30453d6
Jul 03 01:27:28 devstack sudo[105964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:27:28 devstack sudo[105964]: pam_unix(sudo:session): session closed for user root
Jul 03 01:27:28 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-463fb484-257a-4b02-9172-16fe621d8f22 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-80035fed-b57f-4df0-a956-41d1e30453d6" returned: 0 in 0.645s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:27:28 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-463fb484-257a-4b02-9172-16fe621d8f22 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Lock "cinder-quobyte-80035fed-b57f-4df0-a956-41d1e30453d6" released by "delete_volume" :: held 1.452s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:27:28 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-463fb484-257a-4b02-9172-16fe621d8f22 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Created reservations ['c885739d-fede-4387-b554-af33c61faed8', '7b29313c-cff7-4168-af70-825f1c2e1c7b', 'c85906f0-4f7b-4f09-b7ad-ff6bf12d51fb', '938ea88c-eaf7-494c-b822-b547d62554df'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:27:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-463fb484-257a-4b02-9172-16fe621d8f22 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:27:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-463fb484-257a-4b02-9172-16fe621d8f22 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:27:29 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-463fb484-257a-4b02-9172-16fe621d8f22 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:27:29 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-463fb484-257a-4b02-9172-16fe621d8f22 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:27:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-463fb484-257a-4b02-9172-16fe621d8f22 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:27:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-463fb484-257a-4b02-9172-16fe621d8f22 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:27:29 devstack sudo[105968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:27:29 devstack sudo[105968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:27:29 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-9d55fd09-6fb9-4d64-a409-c680481a0011 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Acquiring lock "cinder-6124f5c0-8d15-4ed0-9bfa-47b5ac8cc04f-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:27:29 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-9d55fd09-6fb9-4d64-a409-c680481a0011 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Lock "cinder-6124f5c0-8d15-4ed0-9bfa-47b5ac8cc04f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:27:29 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-9d55fd09-6fb9-4d64-a409-c680481a0011 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Acquiring lock "cinder-quobyte-6124f5c0-8d15-4ed0-9bfa-47b5ac8cc04f" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:27:29 devstack sudo[105968]: pam_unix(sudo:session): session closed for user root
Jul 03 01:27:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-463fb484-257a-4b02-9172-16fe621d8f22 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.691s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:27:29 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-463fb484-257a-4b02-9172-16fe621d8f22 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:27:29 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-9d55fd09-6fb9-4d64-a409-c680481a0011 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Lock "cinder-quobyte-6124f5c0-8d15-4ed0-9bfa-47b5ac8cc04f" acquired by "delete_volume" :: waited 0.023s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:27:29 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-463fb484-257a-4b02-9172-16fe621d8f22 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Deleted volume successfully.
Jul 03 01:27:29 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[c820e5b5-177b-4e8c-baf8-bd5a2c57b40b]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:27:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9d55fd09-6fb9-4d64-a409-c680481a0011 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-6124f5c0-8d15-4ed0-9bfa-47b5ac8cc04f {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:27:29 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-463fb484-257a-4b02-9172-16fe621d8f22 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Lock "cinder-80035fed-b57f-4df0-a956-41d1e30453d6-delete_volume" released by "delete_volume" :: held 2.354s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:27:29 devstack sudo[105971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-6124f5c0-8d15-4ed0-9bfa-47b5ac8cc04f
Jul 03 01:27:29 devstack sudo[105971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:27:30 devstack sudo[105971]: pam_unix(sudo:session): session closed for user root
Jul 03 01:27:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9d55fd09-6fb9-4d64-a409-c680481a0011 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-6124f5c0-8d15-4ed0-9bfa-47b5ac8cc04f" returned: 0 in 0.737s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:27:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9d55fd09-6fb9-4d64-a409-c680481a0011 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-6124f5c0-8d15-4ed0-9bfa-47b5ac8cc04f {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:27:30 devstack sudo[105976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-6124f5c0-8d15-4ed0-9bfa-47b5ac8cc04f
Jul 03 01:27:30 devstack sudo[105976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:27:31 devstack sudo[105976]: pam_unix(sudo:session): session closed for user root
Jul 03 01:27:31 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9d55fd09-6fb9-4d64-a409-c680481a0011 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-6124f5c0-8d15-4ed0-9bfa-47b5ac8cc04f" returned: 0 in 0.664s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:27:31 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-9d55fd09-6fb9-4d64-a409-c680481a0011 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Lock "cinder-quobyte-6124f5c0-8d15-4ed0-9bfa-47b5ac8cc04f" released by "delete_volume" :: held 1.444s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:27:31 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-9d55fd09-6fb9-4d64-a409-c680481a0011 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Created reservations ['2d93950b-0980-45ef-877f-64354d3ab116', 'b7d27fdb-a8b5-48d6-b25b-625909b2f42d', 'ccad53f0-e794-4ff7-873c-e8198227e46e', 'f452be9b-3a4c-46bc-b0a4-215be667ddc5'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:27:31 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-9d55fd09-6fb9-4d64-a409-c680481a0011 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:27:31 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-9d55fd09-6fb9-4d64-a409-c680481a0011 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:27:31 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-9d55fd09-6fb9-4d64-a409-c680481a0011 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:27:31 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-9d55fd09-6fb9-4d64-a409-c680481a0011 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:27:31 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-9d55fd09-6fb9-4d64-a409-c680481a0011 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:27:31 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9d55fd09-6fb9-4d64-a409-c680481a0011 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:27:31 devstack sudo[105979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:27:31 devstack sudo[105979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:27:31 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-650965b4-56b4-4543-90bd-69a30dd33ede tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Acquiring lock "cinder-0fd3fd07-bbb4-4707-819e-f80844ca0da5-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:27:31 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-650965b4-56b4-4543-90bd-69a30dd33ede tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Lock "cinder-0fd3fd07-bbb4-4707-819e-f80844ca0da5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:27:31 devstack sudo[105979]: pam_unix(sudo:session): session closed for user root
Jul 03 01:27:31 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9d55fd09-6fb9-4d64-a409-c680481a0011 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.644s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:27:31 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-9d55fd09-6fb9-4d64-a409-c680481a0011 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:27:31 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-9d55fd09-6fb9-4d64-a409-c680481a0011 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Deleted volume successfully.
Jul 03 01:27:31 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-650965b4-56b4-4543-90bd-69a30dd33ede tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Acquiring lock "cinder-quobyte-0fd3fd07-bbb4-4707-819e-f80844ca0da5" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:27:31 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-9d55fd09-6fb9-4d64-a409-c680481a0011 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Lock "cinder-6124f5c0-8d15-4ed0-9bfa-47b5ac8cc04f-delete_volume" released by "delete_volume" :: held 2.293s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:27:31 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-650965b4-56b4-4543-90bd-69a30dd33ede tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Lock "cinder-quobyte-0fd3fd07-bbb4-4707-819e-f80844ca0da5" acquired by "delete_volume" :: waited 0.022s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:27:31 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b90d272-9300-47d4-af15-a5462d4c899c]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:27:31 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-650965b4-56b4-4543-90bd-69a30dd33ede tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0fd3fd07-bbb4-4707-819e-f80844ca0da5 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:27:32 devstack sudo[105982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0fd3fd07-bbb4-4707-819e-f80844ca0da5
Jul 03 01:27:32 devstack sudo[105982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:27:32 devstack sudo[105982]: pam_unix(sudo:session): session closed for user root
Jul 03 01:27:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-650965b4-56b4-4543-90bd-69a30dd33ede tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0fd3fd07-bbb4-4707-819e-f80844ca0da5" returned: 0 in 0.731s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:27:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-650965b4-56b4-4543-90bd-69a30dd33ede tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0fd3fd07-bbb4-4707-819e-f80844ca0da5 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:27:32 devstack sudo[105987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0fd3fd07-bbb4-4707-819e-f80844ca0da5
Jul 03 01:27:32 devstack sudo[105987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:27:33 devstack sudo[105987]: pam_unix(sudo:session): session closed for user root
Jul 03 01:27:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-650965b4-56b4-4543-90bd-69a30dd33ede tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0fd3fd07-bbb4-4707-819e-f80844ca0da5" returned: 0 in 0.624s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:27:33 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-650965b4-56b4-4543-90bd-69a30dd33ede tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Lock "cinder-quobyte-0fd3fd07-bbb4-4707-819e-f80844ca0da5" released by "delete_volume" :: held 1.392s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:27:33 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-650965b4-56b4-4543-90bd-69a30dd33ede tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Created reservations ['184b3c78-5d6c-403d-9e32-70fce92156b2', 'd2f65941-ca83-4d71-a765-2bae7cdfb979', '812ef4de-6713-4e58-8ba7-d87fff85d812', 'aec6e608-b10b-4b65-aca6-ec52a9d62dd8'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:27:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-650965b4-56b4-4543-90bd-69a30dd33ede tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:27:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-650965b4-56b4-4543-90bd-69a30dd33ede tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:27:33 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-650965b4-56b4-4543-90bd-69a30dd33ede tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:27:33 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-650965b4-56b4-4543-90bd-69a30dd33ede tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:27:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-650965b4-56b4-4543-90bd-69a30dd33ede tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:27:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-650965b4-56b4-4543-90bd-69a30dd33ede tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:27:33 devstack sudo[105990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:27:33 devstack sudo[105990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:27:34 devstack sudo[105990]: pam_unix(sudo:session): session closed for user root
Jul 03 01:27:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-650965b4-56b4-4543-90bd-69a30dd33ede tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.622s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:27:34 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-650965b4-56b4-4543-90bd-69a30dd33ede tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:27:34 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-650965b4-56b4-4543-90bd-69a30dd33ede tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Deleted volume successfully.
Jul 03 01:27:34 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-650965b4-56b4-4543-90bd-69a30dd33ede tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Lock "cinder-0fd3fd07-bbb4-4707-819e-f80844ca0da5-delete_volume" released by "delete_volume" :: held 2.210s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:27:34 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d2346cb0-be3f-4b85-beea-1f06a74e05b9 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Acquiring lock "cinder-25f57c1c-6995-4815-b489-92d96678e344-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:27:34 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d2346cb0-be3f-4b85-beea-1f06a74e05b9 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Lock "cinder-25f57c1c-6995-4815-b489-92d96678e344-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:27:34 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d2346cb0-be3f-4b85-beea-1f06a74e05b9 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Acquiring lock "cinder-quobyte-25f57c1c-6995-4815-b489-92d96678e344" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:27:34 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d2346cb0-be3f-4b85-beea-1f06a74e05b9 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Lock "cinder-quobyte-25f57c1c-6995-4815-b489-92d96678e344" acquired by "delete_volume" :: waited 0.014s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:27:34 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec09575b-36a9-4f38-af9a-ab4fb28ed4ae]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:27:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d2346cb0-be3f-4b85-beea-1f06a74e05b9 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-25f57c1c-6995-4815-b489-92d96678e344 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:27:34 devstack sudo[106029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-25f57c1c-6995-4815-b489-92d96678e344
Jul 03 01:27:34 devstack sudo[106029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:27:34 devstack sudo[106029]: pam_unix(sudo:session): session closed for user root
Jul 03 01:27:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d2346cb0-be3f-4b85-beea-1f06a74e05b9 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-25f57c1c-6995-4815-b489-92d96678e344" returned: 0 in 0.708s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:27:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d2346cb0-be3f-4b85-beea-1f06a74e05b9 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-25f57c1c-6995-4815-b489-92d96678e344 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:27:34 devstack sudo[106034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-25f57c1c-6995-4815-b489-92d96678e344
Jul 03 01:27:34 devstack sudo[106034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:27:35 devstack sudo[106034]: pam_unix(sudo:session): session closed for user root
Jul 03 01:27:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d2346cb0-be3f-4b85-beea-1f06a74e05b9 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-25f57c1c-6995-4815-b489-92d96678e344" returned: 0 in 0.617s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:27:35 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d2346cb0-be3f-4b85-beea-1f06a74e05b9 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Lock "cinder-quobyte-25f57c1c-6995-4815-b489-92d96678e344" released by "delete_volume" :: held 1.366s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:27:35 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-d2346cb0-be3f-4b85-beea-1f06a74e05b9 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Created reservations ['8c392599-8967-46b4-8d89-1c2292e95814', '9c96f4f0-02f5-4c87-b292-42a53d0b3fef', 'edc61d6a-7ff8-4f9a-a8e2-ffd62db418a8', '87bc1c25-a918-40a8-bfa0-facb8103f497'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:27:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-d2346cb0-be3f-4b85-beea-1f06a74e05b9 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:27:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-d2346cb0-be3f-4b85-beea-1f06a74e05b9 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:27:35 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-d2346cb0-be3f-4b85-beea-1f06a74e05b9 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:27:35 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-d2346cb0-be3f-4b85-beea-1f06a74e05b9 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:27:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-d2346cb0-be3f-4b85-beea-1f06a74e05b9 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:27:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d2346cb0-be3f-4b85-beea-1f06a74e05b9 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:27:35 devstack sudo[106037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:27:35 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:27:36 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root
Jul 03 01:27:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d2346cb0-be3f-4b85-beea-1f06a74e05b9 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.677s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:27:36 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-d2346cb0-be3f-4b85-beea-1f06a74e05b9 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:27:36 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-4febf6f5-0371-4c40-822b-6bbbcba61b44 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Acquiring lock "cinder-bbd58b04-5810-4d34-b89b-63d02ce2885e-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:27:36 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-d2346cb0-be3f-4b85-beea-1f06a74e05b9 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Deleted volume successfully.
Jul 03 01:27:36 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-4febf6f5-0371-4c40-822b-6bbbcba61b44 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Lock "cinder-bbd58b04-5810-4d34-b89b-63d02ce2885e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:27:36 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d2346cb0-be3f-4b85-beea-1f06a74e05b9 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Lock "cinder-25f57c1c-6995-4815-b489-92d96678e344-delete_volume" released by "delete_volume" :: held 2.242s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:27:36 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-4febf6f5-0371-4c40-822b-6bbbcba61b44 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Acquiring lock "cinder-quobyte-bbd58b04-5810-4d34-b89b-63d02ce2885e" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:27:36 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-4febf6f5-0371-4c40-822b-6bbbcba61b44 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Lock "cinder-quobyte-bbd58b04-5810-4d34-b89b-63d02ce2885e" acquired by "delete_volume" :: waited 0.014s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:27:36 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb39e29-20fb-40c9-943d-dbd0c5f9bd82]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:27:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-4febf6f5-0371-4c40-822b-6bbbcba61b44 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-bbd58b04-5810-4d34-b89b-63d02ce2885e {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:27:36 devstack sudo[106040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-bbd58b04-5810-4d34-b89b-63d02ce2885e
Jul 03 01:27:36 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:27:37 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root
Jul 03 01:27:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-4febf6f5-0371-4c40-822b-6bbbcba61b44 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-bbd58b04-5810-4d34-b89b-63d02ce2885e" returned: 0 in 0.770s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:27:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-4febf6f5-0371-4c40-822b-6bbbcba61b44 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-bbd58b04-5810-4d34-b89b-63d02ce2885e {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:27:37 devstack sudo[106045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-bbd58b04-5810-4d34-b89b-63d02ce2885e
Jul 03 01:27:37 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:27:37 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root
Jul 03 01:27:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-4febf6f5-0371-4c40-822b-6bbbcba61b44 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-bbd58b04-5810-4d34-b89b-63d02ce2885e" returned: 0 in 0.682s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:27:37 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-4febf6f5-0371-4c40-822b-6bbbcba61b44 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Lock "cinder-quobyte-bbd58b04-5810-4d34-b89b-63d02ce2885e" released by "delete_volume" :: held 1.489s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:27:37 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-4febf6f5-0371-4c40-822b-6bbbcba61b44 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Created reservations ['13788e7f-04eb-4a8a-a771-a3bfced476aa', '5918e8dc-e076-4b3b-9837-c071b9c41ab7', '2ebff939-161d-44cb-b9cb-c7691e5805df', 'c5acaea7-7595-4ea4-9b10-d074cc7b56fc'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:27:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-4febf6f5-0371-4c40-822b-6bbbcba61b44 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:27:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-4febf6f5-0371-4c40-822b-6bbbcba61b44 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:27:38 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-4febf6f5-0371-4c40-822b-6bbbcba61b44 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:27:38 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-4febf6f5-0371-4c40-822b-6bbbcba61b44 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:27:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-4febf6f5-0371-4c40-822b-6bbbcba61b44 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:27:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-4febf6f5-0371-4c40-822b-6bbbcba61b44 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:27:38 devstack sudo[106049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:27:38 devstack sudo[106049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:27:38 devstack sudo[106049]: pam_unix(sudo:session): session closed for user root
Jul 03 01:27:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-4febf6f5-0371-4c40-822b-6bbbcba61b44 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.664s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:27:38 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-4febf6f5-0371-4c40-822b-6bbbcba61b44 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:27:38 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-4febf6f5-0371-4c40-822b-6bbbcba61b44 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Deleted volume successfully.
Jul 03 01:27:38 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-4febf6f5-0371-4c40-822b-6bbbcba61b44 tempest-CreateVolumesFromSourceVolumeTest-1573160676 None] Lock "cinder-bbd58b04-5810-4d34-b89b-63d02ce2885e-delete_volume" released by "delete_volume" :: held 2.388s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:27:41 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-e755b5ce-3d96-44a8-811d-258504a4d5af tempest-VolumeDependencyTests-680812086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:27:41 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e755b5ce-3d96-44a8-811d-258504a4d5af tempest-VolumeDependencyTests-680812086 None] Flow 'volume_create_manager' (ac4f4481-fd97-4eaa-a206-76e805aafa22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:27:41 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e755b5ce-3d96-44a8-811d-258504a4d5af tempest-VolumeDependencyTests-680812086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffc75f2c-73b1-400a-a900-b1f2d2b72488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:27:41 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e755b5ce-3d96-44a8-811d-258504a4d5af tempest-VolumeDependencyTests-680812086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffc75f2c-73b1-400a-a900-b1f2d2b72488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:27:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1662280779',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=943ee80d-283f-4c6a-b28c-26e72c4dbf6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea85d90645e6446a9dbcf5dc9ed810f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:41Z,use_quota=True,user_id='616b1671001c4a7a833a22f27d00d617',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:27:41 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e755b5ce-3d96-44a8-811d-258504a4d5af tempest-VolumeDependencyTests-680812086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29d6fe46-c435-4dc1-a5f6-8e0124c9a236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:27:41 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e755b5ce-3d96-44a8-811d-258504a4d5af tempest-VolumeDependencyTests-680812086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29d6fe46-c435-4dc1-a5f6-8e0124c9a236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:27:41 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e755b5ce-3d96-44a8-811d-258504a4d5af tempest-VolumeDependencyTests-680812086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (609fe705-a6c4-4129-862e-a5c8ef47f1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:27:41 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e755b5ce-3d96-44a8-811d-258504a4d5af tempest-VolumeDependencyTests-680812086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (609fe705-a6c4-4129-862e-a5c8ef47f1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '943ee80d-283f-4c6a-b28c-26e72c4dbf6c', 'volume_name': 'volume-943ee80d-283f-4c6a-b28c-26e72c4dbf6c', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:27:41 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e755b5ce-3d96-44a8-811d-258504a4d5af tempest-VolumeDependencyTests-680812086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf32fee6-c7f5-4167-ae8a-f661f12a6553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:27:41 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e755b5ce-3d96-44a8-811d-258504a4d5af tempest-VolumeDependencyTests-680812086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf32fee6-c7f5-4167-ae8a-f661f12a6553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:27:41 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e755b5ce-3d96-44a8-811d-258504a4d5af tempest-VolumeDependencyTests-680812086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8590d3fa-fbe6-4a4c-b6d8-2b80f824aa3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:27:41 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-e755b5ce-3d96-44a8-811d-258504a4d5af tempest-VolumeDependencyTests-680812086 None] Volume 943ee80d-283f-4c6a-b28c-26e72c4dbf6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-943ee80d-283f-4c6a-b28c-26e72c4dbf6c', 'volume_size': 1}
Jul 03 01:27:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e755b5ce-3d96-44a8-811d-258504a4d5af tempest-VolumeDependencyTests-680812086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:27:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e755b5ce-3d96-44a8-811d-258504a4d5af tempest-VolumeDependencyTests-680812086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:27:41 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-e755b5ce-3d96-44a8-811d-258504a4d5af tempest-VolumeDependencyTests-680812086 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:27:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1662280779',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=943ee80d-283f-4c6a-b28c-26e72c4dbf6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea85d90645e6446a9dbcf5dc9ed810f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:41Z,use_quota=True,user_id='616b1671001c4a7a833a22f27d00d617',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:27:41 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-e755b5ce-3d96-44a8-811d-258504a4d5af tempest-VolumeDependencyTests-680812086 None] Creating volume 943ee80d-283f-4c6a-b28c-26e72c4dbf6c {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:27:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e755b5ce-3d96-44a8-811d-258504a4d5af tempest-VolumeDependencyTests-680812086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:27:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e755b5ce-3d96-44a8-811d-258504a4d5af tempest-VolumeDependencyTests-680812086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:27:41 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-e755b5ce-3d96-44a8-811d-258504a4d5af tempest-VolumeDependencyTests-680812086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:27:41 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-e755b5ce-3d96-44a8-811d-258504a4d5af tempest-VolumeDependencyTests-680812086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:27:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e755b5ce-3d96-44a8-811d-258504a4d5af tempest-VolumeDependencyTests-680812086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:27:41 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-e755b5ce-3d96-44a8-811d-258504a4d5af tempest-VolumeDependencyTests-680812086 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:27:41 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-e755b5ce-3d96-44a8-811d-258504a4d5af tempest-VolumeDependencyTests-680812086 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:27:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e755b5ce-3d96-44a8-811d-258504a4d5af tempest-VolumeDependencyTests-680812086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-943ee80d-283f-4c6a-b28c-26e72c4dbf6c 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:27:41 devstack sudo[106060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-943ee80d-283f-4c6a-b28c-26e72c4dbf6c 1073741824
Jul 03 01:27:41 devstack sudo[106060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:27:42 devstack sudo[106060]: pam_unix(sudo:session): session closed for user root
Jul 03 01:27:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e755b5ce-3d96-44a8-811d-258504a4d5af tempest-VolumeDependencyTests-680812086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-943ee80d-283f-4c6a-b28c-26e72c4dbf6c 1073741824" returned: 0 in 0.767s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:27:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e755b5ce-3d96-44a8-811d-258504a4d5af tempest-VolumeDependencyTests-680812086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-943ee80d-283f-4c6a-b28c-26e72c4dbf6c {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:27:42 devstack sudo[106066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-943ee80d-283f-4c6a-b28c-26e72c4dbf6c
Jul 03 01:27:42 devstack sudo[106066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:27:42 devstack sudo[106066]: pam_unix(sudo:session): session closed for user root
Jul 03 01:27:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e755b5ce-3d96-44a8-811d-258504a4d5af tempest-VolumeDependencyTests-680812086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-943ee80d-283f-4c6a-b28c-26e72c4dbf6c" returned: 0 in 0.633s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:27:42 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-e755b5ce-3d96-44a8-811d-258504a4d5af tempest-VolumeDependencyTests-680812086 None] <== create_volume: return (1441ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:27:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e755b5ce-3d96-44a8-811d-258504a4d5af tempest-VolumeDependencyTests-680812086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.443s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:27:42 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e755b5ce-3d96-44a8-811d-258504a4d5af tempest-VolumeDependencyTests-680812086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8590d3fa-fbe6-4a4c-b6d8-2b80f824aa3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-943ee80d-283f-4c6a-b28c-26e72c4dbf6c', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:27:42 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e755b5ce-3d96-44a8-811d-258504a4d5af tempest-VolumeDependencyTests-680812086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d329976f-f4a5-4cd3-8a76-f3233a20dec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:27:42 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-e755b5ce-3d96-44a8-811d-258504a4d5af tempest-VolumeDependencyTests-680812086 None] Volume volume-943ee80d-283f-4c6a-b28c-26e72c4dbf6c (943ee80d-283f-4c6a-b28c-26e72c4dbf6c): created successfully
Jul 03 01:27:42 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e755b5ce-3d96-44a8-811d-258504a4d5af tempest-VolumeDependencyTests-680812086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d329976f-f4a5-4cd3-8a76-f3233a20dec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:27:42 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e755b5ce-3d96-44a8-811d-258504a4d5af tempest-VolumeDependencyTests-680812086 None] Flow 'volume_create_manager' (ac4f4481-fd97-4eaa-a206-76e805aafa22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:27:42 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-e755b5ce-3d96-44a8-811d-258504a4d5af tempest-VolumeDependencyTests-680812086 None] Created volume successfully.
Jul 03 01:27:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f1f61e7a-cfac-42c0-adc9-42cf8be28819 tempest-VolumeDependencyTests-680812086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:27:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f1f61e7a-cfac-42c0-adc9-42cf8be28819 tempest-VolumeDependencyTests-680812086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:27:43 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-f1f61e7a-cfac-42c0-adc9-42cf8be28819 tempest-VolumeDependencyTests-680812086 None] Creating offline snapshot 1593355c-e142-4b9d-b327-79882337615a of volume 943ee80d-283f-4c6a-b28c-26e72c4dbf6c {{(pid=86891) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 01:27:43 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[15562cde-d3e7-4415-bf59-a008e221fe3a]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:27:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f1f61e7a-cfac-42c0-adc9-42cf8be28819 tempest-VolumeDependencyTests-680812086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-943ee80d-283f-4c6a-b28c-26e72c4dbf6c {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:27:43 devstack sudo[106069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-943ee80d-283f-4c6a-b28c-26e72c4dbf6c
Jul 03 01:27:43 devstack sudo[106069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:27:44 devstack sudo[106069]: pam_unix(sudo:session): session closed for user root
Jul 03 01:27:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f1f61e7a-cfac-42c0-adc9-42cf8be28819 tempest-VolumeDependencyTests-680812086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-943ee80d-283f-4c6a-b28c-26e72c4dbf6c" returned: 0 in 0.726s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:27:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f1f61e7a-cfac-42c0-adc9-42cf8be28819 tempest-VolumeDependencyTests-680812086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-943ee80d-283f-4c6a-b28c-26e72c4dbf6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-943ee80d-283f-4c6a-b28c-26e72c4dbf6c.1593355c-e142-4b9d-b327-79882337615a 1G {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:27:44 devstack sudo[106074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-943ee80d-283f-4c6a-b28c-26e72c4dbf6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-943ee80d-283f-4c6a-b28c-26e72c4dbf6c.1593355c-e142-4b9d-b327-79882337615a 1G
Jul 03 01:27:44 devstack sudo[106074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:27:44 devstack sudo[106074]: pam_unix(sudo:session): session closed for user root
Jul 03 01:27:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f1f61e7a-cfac-42c0-adc9-42cf8be28819 tempest-VolumeDependencyTests-680812086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-943ee80d-283f-4c6a-b28c-26e72c4dbf6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-943ee80d-283f-4c6a-b28c-26e72c4dbf6c.1593355c-e142-4b9d-b327-79882337615a 1G" returned: 0 in 0.774s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:27:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f1f61e7a-cfac-42c0-adc9-42cf8be28819 tempest-VolumeDependencyTests-680812086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-943ee80d-283f-4c6a-b28c-26e72c4dbf6c -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-943ee80d-283f-4c6a-b28c-26e72c4dbf6c.1593355c-e142-4b9d-b327-79882337615a {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:27:44 devstack sudo[106080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-943ee80d-283f-4c6a-b28c-26e72c4dbf6c -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-943ee80d-283f-4c6a-b28c-26e72c4dbf6c.1593355c-e142-4b9d-b327-79882337615a
Jul 03 01:27:44 devstack sudo[106080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:27:45 devstack sudo[106080]: pam_unix(sudo:session): session closed for user root
Jul 03 01:27:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f1f61e7a-cfac-42c0-adc9-42cf8be28819 tempest-VolumeDependencyTests-680812086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-943ee80d-283f-4c6a-b28c-26e72c4dbf6c -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-943ee80d-283f-4c6a-b28c-26e72c4dbf6c.1593355c-e142-4b9d-b327-79882337615a" returned: 0 in 0.670s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:27:45 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-f1f61e7a-cfac-42c0-adc9-42cf8be28819 tempest-VolumeDependencyTests-680812086 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-943ee80d-283f-4c6a-b28c-26e72c4dbf6c.1593355c-e142-4b9d-b327-79882337615a is being set with open permissions: ugo+rw
Jul 03 01:27:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f1f61e7a-cfac-42c0-adc9-42cf8be28819 tempest-VolumeDependencyTests-680812086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-943ee80d-283f-4c6a-b28c-26e72c4dbf6c.1593355c-e142-4b9d-b327-79882337615a {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:27:45 devstack sudo[106085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-943ee80d-283f-4c6a-b28c-26e72c4dbf6c.1593355c-e142-4b9d-b327-79882337615a
Jul 03 01:27:45 devstack sudo[106085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:27:46 devstack sudo[106085]: pam_unix(sudo:session): session closed for user root
Jul 03 01:27:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f1f61e7a-cfac-42c0-adc9-42cf8be28819 tempest-VolumeDependencyTests-680812086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-943ee80d-283f-4c6a-b28c-26e72c4dbf6c.1593355c-e142-4b9d-b327-79882337615a" returned: 0 in 0.597s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:27:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f1f61e7a-cfac-42c0-adc9-42cf8be28819 tempest-VolumeDependencyTests-680812086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-943ee80d-283f-4c6a-b28c-26e72c4dbf6c.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:27:46 devstack sudo[106088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-943ee80d-283f-4c6a-b28c-26e72c4dbf6c.info
Jul 03 01:27:46 devstack sudo[106088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:27:46 devstack sudo[106088]: pam_unix(sudo:session): session closed for user root
Jul 03 01:27:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f1f61e7a-cfac-42c0-adc9-42cf8be28819 tempest-VolumeDependencyTests-680812086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-943ee80d-283f-4c6a-b28c-26e72c4dbf6c.info" returned: 0 in 0.645s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:27:46 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-f1f61e7a-cfac-42c0-adc9-42cf8be28819 tempest-VolumeDependencyTests-680812086 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-943ee80d-283f-4c6a-b28c-26e72c4dbf6c.info is being set with open permissions: ugo+rw
Jul 03 01:27:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f1f61e7a-cfac-42c0-adc9-42cf8be28819 tempest-VolumeDependencyTests-680812086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-943ee80d-283f-4c6a-b28c-26e72c4dbf6c.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:27:46 devstack sudo[106091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-943ee80d-283f-4c6a-b28c-26e72c4dbf6c.info
Jul 03 01:27:46 devstack sudo[106091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:27:47 devstack sudo[106091]: pam_unix(sudo:session): session closed for user root
Jul 03 01:27:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f1f61e7a-cfac-42c0-adc9-42cf8be28819 tempest-VolumeDependencyTests-680812086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-943ee80d-283f-4c6a-b28c-26e72c4dbf6c.info" returned: 0 in 0.606s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:27:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f1f61e7a-cfac-42c0-adc9-42cf8be28819 tempest-VolumeDependencyTests-680812086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.102s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:27:47 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-f1f61e7a-cfac-42c0-adc9-42cf8be28819 tempest-VolumeDependencyTests-680812086 None] Create snapshot completed successfully
Jul 03 01:27:49 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fa26e0f-b04f-4541-863c-47d79c57551c tempest-VolumeDependencyTests-680812086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:27:49 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1fa26e0f-b04f-4541-863c-47d79c57551c tempest-VolumeDependencyTests-680812086 None] Flow 'volume_create_manager' (d7b99b5a-ef7d-40cd-bcbd-1dccac389819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:27:49 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1fa26e0f-b04f-4541-863c-47d79c57551c tempest-VolumeDependencyTests-680812086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49d297c0-7ec1-4c9d-b074-e3f34748ceb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:27:49 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1fa26e0f-b04f-4541-863c-47d79c57551c tempest-VolumeDependencyTests-680812086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49d297c0-7ec1-4c9d-b074-e3f34748ceb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:27:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-4488676',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9caba0ab-1b65-4ea8-84fa-c7da589757ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea85d90645e6446a9dbcf5dc9ed810f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1593355c-e142-4b9d-b327-79882337615a,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:49Z,use_quota=True,user_id='616b1671001c4a7a833a22f27d00d617',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:27:49 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1fa26e0f-b04f-4541-863c-47d79c57551c tempest-VolumeDependencyTests-680812086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e862e5a-e454-42ff-abc3-6207eb362ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:27:49 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1fa26e0f-b04f-4541-863c-47d79c57551c tempest-VolumeDependencyTests-680812086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e862e5a-e454-42ff-abc3-6207eb362ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:27:49 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1fa26e0f-b04f-4541-863c-47d79c57551c tempest-VolumeDependencyTests-680812086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37824085-f0a4-486b-a31f-c3a8259e6127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:27:49 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1fa26e0f-b04f-4541-863c-47d79c57551c tempest-VolumeDependencyTests-680812086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37824085-f0a4-486b-a31f-c3a8259e6127) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9caba0ab-1b65-4ea8-84fa-c7da589757ff', 'volume_name': 'volume-9caba0ab-1b65-4ea8-84fa-c7da589757ff', 'volume_size': 1, 'snapshot_id': '1593355c-e142-4b9d-b327-79882337615a'}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:27:49 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1fa26e0f-b04f-4541-863c-47d79c57551c tempest-VolumeDependencyTests-680812086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e25fbc2f-7eb1-4d7e-a6bb-c13088978be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:27:49 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1fa26e0f-b04f-4541-863c-47d79c57551c tempest-VolumeDependencyTests-680812086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e25fbc2f-7eb1-4d7e-a6bb-c13088978be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:27:49 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1fa26e0f-b04f-4541-863c-47d79c57551c tempest-VolumeDependencyTests-680812086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2c5abd3-2b20-4e61-a40e-861b62b4715c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:27:49 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-1fa26e0f-b04f-4541-863c-47d79c57551c tempest-VolumeDependencyTests-680812086 None] Volume 9caba0ab-1b65-4ea8-84fa-c7da589757ff: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9caba0ab-1b65-4ea8-84fa-c7da589757ff', 'volume_size': 1, 'snapshot_id': '1593355c-e142-4b9d-b327-79882337615a'}
Jul 03 01:27:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1fa26e0f-b04f-4541-863c-47d79c57551c tempest-VolumeDependencyTests-680812086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:27:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1fa26e0f-b04f-4541-863c-47d79c57551c tempest-VolumeDependencyTests-680812086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:27:49 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-1fa26e0f-b04f-4541-863c-47d79c57551c tempest-VolumeDependencyTests-680812086 None] Acquiring lock "cinder-quobyte-1593355c-e142-4b9d-b327-79882337615a-9caba0ab-1b65-4ea8-84fa-c7da589757ff" by "_create_volume_from_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:27:49 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-1fa26e0f-b04f-4541-863c-47d79c57551c tempest-VolumeDependencyTests-680812086 None] Lock "cinder-quobyte-1593355c-e142-4b9d-b327-79882337615a-9caba0ab-1b65-4ea8-84fa-c7da589757ff" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:27:49 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-1fa26e0f-b04f-4541-863c-47d79c57551c tempest-VolumeDependencyTests-680812086 None] Creating volume 9caba0ab-1b65-4ea8-84fa-c7da589757ff from snapshot 1593355c-e142-4b9d-b327-79882337615a {{(pid=86891) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 03 01:27:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1fa26e0f-b04f-4541-863c-47d79c57551c tempest-VolumeDependencyTests-680812086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:27:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1fa26e0f-b04f-4541-863c-47d79c57551c tempest-VolumeDependencyTests-680812086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:27:49 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-1fa26e0f-b04f-4541-863c-47d79c57551c tempest-VolumeDependencyTests-680812086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:27:49 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-1fa26e0f-b04f-4541-863c-47d79c57551c tempest-VolumeDependencyTests-680812086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:27:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1fa26e0f-b04f-4541-863c-47d79c57551c tempest-VolumeDependencyTests-680812086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:27:49 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-1fa26e0f-b04f-4541-863c-47d79c57551c tempest-VolumeDependencyTests-680812086 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:27:49 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-1fa26e0f-b04f-4541-863c-47d79c57551c tempest-VolumeDependencyTests-680812086 None] Acquiring lock "cinder-quobyte-9caba0ab-1b65-4ea8-84fa-c7da589757ff" by "_copy_volume_from_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:27:49 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-1fa26e0f-b04f-4541-863c-47d79c57551c tempest-VolumeDependencyTests-680812086 None] Lock "cinder-quobyte-9caba0ab-1b65-4ea8-84fa-c7da589757ff" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:27:49 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-1fa26e0f-b04f-4541-863c-47d79c57551c tempest-VolumeDependencyTests-680812086 None] snapshot: 1593355c-e142-4b9d-b327-79882337615a, volume: 9caba0ab-1b65-4ea8-84fa-c7da589757ff,  {{(pid=86891) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 03 01:27:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1fa26e0f-b04f-4541-863c-47d79c57551c tempest-VolumeDependencyTests-680812086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:27:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1fa26e0f-b04f-4541-863c-47d79c57551c tempest-VolumeDependencyTests-680812086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:27:49 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-1fa26e0f-b04f-4541-863c-47d79c57551c tempest-VolumeDependencyTests-680812086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:27:49 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-1fa26e0f-b04f-4541-863c-47d79c57551c tempest-VolumeDependencyTests-680812086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:27:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1fa26e0f-b04f-4541-863c-47d79c57551c tempest-VolumeDependencyTests-680812086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:27:49 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d0274f-d84e-4e2f-a919-c11a0d82de31]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:27:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1fa26e0f-b04f-4541-863c-47d79c57551c tempest-VolumeDependencyTests-680812086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-943ee80d-283f-4c6a-b28c-26e72c4dbf6c.1593355c-e142-4b9d-b327-79882337615a {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:27:49 devstack sudo[106095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-943ee80d-283f-4c6a-b28c-26e72c4dbf6c.1593355c-e142-4b9d-b327-79882337615a
Jul 03 01:27:49 devstack sudo[106095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:27:49 devstack sudo[106095]: pam_unix(sudo:session): session closed for user root
Jul 03 01:27:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1fa26e0f-b04f-4541-863c-47d79c57551c tempest-VolumeDependencyTests-680812086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-943ee80d-283f-4c6a-b28c-26e72c4dbf6c.1593355c-e142-4b9d-b327-79882337615a" returned: 0 in 0.706s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:27:49 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-1fa26e0f-b04f-4541-863c-47d79c57551c tempest-VolumeDependencyTests-680812086 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-943ee80d-283f-4c6a-b28c-26e72c4dbf6c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:27:49 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-1fa26e0f-b04f-4541-863c-47d79c57551c tempest-VolumeDependencyTests-680812086 None] will copy from snapshot at /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-943ee80d-283f-4c6a-b28c-26e72c4dbf6c {{(pid=86891) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 03 01:27:49 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-1fa26e0f-b04f-4541-863c-47d79c57551c tempest-VolumeDependencyTests-680812086 None] Creating direct copy from snapshot {{(pid=86891) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 03 01:27:49 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36c6b14-742a-4020-8c5a-202346e26b9f]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:27:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1fa26e0f-b04f-4541-863c-47d79c57551c tempest-VolumeDependencyTests-680812086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-943ee80d-283f-4c6a-b28c-26e72c4dbf6c {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:27:50 devstack sudo[106100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-943ee80d-283f-4c6a-b28c-26e72c4dbf6c
Jul 03 01:27:50 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:27:50 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root
Jul 03 01:27:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1fa26e0f-b04f-4541-863c-47d79c57551c tempest-VolumeDependencyTests-680812086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-943ee80d-283f-4c6a-b28c-26e72c4dbf6c" returned: 0 in 0.719s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:27:50 devstack cinder-volume[86891]: DEBUG cinder.utils [None req-1fa26e0f-b04f-4541-863c-47d79c57551c tempest-VolumeDependencyTests-680812086 None] Path /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9caba0ab-1b65-4ea8-84fa-c7da589757ff not found in is_blk_device check {{(pid=86891) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 03 01:27:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1fa26e0f-b04f-4541-863c-47d79c57551c tempest-VolumeDependencyTests-680812086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-943ee80d-283f-4c6a-b28c-26e72c4dbf6c /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9caba0ab-1b65-4ea8-84fa-c7da589757ff {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:27:50 devstack sudo[106105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-943ee80d-283f-4c6a-b28c-26e72c4dbf6c /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9caba0ab-1b65-4ea8-84fa-c7da589757ff
Jul 03 01:27:50 devstack sudo[106105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:27:54 devstack sudo[106105]: pam_unix(sudo:session): session closed for user root
Jul 03 01:27:54 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1fa26e0f-b04f-4541-863c-47d79c57551c tempest-VolumeDependencyTests-680812086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-943ee80d-283f-4c6a-b28c-26e72c4dbf6c /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9caba0ab-1b65-4ea8-84fa-c7da589757ff" returned: 0 in 4.106s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:27:54 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[003f87b5-8907-43db-894f-bd9b095ce739]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:27:54 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1fa26e0f-b04f-4541-863c-47d79c57551c tempest-VolumeDependencyTests-680812086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-943ee80d-283f-4c6a-b28c-26e72c4dbf6c {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:27:54 devstack sudo[106118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-943ee80d-283f-4c6a-b28c-26e72c4dbf6c
Jul 03 01:27:54 devstack sudo[106118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:27:55 devstack sudo[106118]: pam_unix(sudo:session): session closed for user root
Jul 03 01:27:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1fa26e0f-b04f-4541-863c-47d79c57551c tempest-VolumeDependencyTests-680812086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-943ee80d-283f-4c6a-b28c-26e72c4dbf6c" returned: 0 in 0.865s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:27:55 devstack cinder-volume[86891]: DEBUG cinder.image.image_utils [None req-1fa26e0f-b04f-4541-863c-47d79c57551c tempest-VolumeDependencyTests-680812086 None] Image conversion details: src /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-943ee80d-283f-4c6a-b28c-26e72c4dbf6c, size 1024.00 MB, duration 4.11 sec, destination /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9caba0ab-1b65-4ea8-84fa-c7da589757ff {{(pid=86891) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 03 01:27:55 devstack cinder-volume[86891]: INFO cinder.image.image_utils [None req-1fa26e0f-b04f-4541-863c-47d79c57551c tempest-VolumeDependencyTests-680812086 None] Converted 1024.00 MB image at 249.30 MB/s
Jul 03 01:27:55 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-1fa26e0f-b04f-4541-863c-47d79c57551c tempest-VolumeDependencyTests-680812086 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9caba0ab-1b65-4ea8-84fa-c7da589757ff is being set with open permissions: ugo+rw
Jul 03 01:27:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1fa26e0f-b04f-4541-863c-47d79c57551c tempest-VolumeDependencyTests-680812086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9caba0ab-1b65-4ea8-84fa-c7da589757ff {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:27:55 devstack sudo[106123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9caba0ab-1b65-4ea8-84fa-c7da589757ff
Jul 03 01:27:55 devstack sudo[106123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:27:56 devstack sudo[106123]: pam_unix(sudo:session): session closed for user root
Jul 03 01:27:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1fa26e0f-b04f-4541-863c-47d79c57551c tempest-VolumeDependencyTests-680812086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9caba0ab-1b65-4ea8-84fa-c7da589757ff" returned: 0 in 0.606s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:27:56 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-1fa26e0f-b04f-4541-863c-47d79c57551c tempest-VolumeDependencyTests-680812086 None] Lock "cinder-quobyte-9caba0ab-1b65-4ea8-84fa-c7da589757ff" released by "_copy_volume_from_snapshot" :: held 7.087s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:27:56 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-1fa26e0f-b04f-4541-863c-47d79c57551c tempest-VolumeDependencyTests-680812086 None] Lock "cinder-quobyte-1593355c-e142-4b9d-b327-79882337615a-9caba0ab-1b65-4ea8-84fa-c7da589757ff" released by "_create_volume_from_snapshot" :: held 7.112s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:27:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1fa26e0f-b04f-4541-863c-47d79c57551c tempest-VolumeDependencyTests-680812086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.128s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:27:56 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:SELECT=89,cinder:UPDATE=121,cinder:INSERT=29,cinder:DELETE=16 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:27:56 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:SELECT=82,cinder:UPDATE=133,cinder:INSERT=28,cinder:DELETE=8 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:27:56 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1fa26e0f-b04f-4541-863c-47d79c57551c tempest-VolumeDependencyTests-680812086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2c5abd3-2b20-4e61-a40e-861b62b4715c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9caba0ab-1b65-4ea8-84fa-c7da589757ff', 'volume_size': 1, 'snapshot_id': '1593355c-e142-4b9d-b327-79882337615a'}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:27:56 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1fa26e0f-b04f-4541-863c-47d79c57551c tempest-VolumeDependencyTests-680812086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbcd56a5-566c-4f4d-a729-394ac94b5024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:27:56 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-1fa26e0f-b04f-4541-863c-47d79c57551c tempest-VolumeDependencyTests-680812086 None] Volume volume-9caba0ab-1b65-4ea8-84fa-c7da589757ff (9caba0ab-1b65-4ea8-84fa-c7da589757ff): created successfully
Jul 03 01:27:56 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1fa26e0f-b04f-4541-863c-47d79c57551c tempest-VolumeDependencyTests-680812086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbcd56a5-566c-4f4d-a729-394ac94b5024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:27:56 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1fa26e0f-b04f-4541-863c-47d79c57551c tempest-VolumeDependencyTests-680812086 None] Flow 'volume_create_manager' (d7b99b5a-ef7d-40cd-bcbd-1dccac389819) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:27:56 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-1fa26e0f-b04f-4541-863c-47d79c57551c tempest-VolumeDependencyTests-680812086 None] Created volume successfully.
Jul 03 01:27:56 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-0e9ec88f-3167-4a0c-9148-f0d7b8c7ef7c tempest-VolumeDependencyTests-680812086 None] Acquiring lock "cinder-1593355c-e142-4b9d-b327-79882337615a-delete_snapshot" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:27:56 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-0e9ec88f-3167-4a0c-9148-f0d7b8c7ef7c tempest-VolumeDependencyTests-680812086 None] Lock "cinder-1593355c-e142-4b9d-b327-79882337615a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:27:56 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-0e9ec88f-3167-4a0c-9148-f0d7b8c7ef7c tempest-VolumeDependencyTests-680812086 None] Acquiring lock "cinder-quobyte-943ee80d-283f-4c6a-b28c-26e72c4dbf6c" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:27:56 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-0e9ec88f-3167-4a0c-9148-f0d7b8c7ef7c tempest-VolumeDependencyTests-680812086 None] Lock "cinder-quobyte-943ee80d-283f-4c6a-b28c-26e72c4dbf6c" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:27:56 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-0e9ec88f-3167-4a0c-9148-f0d7b8c7ef7c tempest-VolumeDependencyTests-680812086 None] Acquiring lock "cinder-quobyte-1593355c-e142-4b9d-b327-79882337615a" by "_delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:27:56 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-0e9ec88f-3167-4a0c-9148-f0d7b8c7ef7c tempest-VolumeDependencyTests-680812086 None] Lock "cinder-quobyte-1593355c-e142-4b9d-b327-79882337615a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:27:56 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-0e9ec88f-3167-4a0c-9148-f0d7b8c7ef7c tempest-VolumeDependencyTests-680812086 None] Deleting offline snapshot 1593355c-e142-4b9d-b327-79882337615a of volume 943ee80d-283f-4c6a-b28c-26e72c4dbf6c {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 01:27:56 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-0e9ec88f-3167-4a0c-9148-f0d7b8c7ef7c tempest-VolumeDependencyTests-680812086 None] snapshot_file for this snap is: volume-943ee80d-283f-4c6a-b28c-26e72c4dbf6c.1593355c-e142-4b9d-b327-79882337615a {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 01:27:56 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a56bdd2-a452-4582-b1c6-8d04454fec8c]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:27:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0e9ec88f-3167-4a0c-9148-f0d7b8c7ef7c tempest-VolumeDependencyTests-680812086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-943ee80d-283f-4c6a-b28c-26e72c4dbf6c.1593355c-e142-4b9d-b327-79882337615a {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:27:56 devstack sudo[106126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-943ee80d-283f-4c6a-b28c-26e72c4dbf6c.1593355c-e142-4b9d-b327-79882337615a
Jul 03 01:27:56 devstack sudo[106126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:27:57 devstack sudo[106126]: pam_unix(sudo:session): session closed for user root
Jul 03 01:27:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0e9ec88f-3167-4a0c-9148-f0d7b8c7ef7c tempest-VolumeDependencyTests-680812086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-943ee80d-283f-4c6a-b28c-26e72c4dbf6c.1593355c-e142-4b9d-b327-79882337615a" returned: 0 in 0.720s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:27:57 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-0e9ec88f-3167-4a0c-9148-f0d7b8c7ef7c tempest-VolumeDependencyTests-680812086 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-943ee80d-283f-4c6a-b28c-26e72c4dbf6c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:27:57 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c0fdfa-d06a-4f8e-99da-30283d895646]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:27:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0e9ec88f-3167-4a0c-9148-f0d7b8c7ef7c tempest-VolumeDependencyTests-680812086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-943ee80d-283f-4c6a-b28c-26e72c4dbf6c {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:27:57 devstack sudo[106131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-943ee80d-283f-4c6a-b28c-26e72c4dbf6c
Jul 03 01:27:57 devstack sudo[106131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:27:58 devstack sudo[106131]: pam_unix(sudo:session): session closed for user root
Jul 03 01:27:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0e9ec88f-3167-4a0c-9148-f0d7b8c7ef7c tempest-VolumeDependencyTests-680812086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-943ee80d-283f-4c6a-b28c-26e72c4dbf6c" returned: 0 in 0.714s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:27:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0e9ec88f-3167-4a0c-9148-f0d7b8c7ef7c tempest-VolumeDependencyTests-680812086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-943ee80d-283f-4c6a-b28c-26e72c4dbf6c.1593355c-e142-4b9d-b327-79882337615a {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:27:58 devstack sudo[106136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-943ee80d-283f-4c6a-b28c-26e72c4dbf6c.1593355c-e142-4b9d-b327-79882337615a
Jul 03 01:27:58 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:27:58 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root
Jul 03 01:27:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0e9ec88f-3167-4a0c-9148-f0d7b8c7ef7c tempest-VolumeDependencyTests-680812086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-943ee80d-283f-4c6a-b28c-26e72c4dbf6c.1593355c-e142-4b9d-b327-79882337615a" returned: 0 in 0.718s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:27:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0e9ec88f-3167-4a0c-9148-f0d7b8c7ef7c tempest-VolumeDependencyTests-680812086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-943ee80d-283f-4c6a-b28c-26e72c4dbf6c.1593355c-e142-4b9d-b327-79882337615a {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:27:58 devstack sudo[106142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-943ee80d-283f-4c6a-b28c-26e72c4dbf6c.1593355c-e142-4b9d-b327-79882337615a
Jul 03 01:27:58 devstack sudo[106142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:27:59 devstack sudo[106142]: pam_unix(sudo:session): session closed for user root
Jul 03 01:27:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0e9ec88f-3167-4a0c-9148-f0d7b8c7ef7c tempest-VolumeDependencyTests-680812086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-943ee80d-283f-4c6a-b28c-26e72c4dbf6c.1593355c-e142-4b9d-b327-79882337615a" returned: 0 in 0.613s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:27:59 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-0e9ec88f-3167-4a0c-9148-f0d7b8c7ef7c tempest-VolumeDependencyTests-680812086 None] Lock "cinder-quobyte-1593355c-e142-4b9d-b327-79882337615a" released by "_delete_snapshot" :: held 2.855s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:27:59 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-0e9ec88f-3167-4a0c-9148-f0d7b8c7ef7c tempest-VolumeDependencyTests-680812086 None] Lock "cinder-quobyte-943ee80d-283f-4c6a-b28c-26e72c4dbf6c" released by "delete_snapshot" :: held 2.877s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:27:59 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-0e9ec88f-3167-4a0c-9148-f0d7b8c7ef7c tempest-VolumeDependencyTests-680812086 None] Created reservations ['5df19a78-05c8-4355-a55b-83b9e9bb5f18', 'ab899d44-bbf2-4541-a8dc-2e654bf18972', '7925db73-228d-4d2d-ab96-937bddff168b', 'd141bbe7-79da-44f4-a1c8-ba046d3eecdf'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:27:59 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-0e9ec88f-3167-4a0c-9148-f0d7b8c7ef7c tempest-VolumeDependencyTests-680812086 None] Delete snapshot completed successfully.
Jul 03 01:27:59 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-0e9ec88f-3167-4a0c-9148-f0d7b8c7ef7c tempest-VolumeDependencyTests-680812086 None] Lock "cinder-1593355c-e142-4b9d-b327-79882337615a-delete_snapshot" released by "delete_snapshot" :: held 3.000s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:27:59 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-23caf133-e0da-42b9-9003-ae5a993b0750 tempest-VolumeDependencyTests-680812086 None] Acquiring lock "cinder-943ee80d-283f-4c6a-b28c-26e72c4dbf6c-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:27:59 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-23caf133-e0da-42b9-9003-ae5a993b0750 tempest-VolumeDependencyTests-680812086 None] Lock "cinder-943ee80d-283f-4c6a-b28c-26e72c4dbf6c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:27:59 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-23caf133-e0da-42b9-9003-ae5a993b0750 tempest-VolumeDependencyTests-680812086 None] Acquiring lock "cinder-quobyte-943ee80d-283f-4c6a-b28c-26e72c4dbf6c" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:27:59 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-23caf133-e0da-42b9-9003-ae5a993b0750 tempest-VolumeDependencyTests-680812086 None] Lock "cinder-quobyte-943ee80d-283f-4c6a-b28c-26e72c4dbf6c" acquired by "delete_volume" :: waited 0.017s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:27:59 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[326b8c99-4582-43f7-89c5-2a1bc22a242c]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:27:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-23caf133-e0da-42b9-9003-ae5a993b0750 tempest-VolumeDependencyTests-680812086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-943ee80d-283f-4c6a-b28c-26e72c4dbf6c {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:00 devstack sudo[106145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-943ee80d-283f-4c6a-b28c-26e72c4dbf6c
Jul 03 01:28:00 devstack sudo[106145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:00 devstack sudo[106145]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:00 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-23caf133-e0da-42b9-9003-ae5a993b0750 tempest-VolumeDependencyTests-680812086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-943ee80d-283f-4c6a-b28c-26e72c4dbf6c" returned: 0 in 0.761s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:00 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-23caf133-e0da-42b9-9003-ae5a993b0750 tempest-VolumeDependencyTests-680812086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-943ee80d-283f-4c6a-b28c-26e72c4dbf6c {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:00 devstack sudo[106150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-943ee80d-283f-4c6a-b28c-26e72c4dbf6c
Jul 03 01:28:00 devstack sudo[106150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:01 devstack sudo[106150]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-23caf133-e0da-42b9-9003-ae5a993b0750 tempest-VolumeDependencyTests-680812086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-943ee80d-283f-4c6a-b28c-26e72c4dbf6c" returned: 0 in 0.615s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:01 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-23caf133-e0da-42b9-9003-ae5a993b0750 tempest-VolumeDependencyTests-680812086 None] Lock "cinder-quobyte-943ee80d-283f-4c6a-b28c-26e72c4dbf6c" released by "delete_volume" :: held 1.429s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:28:01 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-23caf133-e0da-42b9-9003-ae5a993b0750 tempest-VolumeDependencyTests-680812086 None] Created reservations ['abde2afe-9190-4cd3-b20b-9b61f04599d8', '565198b2-ff0a-470b-8af1-9866540e8db4', 'ff155c81-878d-4e51-a94c-465477ec4729', 'e6553bf6-defd-4402-9b68-4e474af7a7f6'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:28:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-23caf133-e0da-42b9-9003-ae5a993b0750 tempest-VolumeDependencyTests-680812086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:28:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-23caf133-e0da-42b9-9003-ae5a993b0750 tempest-VolumeDependencyTests-680812086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:28:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-23caf133-e0da-42b9-9003-ae5a993b0750 tempest-VolumeDependencyTests-680812086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:28:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-23caf133-e0da-42b9-9003-ae5a993b0750 tempest-VolumeDependencyTests-680812086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:28:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-23caf133-e0da-42b9-9003-ae5a993b0750 tempest-VolumeDependencyTests-680812086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:28:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-23caf133-e0da-42b9-9003-ae5a993b0750 tempest-VolumeDependencyTests-680812086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:01 devstack sudo[106153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:28:01 devstack sudo[106153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:01 devstack cinder-volume[86891]: DEBUG oslo_service.periodic_task [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86891) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 01:28:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:28:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:28:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:28:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:28:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:28:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:01 devstack sudo[106156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:28:01 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:02 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-9a986438-f2cc-45d0-89e1-e8b68eedcbd9 tempest-VolumeDependencyTests-680812086 None] Acquiring lock "cinder-9caba0ab-1b65-4ea8-84fa-c7da589757ff-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:28:02 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-9a986438-f2cc-45d0-89e1-e8b68eedcbd9 tempest-VolumeDependencyTests-680812086 None] Lock "cinder-9caba0ab-1b65-4ea8-84fa-c7da589757ff-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:28:02 devstack sudo[106153]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-23caf133-e0da-42b9-9003-ae5a993b0750 tempest-VolumeDependencyTests-680812086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.673s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:02 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-23caf133-e0da-42b9-9003-ae5a993b0750 tempest-VolumeDependencyTests-680812086 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:28:02 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-23caf133-e0da-42b9-9003-ae5a993b0750 tempest-VolumeDependencyTests-680812086 None] Deleted volume successfully.
Jul 03 01:28:02 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-23caf133-e0da-42b9-9003-ae5a993b0750 tempest-VolumeDependencyTests-680812086 None] Lock "cinder-943ee80d-283f-4c6a-b28c-26e72c4dbf6c-delete_volume" released by "delete_volume" :: held 2.310s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:28:02 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-9a986438-f2cc-45d0-89e1-e8b68eedcbd9 tempest-VolumeDependencyTests-680812086 None] Acquiring lock "cinder-quobyte-9caba0ab-1b65-4ea8-84fa-c7da589757ff" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:28:02 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-9a986438-f2cc-45d0-89e1-e8b68eedcbd9 tempest-VolumeDependencyTests-680812086 None] Lock "cinder-quobyte-9caba0ab-1b65-4ea8-84fa-c7da589757ff" acquired by "delete_volume" :: waited 0.013s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:28:02 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c252937-5415-4ac6-9a4c-3a85421c377f]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:28:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9a986438-f2cc-45d0-89e1-e8b68eedcbd9 tempest-VolumeDependencyTests-680812086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9caba0ab-1b65-4ea8-84fa-c7da589757ff {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:02 devstack sudo[106158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9caba0ab-1b65-4ea8-84fa-c7da589757ff
Jul 03 01:28:02 devstack sudo[106158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:02 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.645s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:02 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:28:02 devstack cinder-volume[86891]: DEBUG oslo_service.periodic_task [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running periodic task VolumeManager._thread_info {{(pid=86891) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 01:28:02 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] thread count: 28 {{(pid=86891) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 01:28:02 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] thread info: [<_MainThread(MainThread, started 136731296534656)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136731184953280)>, <Thread(Thread-3 (stat_writer), started daemon 136731184058816)>, <Thread(Rabbit-heartbeat, started daemon 136731184846080)>, <Thread(Thread-5 (_runner), started daemon 136731182936576)>, <Thread(Thread-7 (_runner), started daemon 136731182954944)>, <Thread(fd_logger, started daemon 136731181916416)>, <Thread(privsep_reader, started daemon 136731180942208)>, <Thread(tpool_thread_0, started daemon 136731172161216)>, <Thread(tpool_thread_1, started daemon 136731163768512)>, <Thread(tpool_thread_2, started daemon 136731155375808)>, <Thread(tpool_thread_3, started daemon 136731146983104)>, <Thread(tpool_thread_4, started daemon 136731138590400)>, <Thread(tpool_thread_5, started daemon 136731130197696)>, <Thread(tpool_thread_6, started daemon 136731121804992)>, <Thread(tpool_thread_7, started daemon 136731113412288)>, <Thread(tpool_thread_8, started daemon 136731105003200)>, <Thread(tpool_thread_9, started daemon 136731096594112)>, <Thread(tpool_thread_10, started daemon 136731088185024)>, <Thread(tpool_thread_11, started daemon 136731079775936)>, <Thread(tpool_thread_12, started daemon 136731071366848)>, <Thread(tpool_thread_13, started daemon 136731062957760)>, <Thread(tpool_thread_14, started daemon 136731054548672)>, <Thread(tpool_thread_15, started daemon 136731046139584)>, <Thread(tpool_thread_16, started daemon 136731037730496)>, <Thread(tpool_thread_17, started daemon 136731029321408)>, <Thread(tpool_thread_18, started daemon 136731020912320)>, <Thread(tpool_thread_19, started daemon 136731012503232)>] {{(pid=86891) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 01:28:02 devstack sudo[106158]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9a986438-f2cc-45d0-89e1-e8b68eedcbd9 tempest-VolumeDependencyTests-680812086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9caba0ab-1b65-4ea8-84fa-c7da589757ff" returned: 0 in 0.732s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9a986438-f2cc-45d0-89e1-e8b68eedcbd9 tempest-VolumeDependencyTests-680812086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9caba0ab-1b65-4ea8-84fa-c7da589757ff {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:02 devstack sudo[106164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9caba0ab-1b65-4ea8-84fa-c7da589757ff
Jul 03 01:28:02 devstack sudo[106164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:03 devstack sudo[106164]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9a986438-f2cc-45d0-89e1-e8b68eedcbd9 tempest-VolumeDependencyTests-680812086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9caba0ab-1b65-4ea8-84fa-c7da589757ff" returned: 0 in 0.605s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:03 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-9a986438-f2cc-45d0-89e1-e8b68eedcbd9 tempest-VolumeDependencyTests-680812086 None] Lock "cinder-quobyte-9caba0ab-1b65-4ea8-84fa-c7da589757ff" released by "delete_volume" :: held 1.374s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:28:03 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-9a986438-f2cc-45d0-89e1-e8b68eedcbd9 tempest-VolumeDependencyTests-680812086 None] Created reservations ['69acb242-0e7d-4cad-9ba1-a841525fdf26', '5ab65c1c-991f-4490-88b6-6b932c596521', '63c670bb-2eab-450a-a4e6-6981fbf3774d', '97f8050a-59a9-42a4-bfa3-c781865542b6'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:28:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-9a986438-f2cc-45d0-89e1-e8b68eedcbd9 tempest-VolumeDependencyTests-680812086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:28:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-9a986438-f2cc-45d0-89e1-e8b68eedcbd9 tempest-VolumeDependencyTests-680812086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:28:03 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-9a986438-f2cc-45d0-89e1-e8b68eedcbd9 tempest-VolumeDependencyTests-680812086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:28:03 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-9a986438-f2cc-45d0-89e1-e8b68eedcbd9 tempest-VolumeDependencyTests-680812086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:28:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-9a986438-f2cc-45d0-89e1-e8b68eedcbd9 tempest-VolumeDependencyTests-680812086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:28:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9a986438-f2cc-45d0-89e1-e8b68eedcbd9 tempest-VolumeDependencyTests-680812086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:03 devstack sudo[106167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:28:03 devstack sudo[106167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:04 devstack sudo[106167]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9a986438-f2cc-45d0-89e1-e8b68eedcbd9 tempest-VolumeDependencyTests-680812086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.648s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:04 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-9a986438-f2cc-45d0-89e1-e8b68eedcbd9 tempest-VolumeDependencyTests-680812086 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:28:04 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-9a986438-f2cc-45d0-89e1-e8b68eedcbd9 tempest-VolumeDependencyTests-680812086 None] Deleted volume successfully.
Jul 03 01:28:04 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-9a986438-f2cc-45d0-89e1-e8b68eedcbd9 tempest-VolumeDependencyTests-680812086 None] Lock "cinder-9caba0ab-1b65-4ea8-84fa-c7da589757ff-delete_volume" released by "delete_volume" :: held 2.221s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:28:07 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-bccf7d1c-dd08-4c45-86cf-4d9d3c02b18f tempest-ProjectReaderTests-1503419375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:28:07 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bccf7d1c-dd08-4c45-86cf-4d9d3c02b18f tempest-ProjectReaderTests-1503419375 None] Flow 'volume_create_manager' (f83ebfb5-8963-4d8d-967a-d10f7e71d99e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:28:07 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bccf7d1c-dd08-4c45-86cf-4d9d3c02b18f tempest-ProjectReaderTests-1503419375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9041ffce-d2a5-4ead-8294-0dd46df0782f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:07 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bccf7d1c-dd08-4c45-86cf-4d9d3c02b18f tempest-ProjectReaderTests-1503419375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9041ffce-d2a5-4ead-8294-0dd46df0782f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:28:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1169632314',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fea0e3f-c1d8-44ac-9e2d-287b1847f518,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1b11bcd358a43e481eb48a2ca75e005',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:28:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:28:08Z,use_quota=True,user_id='eec91f2b326e45d69ee8ff9681115a3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:07 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bccf7d1c-dd08-4c45-86cf-4d9d3c02b18f tempest-ProjectReaderTests-1503419375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16caaa70-e23f-4797-b0e9-de2b46ce4e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:07 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bccf7d1c-dd08-4c45-86cf-4d9d3c02b18f tempest-ProjectReaderTests-1503419375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16caaa70-e23f-4797-b0e9-de2b46ce4e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:07 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bccf7d1c-dd08-4c45-86cf-4d9d3c02b18f tempest-ProjectReaderTests-1503419375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba008d13-a5da-4c34-adb8-fb2ed795949c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:07 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bccf7d1c-dd08-4c45-86cf-4d9d3c02b18f tempest-ProjectReaderTests-1503419375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba008d13-a5da-4c34-adb8-fb2ed795949c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fea0e3f-c1d8-44ac-9e2d-287b1847f518', 'volume_name': 'volume-9fea0e3f-c1d8-44ac-9e2d-287b1847f518', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:07 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bccf7d1c-dd08-4c45-86cf-4d9d3c02b18f tempest-ProjectReaderTests-1503419375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba6ef00e-ff9c-454e-984d-3a28f7ecbbb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:07 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bccf7d1c-dd08-4c45-86cf-4d9d3c02b18f tempest-ProjectReaderTests-1503419375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba6ef00e-ff9c-454e-984d-3a28f7ecbbb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:07 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bccf7d1c-dd08-4c45-86cf-4d9d3c02b18f tempest-ProjectReaderTests-1503419375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80510fc8-68df-416a-a077-785ee61af83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:07 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-bccf7d1c-dd08-4c45-86cf-4d9d3c02b18f tempest-ProjectReaderTests-1503419375 None] Volume 9fea0e3f-c1d8-44ac-9e2d-287b1847f518: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fea0e3f-c1d8-44ac-9e2d-287b1847f518', 'volume_size': 1}
Jul 03 01:28:07 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-bccf7d1c-dd08-4c45-86cf-4d9d3c02b18f tempest-ProjectReaderTests-1503419375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:28:07 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-bccf7d1c-dd08-4c45-86cf-4d9d3c02b18f tempest-ProjectReaderTests-1503419375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:28:07 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-bccf7d1c-dd08-4c45-86cf-4d9d3c02b18f tempest-ProjectReaderTests-1503419375 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:28:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1169632314',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fea0e3f-c1d8-44ac-9e2d-287b1847f518,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1b11bcd358a43e481eb48a2ca75e005',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:28:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:28:08Z,use_quota=True,user_id='eec91f2b326e45d69ee8ff9681115a3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:28:07 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-bccf7d1c-dd08-4c45-86cf-4d9d3c02b18f tempest-ProjectReaderTests-1503419375 None] Creating volume 9fea0e3f-c1d8-44ac-9e2d-287b1847f518 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:28:07 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-bccf7d1c-dd08-4c45-86cf-4d9d3c02b18f tempest-ProjectReaderTests-1503419375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:28:07 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-bccf7d1c-dd08-4c45-86cf-4d9d3c02b18f tempest-ProjectReaderTests-1503419375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:28:07 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-bccf7d1c-dd08-4c45-86cf-4d9d3c02b18f tempest-ProjectReaderTests-1503419375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:28:07 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-bccf7d1c-dd08-4c45-86cf-4d9d3c02b18f tempest-ProjectReaderTests-1503419375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:28:07 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-bccf7d1c-dd08-4c45-86cf-4d9d3c02b18f tempest-ProjectReaderTests-1503419375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:28:07 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-bccf7d1c-dd08-4c45-86cf-4d9d3c02b18f tempest-ProjectReaderTests-1503419375 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:28:07 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-bccf7d1c-dd08-4c45-86cf-4d9d3c02b18f tempest-ProjectReaderTests-1503419375 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:28:07 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bccf7d1c-dd08-4c45-86cf-4d9d3c02b18f tempest-ProjectReaderTests-1503419375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9fea0e3f-c1d8-44ac-9e2d-287b1847f518 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:07 devstack sudo[106170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9fea0e3f-c1d8-44ac-9e2d-287b1847f518 1073741824
Jul 03 01:28:07 devstack sudo[106170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:08 devstack sudo[106170]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:08 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bccf7d1c-dd08-4c45-86cf-4d9d3c02b18f tempest-ProjectReaderTests-1503419375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9fea0e3f-c1d8-44ac-9e2d-287b1847f518 1073741824" returned: 0 in 0.778s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:08 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bccf7d1c-dd08-4c45-86cf-4d9d3c02b18f tempest-ProjectReaderTests-1503419375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9fea0e3f-c1d8-44ac-9e2d-287b1847f518 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:08 devstack sudo[106176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9fea0e3f-c1d8-44ac-9e2d-287b1847f518
Jul 03 01:28:08 devstack sudo[106176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:09 devstack sudo[106176]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bccf7d1c-dd08-4c45-86cf-4d9d3c02b18f tempest-ProjectReaderTests-1503419375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9fea0e3f-c1d8-44ac-9e2d-287b1847f518" returned: 0 in 0.632s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:09 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-bccf7d1c-dd08-4c45-86cf-4d9d3c02b18f tempest-ProjectReaderTests-1503419375 None] <== create_volume: return (1447ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:28:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-bccf7d1c-dd08-4c45-86cf-4d9d3c02b18f tempest-ProjectReaderTests-1503419375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.450s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:28:09 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bccf7d1c-dd08-4c45-86cf-4d9d3c02b18f tempest-ProjectReaderTests-1503419375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80510fc8-68df-416a-a077-785ee61af83d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fea0e3f-c1d8-44ac-9e2d-287b1847f518', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:09 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bccf7d1c-dd08-4c45-86cf-4d9d3c02b18f tempest-ProjectReaderTests-1503419375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1867783c-eaf0-45b4-91b3-07b1221be23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:09 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-bccf7d1c-dd08-4c45-86cf-4d9d3c02b18f tempest-ProjectReaderTests-1503419375 None] Volume volume-9fea0e3f-c1d8-44ac-9e2d-287b1847f518 (9fea0e3f-c1d8-44ac-9e2d-287b1847f518): created successfully
Jul 03 01:28:09 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bccf7d1c-dd08-4c45-86cf-4d9d3c02b18f tempest-ProjectReaderTests-1503419375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1867783c-eaf0-45b4-91b3-07b1221be23b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:09 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bccf7d1c-dd08-4c45-86cf-4d9d3c02b18f tempest-ProjectReaderTests-1503419375 None] Flow 'volume_create_manager' (f83ebfb5-8963-4d8d-967a-d10f7e71d99e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:28:09 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-bccf7d1c-dd08-4c45-86cf-4d9d3c02b18f tempest-ProjectReaderTests-1503419375 None] Created volume successfully.
Jul 03 01:28:09 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8ec716cc-850c-484d-bf89-b561fcdbc99f tempest-ProjectReaderTests-1503419375 None] Acquiring lock "cinder-9fea0e3f-c1d8-44ac-9e2d-287b1847f518-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:28:09 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8ec716cc-850c-484d-bf89-b561fcdbc99f tempest-ProjectReaderTests-1503419375 None] Lock "cinder-9fea0e3f-c1d8-44ac-9e2d-287b1847f518-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:28:09 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8ec716cc-850c-484d-bf89-b561fcdbc99f tempest-ProjectReaderTests-1503419375 None] Acquiring lock "cinder-quobyte-9fea0e3f-c1d8-44ac-9e2d-287b1847f518" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:28:09 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8ec716cc-850c-484d-bf89-b561fcdbc99f tempest-ProjectReaderTests-1503419375 None] Lock "cinder-quobyte-9fea0e3f-c1d8-44ac-9e2d-287b1847f518" acquired by "delete_volume" :: waited 0.013s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:28:09 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[27acf10c-4d55-48cf-b910-285328b188ba]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:28:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8ec716cc-850c-484d-bf89-b561fcdbc99f tempest-ProjectReaderTests-1503419375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9fea0e3f-c1d8-44ac-9e2d-287b1847f518 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:10 devstack sudo[106180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9fea0e3f-c1d8-44ac-9e2d-287b1847f518
Jul 03 01:28:10 devstack sudo[106180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:10 devstack sudo[106180]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:10 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8ec716cc-850c-484d-bf89-b561fcdbc99f tempest-ProjectReaderTests-1503419375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9fea0e3f-c1d8-44ac-9e2d-287b1847f518" returned: 0 in 0.728s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:10 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8ec716cc-850c-484d-bf89-b561fcdbc99f tempest-ProjectReaderTests-1503419375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9fea0e3f-c1d8-44ac-9e2d-287b1847f518 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:10 devstack sudo[106185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9fea0e3f-c1d8-44ac-9e2d-287b1847f518
Jul 03 01:28:10 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:11 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:11 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8ec716cc-850c-484d-bf89-b561fcdbc99f tempest-ProjectReaderTests-1503419375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9fea0e3f-c1d8-44ac-9e2d-287b1847f518" returned: 0 in 0.621s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:11 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8ec716cc-850c-484d-bf89-b561fcdbc99f tempest-ProjectReaderTests-1503419375 None] Lock "cinder-quobyte-9fea0e3f-c1d8-44ac-9e2d-287b1847f518" released by "delete_volume" :: held 1.386s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:28:11 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-8ec716cc-850c-484d-bf89-b561fcdbc99f tempest-ProjectReaderTests-1503419375 None] Created reservations ['47cc9a2f-5406-4ee6-92a8-8930b5e4c133', 'ed092d95-bbbc-4cc4-be0b-de01c61a5a23', 'e22bfc98-2e6e-4ada-a3f6-f1c9e559b12e', 'f7840cf1-fb08-4cb9-b1ff-b66afae290b0'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:28:11 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-8ec716cc-850c-484d-bf89-b561fcdbc99f tempest-ProjectReaderTests-1503419375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:28:11 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-8ec716cc-850c-484d-bf89-b561fcdbc99f tempest-ProjectReaderTests-1503419375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:28:11 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-8ec716cc-850c-484d-bf89-b561fcdbc99f tempest-ProjectReaderTests-1503419375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:28:11 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-8ec716cc-850c-484d-bf89-b561fcdbc99f tempest-ProjectReaderTests-1503419375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:28:11 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-8ec716cc-850c-484d-bf89-b561fcdbc99f tempest-ProjectReaderTests-1503419375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:28:11 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8ec716cc-850c-484d-bf89-b561fcdbc99f tempest-ProjectReaderTests-1503419375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:11 devstack sudo[106188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:28:11 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:11 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8ec716cc-850c-484d-bf89-b561fcdbc99f tempest-ProjectReaderTests-1503419375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.632s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:12 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-8ec716cc-850c-484d-bf89-b561fcdbc99f tempest-ProjectReaderTests-1503419375 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:28:12 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-8ec716cc-850c-484d-bf89-b561fcdbc99f tempest-ProjectReaderTests-1503419375 None] Deleted volume successfully.
Jul 03 01:28:12 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8ec716cc-850c-484d-bf89-b561fcdbc99f tempest-ProjectReaderTests-1503419375 None] Lock "cinder-9fea0e3f-c1d8-44ac-9e2d-287b1847f518-delete_volume" released by "delete_volume" :: held 2.199s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:28:12 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-e18ddf2d-3dd4-4044-a1f7-04200c8de419 tempest-ProjectReaderTests-1503419375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:28:12 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e18ddf2d-3dd4-4044-a1f7-04200c8de419 tempest-ProjectReaderTests-1503419375 None] Flow 'volume_create_manager' (35f8d8f5-c0bd-49eb-8dff-c1fabf66d96d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:28:12 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e18ddf2d-3dd4-4044-a1f7-04200c8de419 tempest-ProjectReaderTests-1503419375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a1a30c8-ffa7-4cda-bac7-ffc9602fbad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:12 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e18ddf2d-3dd4-4044-a1f7-04200c8de419 tempest-ProjectReaderTests-1503419375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a1a30c8-ffa7-4cda-bac7-ffc9602fbad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:28:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1130963739',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9ae70fc-b7e9-4344-9482-45c795144af2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1b11bcd358a43e481eb48a2ca75e005',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:28:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:28:12Z,use_quota=True,user_id='eec91f2b326e45d69ee8ff9681115a3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:12 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e18ddf2d-3dd4-4044-a1f7-04200c8de419 tempest-ProjectReaderTests-1503419375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61e51044-797b-4ef8-af49-926a067b51b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:12 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e18ddf2d-3dd4-4044-a1f7-04200c8de419 tempest-ProjectReaderTests-1503419375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61e51044-797b-4ef8-af49-926a067b51b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:12 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e18ddf2d-3dd4-4044-a1f7-04200c8de419 tempest-ProjectReaderTests-1503419375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d766c306-676c-434e-a1ef-04f7bf1c549b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:12 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e18ddf2d-3dd4-4044-a1f7-04200c8de419 tempest-ProjectReaderTests-1503419375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d766c306-676c-434e-a1ef-04f7bf1c549b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9ae70fc-b7e9-4344-9482-45c795144af2', 'volume_name': 'volume-e9ae70fc-b7e9-4344-9482-45c795144af2', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:12 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e18ddf2d-3dd4-4044-a1f7-04200c8de419 tempest-ProjectReaderTests-1503419375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50ab672c-f0ee-4755-b13b-97e5a66677f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:12 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e18ddf2d-3dd4-4044-a1f7-04200c8de419 tempest-ProjectReaderTests-1503419375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50ab672c-f0ee-4755-b13b-97e5a66677f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:12 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e18ddf2d-3dd4-4044-a1f7-04200c8de419 tempest-ProjectReaderTests-1503419375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0990ddc4-e5a2-40fc-a63d-2abbee0390dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:12 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-e18ddf2d-3dd4-4044-a1f7-04200c8de419 tempest-ProjectReaderTests-1503419375 None] Volume e9ae70fc-b7e9-4344-9482-45c795144af2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9ae70fc-b7e9-4344-9482-45c795144af2', 'volume_size': 1}
Jul 03 01:28:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e18ddf2d-3dd4-4044-a1f7-04200c8de419 tempest-ProjectReaderTests-1503419375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:28:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e18ddf2d-3dd4-4044-a1f7-04200c8de419 tempest-ProjectReaderTests-1503419375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:28:12 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-e18ddf2d-3dd4-4044-a1f7-04200c8de419 tempest-ProjectReaderTests-1503419375 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:28:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1130963739',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9ae70fc-b7e9-4344-9482-45c795144af2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1b11bcd358a43e481eb48a2ca75e005',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:28:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:28:12Z,use_quota=True,user_id='eec91f2b326e45d69ee8ff9681115a3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:28:12 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-e18ddf2d-3dd4-4044-a1f7-04200c8de419 tempest-ProjectReaderTests-1503419375 None] Creating volume e9ae70fc-b7e9-4344-9482-45c795144af2 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:28:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e18ddf2d-3dd4-4044-a1f7-04200c8de419 tempest-ProjectReaderTests-1503419375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:28:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e18ddf2d-3dd4-4044-a1f7-04200c8de419 tempest-ProjectReaderTests-1503419375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:28:12 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-e18ddf2d-3dd4-4044-a1f7-04200c8de419 tempest-ProjectReaderTests-1503419375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:28:12 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-e18ddf2d-3dd4-4044-a1f7-04200c8de419 tempest-ProjectReaderTests-1503419375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:28:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e18ddf2d-3dd4-4044-a1f7-04200c8de419 tempest-ProjectReaderTests-1503419375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:28:12 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-e18ddf2d-3dd4-4044-a1f7-04200c8de419 tempest-ProjectReaderTests-1503419375 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:28:12 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-e18ddf2d-3dd4-4044-a1f7-04200c8de419 tempest-ProjectReaderTests-1503419375 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:28:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e18ddf2d-3dd4-4044-a1f7-04200c8de419 tempest-ProjectReaderTests-1503419375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e9ae70fc-b7e9-4344-9482-45c795144af2 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:12 devstack sudo[106191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e9ae70fc-b7e9-4344-9482-45c795144af2 1073741824
Jul 03 01:28:12 devstack sudo[106191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:13 devstack sudo[106191]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e18ddf2d-3dd4-4044-a1f7-04200c8de419 tempest-ProjectReaderTests-1503419375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e9ae70fc-b7e9-4344-9482-45c795144af2 1073741824" returned: 0 in 0.786s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e18ddf2d-3dd4-4044-a1f7-04200c8de419 tempest-ProjectReaderTests-1503419375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e9ae70fc-b7e9-4344-9482-45c795144af2 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:13 devstack sudo[106196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e9ae70fc-b7e9-4344-9482-45c795144af2
Jul 03 01:28:13 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:13 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e18ddf2d-3dd4-4044-a1f7-04200c8de419 tempest-ProjectReaderTests-1503419375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e9ae70fc-b7e9-4344-9482-45c795144af2" returned: 0 in 0.644s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:13 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-e18ddf2d-3dd4-4044-a1f7-04200c8de419 tempest-ProjectReaderTests-1503419375 None] <== create_volume: return (1467ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:28:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e18ddf2d-3dd4-4044-a1f7-04200c8de419 tempest-ProjectReaderTests-1503419375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.470s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:28:14 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e18ddf2d-3dd4-4044-a1f7-04200c8de419 tempest-ProjectReaderTests-1503419375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0990ddc4-e5a2-40fc-a63d-2abbee0390dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9ae70fc-b7e9-4344-9482-45c795144af2', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:14 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e18ddf2d-3dd4-4044-a1f7-04200c8de419 tempest-ProjectReaderTests-1503419375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e85c532-f6f1-4a44-9514-d70d9edc2899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:14 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-e18ddf2d-3dd4-4044-a1f7-04200c8de419 tempest-ProjectReaderTests-1503419375 None] Volume volume-e9ae70fc-b7e9-4344-9482-45c795144af2 (e9ae70fc-b7e9-4344-9482-45c795144af2): created successfully
Jul 03 01:28:14 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e18ddf2d-3dd4-4044-a1f7-04200c8de419 tempest-ProjectReaderTests-1503419375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e85c532-f6f1-4a44-9514-d70d9edc2899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:14 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e18ddf2d-3dd4-4044-a1f7-04200c8de419 tempest-ProjectReaderTests-1503419375 None] Flow 'volume_create_manager' (35f8d8f5-c0bd-49eb-8dff-c1fabf66d96d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:28:14 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-e18ddf2d-3dd4-4044-a1f7-04200c8de419 tempest-ProjectReaderTests-1503419375 None] Created volume successfully.
Jul 03 01:28:14 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e24e53fc-6867-4581-b37f-e78c2eb586e9 tempest-ProjectReaderTests-1503419375 None] Acquiring lock "cinder-e9ae70fc-b7e9-4344-9482-45c795144af2-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:28:14 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e24e53fc-6867-4581-b37f-e78c2eb586e9 tempest-ProjectReaderTests-1503419375 None] Lock "cinder-e9ae70fc-b7e9-4344-9482-45c795144af2-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:28:14 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e24e53fc-6867-4581-b37f-e78c2eb586e9 tempest-ProjectReaderTests-1503419375 None] Acquiring lock "cinder-quobyte-e9ae70fc-b7e9-4344-9482-45c795144af2" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:28:14 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e24e53fc-6867-4581-b37f-e78c2eb586e9 tempest-ProjectReaderTests-1503419375 None] Lock "cinder-quobyte-e9ae70fc-b7e9-4344-9482-45c795144af2" acquired by "delete_volume" :: waited 0.017s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:28:14 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[9913b6d3-9384-4828-8b89-6be692a6e895]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:28:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e24e53fc-6867-4581-b37f-e78c2eb586e9 tempest-ProjectReaderTests-1503419375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e9ae70fc-b7e9-4344-9482-45c795144af2 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:14 devstack sudo[106199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e9ae70fc-b7e9-4344-9482-45c795144af2
Jul 03 01:28:14 devstack sudo[106199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:15 devstack sudo[106199]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e24e53fc-6867-4581-b37f-e78c2eb586e9 tempest-ProjectReaderTests-1503419375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e9ae70fc-b7e9-4344-9482-45c795144af2" returned: 0 in 0.735s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e24e53fc-6867-4581-b37f-e78c2eb586e9 tempest-ProjectReaderTests-1503419375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e9ae70fc-b7e9-4344-9482-45c795144af2 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:15 devstack sudo[106204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e9ae70fc-b7e9-4344-9482-45c795144af2
Jul 03 01:28:15 devstack sudo[106204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:16 devstack sudo[106204]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e24e53fc-6867-4581-b37f-e78c2eb586e9 tempest-ProjectReaderTests-1503419375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e9ae70fc-b7e9-4344-9482-45c795144af2" returned: 0 in 0.651s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:16 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e24e53fc-6867-4581-b37f-e78c2eb586e9 tempest-ProjectReaderTests-1503419375 None] Lock "cinder-quobyte-e9ae70fc-b7e9-4344-9482-45c795144af2" released by "delete_volume" :: held 1.421s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:28:16 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-e24e53fc-6867-4581-b37f-e78c2eb586e9 tempest-ProjectReaderTests-1503419375 None] Created reservations ['26e08e9c-a14f-4527-8885-77be91be930b', 'a89d5092-de90-4178-aa24-551da74e67f0', '1e7829a4-6e44-4fd0-98f2-ab44709351ec', '2e356797-9c74-41b4-b12d-be405887dbca'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:28:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e24e53fc-6867-4581-b37f-e78c2eb586e9 tempest-ProjectReaderTests-1503419375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:28:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e24e53fc-6867-4581-b37f-e78c2eb586e9 tempest-ProjectReaderTests-1503419375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:28:16 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-e24e53fc-6867-4581-b37f-e78c2eb586e9 tempest-ProjectReaderTests-1503419375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:28:16 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-e24e53fc-6867-4581-b37f-e78c2eb586e9 tempest-ProjectReaderTests-1503419375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:28:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e24e53fc-6867-4581-b37f-e78c2eb586e9 tempest-ProjectReaderTests-1503419375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:28:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e24e53fc-6867-4581-b37f-e78c2eb586e9 tempest-ProjectReaderTests-1503419375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:16 devstack sudo[106208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:28:16 devstack sudo[106208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:16 devstack sudo[106208]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e24e53fc-6867-4581-b37f-e78c2eb586e9 tempest-ProjectReaderTests-1503419375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.647s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:16 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-e24e53fc-6867-4581-b37f-e78c2eb586e9 tempest-ProjectReaderTests-1503419375 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:28:16 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-e24e53fc-6867-4581-b37f-e78c2eb586e9 tempest-ProjectReaderTests-1503419375 None] Deleted volume successfully.
Jul 03 01:28:16 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e24e53fc-6867-4581-b37f-e78c2eb586e9 tempest-ProjectReaderTests-1503419375 None] Lock "cinder-e9ae70fc-b7e9-4344-9482-45c795144af2-delete_volume" released by "delete_volume" :: held 2.255s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:28:17 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-500f8a06-37dc-4130-b44e-1b83894f7350 tempest-ProjectReaderTests-1503419375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:28:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-500f8a06-37dc-4130-b44e-1b83894f7350 tempest-ProjectReaderTests-1503419375 None] Flow 'volume_create_manager' (160da12f-8d4b-45a8-89a0-3a8cdd22965b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:28:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-500f8a06-37dc-4130-b44e-1b83894f7350 tempest-ProjectReaderTests-1503419375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eddad5e-b7ba-42df-bf64-70f6ffcb33c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-500f8a06-37dc-4130-b44e-1b83894f7350 tempest-ProjectReaderTests-1503419375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eddad5e-b7ba-42df-bf64-70f6ffcb33c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:28:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-707667456',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=877737dc-094d-42cb-a7b3-7500834f37bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1b11bcd358a43e481eb48a2ca75e005',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:28:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:28:17Z,use_quota=True,user_id='eec91f2b326e45d69ee8ff9681115a3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-500f8a06-37dc-4130-b44e-1b83894f7350 tempest-ProjectReaderTests-1503419375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72501ddd-7ee8-41ca-86e5-57520e498be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-500f8a06-37dc-4130-b44e-1b83894f7350 tempest-ProjectReaderTests-1503419375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72501ddd-7ee8-41ca-86e5-57520e498be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-500f8a06-37dc-4130-b44e-1b83894f7350 tempest-ProjectReaderTests-1503419375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40c9ca9d-87f4-46c2-be49-e269ffc55398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-500f8a06-37dc-4130-b44e-1b83894f7350 tempest-ProjectReaderTests-1503419375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40c9ca9d-87f4-46c2-be49-e269ffc55398) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '877737dc-094d-42cb-a7b3-7500834f37bb', 'volume_name': 'volume-877737dc-094d-42cb-a7b3-7500834f37bb', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-500f8a06-37dc-4130-b44e-1b83894f7350 tempest-ProjectReaderTests-1503419375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8954d633-8145-4d2c-9e3b-807ff2de201e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-500f8a06-37dc-4130-b44e-1b83894f7350 tempest-ProjectReaderTests-1503419375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8954d633-8145-4d2c-9e3b-807ff2de201e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-500f8a06-37dc-4130-b44e-1b83894f7350 tempest-ProjectReaderTests-1503419375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (059a96d5-e7ee-4518-b6de-edee733e0047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:17 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-500f8a06-37dc-4130-b44e-1b83894f7350 tempest-ProjectReaderTests-1503419375 None] Volume 877737dc-094d-42cb-a7b3-7500834f37bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-877737dc-094d-42cb-a7b3-7500834f37bb', 'volume_size': 1}
Jul 03 01:28:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-500f8a06-37dc-4130-b44e-1b83894f7350 tempest-ProjectReaderTests-1503419375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:28:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-500f8a06-37dc-4130-b44e-1b83894f7350 tempest-ProjectReaderTests-1503419375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:28:17 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-500f8a06-37dc-4130-b44e-1b83894f7350 tempest-ProjectReaderTests-1503419375 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:28:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-707667456',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=877737dc-094d-42cb-a7b3-7500834f37bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1b11bcd358a43e481eb48a2ca75e005',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:28:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:28:17Z,use_quota=True,user_id='eec91f2b326e45d69ee8ff9681115a3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:28:17 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-500f8a06-37dc-4130-b44e-1b83894f7350 tempest-ProjectReaderTests-1503419375 None] Creating volume 877737dc-094d-42cb-a7b3-7500834f37bb {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:28:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-500f8a06-37dc-4130-b44e-1b83894f7350 tempest-ProjectReaderTests-1503419375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:28:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-500f8a06-37dc-4130-b44e-1b83894f7350 tempest-ProjectReaderTests-1503419375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:28:17 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-500f8a06-37dc-4130-b44e-1b83894f7350 tempest-ProjectReaderTests-1503419375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:28:17 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-500f8a06-37dc-4130-b44e-1b83894f7350 tempest-ProjectReaderTests-1503419375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:28:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-500f8a06-37dc-4130-b44e-1b83894f7350 tempest-ProjectReaderTests-1503419375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:28:17 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-500f8a06-37dc-4130-b44e-1b83894f7350 tempest-ProjectReaderTests-1503419375 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:28:17 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-500f8a06-37dc-4130-b44e-1b83894f7350 tempest-ProjectReaderTests-1503419375 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:28:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-500f8a06-37dc-4130-b44e-1b83894f7350 tempest-ProjectReaderTests-1503419375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-877737dc-094d-42cb-a7b3-7500834f37bb 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:17 devstack sudo[106211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-877737dc-094d-42cb-a7b3-7500834f37bb 1073741824
Jul 03 01:28:17 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:18 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-500f8a06-37dc-4130-b44e-1b83894f7350 tempest-ProjectReaderTests-1503419375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-877737dc-094d-42cb-a7b3-7500834f37bb 1073741824" returned: 0 in 0.765s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-500f8a06-37dc-4130-b44e-1b83894f7350 tempest-ProjectReaderTests-1503419375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-877737dc-094d-42cb-a7b3-7500834f37bb {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:18 devstack sudo[106218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-877737dc-094d-42cb-a7b3-7500834f37bb
Jul 03 01:28:18 devstack sudo[106218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:18 devstack sudo[106218]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-500f8a06-37dc-4130-b44e-1b83894f7350 tempest-ProjectReaderTests-1503419375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-877737dc-094d-42cb-a7b3-7500834f37bb" returned: 0 in 0.615s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:18 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-500f8a06-37dc-4130-b44e-1b83894f7350 tempest-ProjectReaderTests-1503419375 None] <== create_volume: return (1424ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:28:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-500f8a06-37dc-4130-b44e-1b83894f7350 tempest-ProjectReaderTests-1503419375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.426s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:28:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-500f8a06-37dc-4130-b44e-1b83894f7350 tempest-ProjectReaderTests-1503419375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (059a96d5-e7ee-4518-b6de-edee733e0047) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-877737dc-094d-42cb-a7b3-7500834f37bb', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-500f8a06-37dc-4130-b44e-1b83894f7350 tempest-ProjectReaderTests-1503419375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac62ed33-1b40-494d-afb0-48c6e487bfed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:18 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-500f8a06-37dc-4130-b44e-1b83894f7350 tempest-ProjectReaderTests-1503419375 None] Volume volume-877737dc-094d-42cb-a7b3-7500834f37bb (877737dc-094d-42cb-a7b3-7500834f37bb): created successfully
Jul 03 01:28:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-500f8a06-37dc-4130-b44e-1b83894f7350 tempest-ProjectReaderTests-1503419375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac62ed33-1b40-494d-afb0-48c6e487bfed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-500f8a06-37dc-4130-b44e-1b83894f7350 tempest-ProjectReaderTests-1503419375 None] Flow 'volume_create_manager' (160da12f-8d4b-45a8-89a0-3a8cdd22965b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:28:18 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-500f8a06-37dc-4130-b44e-1b83894f7350 tempest-ProjectReaderTests-1503419375 None] Created volume successfully.
Jul 03 01:28:19 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-127c2615-4007-41cb-a6b1-020b24d26536 tempest-ProjectReaderTests-1503419375 None] Acquiring lock "cinder-877737dc-094d-42cb-a7b3-7500834f37bb-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:28:19 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-127c2615-4007-41cb-a6b1-020b24d26536 tempest-ProjectReaderTests-1503419375 None] Lock "cinder-877737dc-094d-42cb-a7b3-7500834f37bb-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:28:19 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-127c2615-4007-41cb-a6b1-020b24d26536 tempest-ProjectReaderTests-1503419375 None] Acquiring lock "cinder-quobyte-877737dc-094d-42cb-a7b3-7500834f37bb" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:28:19 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-127c2615-4007-41cb-a6b1-020b24d26536 tempest-ProjectReaderTests-1503419375 None] Lock "cinder-quobyte-877737dc-094d-42cb-a7b3-7500834f37bb" acquired by "delete_volume" :: waited 0.021s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:28:19 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[24794476-a2b0-4da4-92bf-9888f04f62e5]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:28:19 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-127c2615-4007-41cb-a6b1-020b24d26536 tempest-ProjectReaderTests-1503419375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-877737dc-094d-42cb-a7b3-7500834f37bb {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:19 devstack sudo[106222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-877737dc-094d-42cb-a7b3-7500834f37bb
Jul 03 01:28:19 devstack sudo[106222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:20 devstack sudo[106222]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-127c2615-4007-41cb-a6b1-020b24d26536 tempest-ProjectReaderTests-1503419375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-877737dc-094d-42cb-a7b3-7500834f37bb" returned: 0 in 0.780s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-127c2615-4007-41cb-a6b1-020b24d26536 tempest-ProjectReaderTests-1503419375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-877737dc-094d-42cb-a7b3-7500834f37bb {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:20 devstack sudo[106227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-877737dc-094d-42cb-a7b3-7500834f37bb
Jul 03 01:28:20 devstack sudo[106227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:20 devstack sudo[106227]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-127c2615-4007-41cb-a6b1-020b24d26536 tempest-ProjectReaderTests-1503419375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-877737dc-094d-42cb-a7b3-7500834f37bb" returned: 0 in 0.638s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:20 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-127c2615-4007-41cb-a6b1-020b24d26536 tempest-ProjectReaderTests-1503419375 None] Lock "cinder-quobyte-877737dc-094d-42cb-a7b3-7500834f37bb" released by "delete_volume" :: held 1.457s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:28:20 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-127c2615-4007-41cb-a6b1-020b24d26536 tempest-ProjectReaderTests-1503419375 None] Created reservations ['36c8a55f-ba44-409a-ba94-e05e9eeabf57', '6bc2191b-5167-4b0f-8b07-65dd342f5a3b', '50ed2be8-cb95-45fb-bc6f-dc10398cfec7', '7ce7a1b7-0613-4a70-95b2-7244f51552ba'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:28:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-127c2615-4007-41cb-a6b1-020b24d26536 tempest-ProjectReaderTests-1503419375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:28:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-127c2615-4007-41cb-a6b1-020b24d26536 tempest-ProjectReaderTests-1503419375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:28:21 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-127c2615-4007-41cb-a6b1-020b24d26536 tempest-ProjectReaderTests-1503419375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:28:21 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-127c2615-4007-41cb-a6b1-020b24d26536 tempest-ProjectReaderTests-1503419375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:28:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-127c2615-4007-41cb-a6b1-020b24d26536 tempest-ProjectReaderTests-1503419375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:28:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-127c2615-4007-41cb-a6b1-020b24d26536 tempest-ProjectReaderTests-1503419375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:21 devstack sudo[106232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:28:21 devstack sudo[106232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:21 devstack sudo[106232]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-127c2615-4007-41cb-a6b1-020b24d26536 tempest-ProjectReaderTests-1503419375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.624s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:21 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-127c2615-4007-41cb-a6b1-020b24d26536 tempest-ProjectReaderTests-1503419375 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:28:21 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-127c2615-4007-41cb-a6b1-020b24d26536 tempest-ProjectReaderTests-1503419375 None] Deleted volume successfully.
Jul 03 01:28:21 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-127c2615-4007-41cb-a6b1-020b24d26536 tempest-ProjectReaderTests-1503419375 None] Lock "cinder-877737dc-094d-42cb-a7b3-7500834f37bb-delete_volume" released by "delete_volume" :: held 2.288s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:28:22 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5fe7aee-15d7-4d22-89c2-a0d788e0f07c tempest-ProjectReaderTests-1503419375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:28:22 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b5fe7aee-15d7-4d22-89c2-a0d788e0f07c tempest-ProjectReaderTests-1503419375 None] Flow 'volume_create_manager' (4c6684cc-a075-45be-88e9-dd4b7ea129d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:28:22 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b5fe7aee-15d7-4d22-89c2-a0d788e0f07c tempest-ProjectReaderTests-1503419375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cf46c1f-bca0-4f9f-be00-aa99781f3876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:22 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b5fe7aee-15d7-4d22-89c2-a0d788e0f07c tempest-ProjectReaderTests-1503419375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cf46c1f-bca0-4f9f-be00-aa99781f3876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:28:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-407491671',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48191ecd-f861-4ea3-80e3-bf2f9d1a9e38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1b11bcd358a43e481eb48a2ca75e005',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:28:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:28:22Z,use_quota=True,user_id='eec91f2b326e45d69ee8ff9681115a3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:22 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b5fe7aee-15d7-4d22-89c2-a0d788e0f07c tempest-ProjectReaderTests-1503419375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f522fa48-fc1a-4abf-b66a-64396409783f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:22 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b5fe7aee-15d7-4d22-89c2-a0d788e0f07c tempest-ProjectReaderTests-1503419375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f522fa48-fc1a-4abf-b66a-64396409783f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:22 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b5fe7aee-15d7-4d22-89c2-a0d788e0f07c tempest-ProjectReaderTests-1503419375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aad0c71-c954-4b61-b2bb-c40d476896c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:22 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b5fe7aee-15d7-4d22-89c2-a0d788e0f07c tempest-ProjectReaderTests-1503419375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aad0c71-c954-4b61-b2bb-c40d476896c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48191ecd-f861-4ea3-80e3-bf2f9d1a9e38', 'volume_name': 'volume-48191ecd-f861-4ea3-80e3-bf2f9d1a9e38', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:22 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b5fe7aee-15d7-4d22-89c2-a0d788e0f07c tempest-ProjectReaderTests-1503419375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cdbfe67-3529-4a23-974a-db91319468e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:22 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b5fe7aee-15d7-4d22-89c2-a0d788e0f07c tempest-ProjectReaderTests-1503419375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cdbfe67-3529-4a23-974a-db91319468e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:22 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b5fe7aee-15d7-4d22-89c2-a0d788e0f07c tempest-ProjectReaderTests-1503419375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb4d2972-010b-408e-8e02-fed4258cd646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:22 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-b5fe7aee-15d7-4d22-89c2-a0d788e0f07c tempest-ProjectReaderTests-1503419375 None] Volume 48191ecd-f861-4ea3-80e3-bf2f9d1a9e38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48191ecd-f861-4ea3-80e3-bf2f9d1a9e38', 'volume_size': 1}
Jul 03 01:28:22 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b5fe7aee-15d7-4d22-89c2-a0d788e0f07c tempest-ProjectReaderTests-1503419375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:28:22 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b5fe7aee-15d7-4d22-89c2-a0d788e0f07c tempest-ProjectReaderTests-1503419375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:28:22 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-b5fe7aee-15d7-4d22-89c2-a0d788e0f07c tempest-ProjectReaderTests-1503419375 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:28:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-407491671',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48191ecd-f861-4ea3-80e3-bf2f9d1a9e38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1b11bcd358a43e481eb48a2ca75e005',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:28:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:28:22Z,use_quota=True,user_id='eec91f2b326e45d69ee8ff9681115a3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:28:22 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-b5fe7aee-15d7-4d22-89c2-a0d788e0f07c tempest-ProjectReaderTests-1503419375 None] Creating volume 48191ecd-f861-4ea3-80e3-bf2f9d1a9e38 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:28:22 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b5fe7aee-15d7-4d22-89c2-a0d788e0f07c tempest-ProjectReaderTests-1503419375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:28:22 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b5fe7aee-15d7-4d22-89c2-a0d788e0f07c tempest-ProjectReaderTests-1503419375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:28:22 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-b5fe7aee-15d7-4d22-89c2-a0d788e0f07c tempest-ProjectReaderTests-1503419375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:28:22 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-b5fe7aee-15d7-4d22-89c2-a0d788e0f07c tempest-ProjectReaderTests-1503419375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:28:22 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b5fe7aee-15d7-4d22-89c2-a0d788e0f07c tempest-ProjectReaderTests-1503419375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:28:22 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-b5fe7aee-15d7-4d22-89c2-a0d788e0f07c tempest-ProjectReaderTests-1503419375 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:28:22 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-b5fe7aee-15d7-4d22-89c2-a0d788e0f07c tempest-ProjectReaderTests-1503419375 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:28:22 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b5fe7aee-15d7-4d22-89c2-a0d788e0f07c tempest-ProjectReaderTests-1503419375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-48191ecd-f861-4ea3-80e3-bf2f9d1a9e38 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:22 devstack sudo[106235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-48191ecd-f861-4ea3-80e3-bf2f9d1a9e38 1073741824
Jul 03 01:28:22 devstack sudo[106235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:22 devstack sudo[106235]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:22 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b5fe7aee-15d7-4d22-89c2-a0d788e0f07c tempest-ProjectReaderTests-1503419375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-48191ecd-f861-4ea3-80e3-bf2f9d1a9e38 1073741824" returned: 0 in 0.772s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:22 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b5fe7aee-15d7-4d22-89c2-a0d788e0f07c tempest-ProjectReaderTests-1503419375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-48191ecd-f861-4ea3-80e3-bf2f9d1a9e38 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:22 devstack sudo[106241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-48191ecd-f861-4ea3-80e3-bf2f9d1a9e38
Jul 03 01:28:22 devstack sudo[106241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:23 devstack sudo[106241]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b5fe7aee-15d7-4d22-89c2-a0d788e0f07c tempest-ProjectReaderTests-1503419375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-48191ecd-f861-4ea3-80e3-bf2f9d1a9e38" returned: 0 in 0.613s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:23 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-b5fe7aee-15d7-4d22-89c2-a0d788e0f07c tempest-ProjectReaderTests-1503419375 None] <== create_volume: return (1433ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:28:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b5fe7aee-15d7-4d22-89c2-a0d788e0f07c tempest-ProjectReaderTests-1503419375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.435s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:28:23 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b5fe7aee-15d7-4d22-89c2-a0d788e0f07c tempest-ProjectReaderTests-1503419375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb4d2972-010b-408e-8e02-fed4258cd646) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48191ecd-f861-4ea3-80e3-bf2f9d1a9e38', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:23 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b5fe7aee-15d7-4d22-89c2-a0d788e0f07c tempest-ProjectReaderTests-1503419375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ff606f4-613f-4166-bb59-8932b28d201f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:23 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-b5fe7aee-15d7-4d22-89c2-a0d788e0f07c tempest-ProjectReaderTests-1503419375 None] Volume volume-48191ecd-f861-4ea3-80e3-bf2f9d1a9e38 (48191ecd-f861-4ea3-80e3-bf2f9d1a9e38): created successfully
Jul 03 01:28:23 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b5fe7aee-15d7-4d22-89c2-a0d788e0f07c tempest-ProjectReaderTests-1503419375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ff606f4-613f-4166-bb59-8932b28d201f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:23 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b5fe7aee-15d7-4d22-89c2-a0d788e0f07c tempest-ProjectReaderTests-1503419375 None] Flow 'volume_create_manager' (4c6684cc-a075-45be-88e9-dd4b7ea129d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:28:23 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-b5fe7aee-15d7-4d22-89c2-a0d788e0f07c tempest-ProjectReaderTests-1503419375 None] Created volume successfully.
Jul 03 01:28:24 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-4c4becb6-5402-46a6-8088-6f98400e50d3 tempest-ProjectReaderTests-1503419375 None] Acquiring lock "cinder-48191ecd-f861-4ea3-80e3-bf2f9d1a9e38-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:28:24 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-4c4becb6-5402-46a6-8088-6f98400e50d3 tempest-ProjectReaderTests-1503419375 None] Lock "cinder-48191ecd-f861-4ea3-80e3-bf2f9d1a9e38-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:28:24 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-4c4becb6-5402-46a6-8088-6f98400e50d3 tempest-ProjectReaderTests-1503419375 None] Acquiring lock "cinder-quobyte-48191ecd-f861-4ea3-80e3-bf2f9d1a9e38" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:28:24 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-4c4becb6-5402-46a6-8088-6f98400e50d3 tempest-ProjectReaderTests-1503419375 None] Lock "cinder-quobyte-48191ecd-f861-4ea3-80e3-bf2f9d1a9e38" acquired by "delete_volume" :: waited 0.016s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:28:24 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[d35873f5-f940-49e3-8687-d5d2ec6be181]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:28:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-4c4becb6-5402-46a6-8088-6f98400e50d3 tempest-ProjectReaderTests-1503419375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-48191ecd-f861-4ea3-80e3-bf2f9d1a9e38 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:24 devstack sudo[106244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-48191ecd-f861-4ea3-80e3-bf2f9d1a9e38
Jul 03 01:28:24 devstack sudo[106244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:24 devstack sudo[106244]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-4c4becb6-5402-46a6-8088-6f98400e50d3 tempest-ProjectReaderTests-1503419375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-48191ecd-f861-4ea3-80e3-bf2f9d1a9e38" returned: 0 in 0.727s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-4c4becb6-5402-46a6-8088-6f98400e50d3 tempest-ProjectReaderTests-1503419375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-48191ecd-f861-4ea3-80e3-bf2f9d1a9e38 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:24 devstack sudo[106249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-48191ecd-f861-4ea3-80e3-bf2f9d1a9e38
Jul 03 01:28:24 devstack sudo[106249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:25 devstack sudo[106249]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-4c4becb6-5402-46a6-8088-6f98400e50d3 tempest-ProjectReaderTests-1503419375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-48191ecd-f861-4ea3-80e3-bf2f9d1a9e38" returned: 0 in 0.612s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:25 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-4c4becb6-5402-46a6-8088-6f98400e50d3 tempest-ProjectReaderTests-1503419375 None] Lock "cinder-quobyte-48191ecd-f861-4ea3-80e3-bf2f9d1a9e38" released by "delete_volume" :: held 1.375s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:28:25 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-4c4becb6-5402-46a6-8088-6f98400e50d3 tempest-ProjectReaderTests-1503419375 None] Created reservations ['b9832146-b075-4ed3-b047-c5ec397afc67', '1a0546fc-4aa9-4a51-9b63-bb08646ab4d7', 'e30b17cf-4107-47eb-84c2-339a49620084', '22588847-8e63-40f6-951d-e99e481a953b'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:28:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-4c4becb6-5402-46a6-8088-6f98400e50d3 tempest-ProjectReaderTests-1503419375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:28:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-4c4becb6-5402-46a6-8088-6f98400e50d3 tempest-ProjectReaderTests-1503419375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:28:25 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-4c4becb6-5402-46a6-8088-6f98400e50d3 tempest-ProjectReaderTests-1503419375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:28:25 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-4c4becb6-5402-46a6-8088-6f98400e50d3 tempest-ProjectReaderTests-1503419375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:28:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-4c4becb6-5402-46a6-8088-6f98400e50d3 tempest-ProjectReaderTests-1503419375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:28:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-4c4becb6-5402-46a6-8088-6f98400e50d3 tempest-ProjectReaderTests-1503419375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:25 devstack sudo[106252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:28:25 devstack sudo[106252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:26 devstack sudo[106252]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:26 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-4c4becb6-5402-46a6-8088-6f98400e50d3 tempest-ProjectReaderTests-1503419375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.602s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:26 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-4c4becb6-5402-46a6-8088-6f98400e50d3 tempest-ProjectReaderTests-1503419375 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:28:26 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-4c4becb6-5402-46a6-8088-6f98400e50d3 tempest-ProjectReaderTests-1503419375 None] Deleted volume successfully.
Jul 03 01:28:26 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-4c4becb6-5402-46a6-8088-6f98400e50d3 tempest-ProjectReaderTests-1503419375 None] Lock "cinder-48191ecd-f861-4ea3-80e3-bf2f9d1a9e38-delete_volume" released by "delete_volume" :: held 2.161s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:28:35 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:DELETE=5,cinder:SELECT=42,cinder:INSERT=17,cinder:UPDATE=67 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:28:36 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:UPDATE=66,cinder:SELECT=45,cinder:INSERT=15,cinder:DELETE=6 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:28:37 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd4e93c1-8cc8-4c24-9011-808b8f9859b9 tempest-CreateVolumesFromSnapshotTest-405548807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:28:37 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-dd4e93c1-8cc8-4c24-9011-808b8f9859b9 tempest-CreateVolumesFromSnapshotTest-405548807 None] Flow 'volume_create_manager' (00ce3149-fc2b-4f34-bab2-ec4b39cb828e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:28:37 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-dd4e93c1-8cc8-4c24-9011-808b8f9859b9 tempest-CreateVolumesFromSnapshotTest-405548807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b56c8f62-4e51-46a5-9bb2-62b72f45fa50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:37 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-dd4e93c1-8cc8-4c24-9011-808b8f9859b9 tempest-CreateVolumesFromSnapshotTest-405548807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b56c8f62-4e51-46a5-9bb2-62b72f45fa50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:28:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-793491279',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d848e64e-0132-492f-ae40-b97334eb11a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22132ab0ea9b4ea988edd18ae904eedf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:28:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:28:38Z,use_quota=True,user_id='a2a91733885b484e97b56b50f871d19f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:37 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-dd4e93c1-8cc8-4c24-9011-808b8f9859b9 tempest-CreateVolumesFromSnapshotTest-405548807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d100dae1-10e6-42bc-9c5e-19b477e4affb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:37 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-dd4e93c1-8cc8-4c24-9011-808b8f9859b9 tempest-CreateVolumesFromSnapshotTest-405548807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d100dae1-10e6-42bc-9c5e-19b477e4affb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:37 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-dd4e93c1-8cc8-4c24-9011-808b8f9859b9 tempest-CreateVolumesFromSnapshotTest-405548807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (050dac74-8386-4524-8aa0-fba368817940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:37 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-dd4e93c1-8cc8-4c24-9011-808b8f9859b9 tempest-CreateVolumesFromSnapshotTest-405548807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (050dac74-8386-4524-8aa0-fba368817940) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd848e64e-0132-492f-ae40-b97334eb11a0', 'volume_name': 'volume-d848e64e-0132-492f-ae40-b97334eb11a0', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:37 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-dd4e93c1-8cc8-4c24-9011-808b8f9859b9 tempest-CreateVolumesFromSnapshotTest-405548807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97306caa-57ec-4e2a-ac63-7dfecd436dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:37 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-dd4e93c1-8cc8-4c24-9011-808b8f9859b9 tempest-CreateVolumesFromSnapshotTest-405548807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97306caa-57ec-4e2a-ac63-7dfecd436dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:37 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-dd4e93c1-8cc8-4c24-9011-808b8f9859b9 tempest-CreateVolumesFromSnapshotTest-405548807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3b967e0-d428-4db3-aa23-21e57827953b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:37 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-dd4e93c1-8cc8-4c24-9011-808b8f9859b9 tempest-CreateVolumesFromSnapshotTest-405548807 None] Volume d848e64e-0132-492f-ae40-b97334eb11a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d848e64e-0132-492f-ae40-b97334eb11a0', 'volume_size': 1}
Jul 03 01:28:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-dd4e93c1-8cc8-4c24-9011-808b8f9859b9 tempest-CreateVolumesFromSnapshotTest-405548807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:28:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-dd4e93c1-8cc8-4c24-9011-808b8f9859b9 tempest-CreateVolumesFromSnapshotTest-405548807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:28:37 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-dd4e93c1-8cc8-4c24-9011-808b8f9859b9 tempest-CreateVolumesFromSnapshotTest-405548807 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:28:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-793491279',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d848e64e-0132-492f-ae40-b97334eb11a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22132ab0ea9b4ea988edd18ae904eedf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:28:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:28:38Z,use_quota=True,user_id='a2a91733885b484e97b56b50f871d19f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:28:37 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-dd4e93c1-8cc8-4c24-9011-808b8f9859b9 tempest-CreateVolumesFromSnapshotTest-405548807 None] Creating volume d848e64e-0132-492f-ae40-b97334eb11a0 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:28:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-dd4e93c1-8cc8-4c24-9011-808b8f9859b9 tempest-CreateVolumesFromSnapshotTest-405548807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:28:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-dd4e93c1-8cc8-4c24-9011-808b8f9859b9 tempest-CreateVolumesFromSnapshotTest-405548807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:28:37 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-dd4e93c1-8cc8-4c24-9011-808b8f9859b9 tempest-CreateVolumesFromSnapshotTest-405548807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:28:37 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-dd4e93c1-8cc8-4c24-9011-808b8f9859b9 tempest-CreateVolumesFromSnapshotTest-405548807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:28:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-dd4e93c1-8cc8-4c24-9011-808b8f9859b9 tempest-CreateVolumesFromSnapshotTest-405548807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:28:37 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-dd4e93c1-8cc8-4c24-9011-808b8f9859b9 tempest-CreateVolumesFromSnapshotTest-405548807 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:28:37 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-dd4e93c1-8cc8-4c24-9011-808b8f9859b9 tempest-CreateVolumesFromSnapshotTest-405548807 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:28:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-dd4e93c1-8cc8-4c24-9011-808b8f9859b9 tempest-CreateVolumesFromSnapshotTest-405548807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d848e64e-0132-492f-ae40-b97334eb11a0 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:38 devstack sudo[106328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d848e64e-0132-492f-ae40-b97334eb11a0 1073741824
Jul 03 01:28:38 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:38 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-dd4e93c1-8cc8-4c24-9011-808b8f9859b9 tempest-CreateVolumesFromSnapshotTest-405548807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d848e64e-0132-492f-ae40-b97334eb11a0 1073741824" returned: 0 in 0.972s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-dd4e93c1-8cc8-4c24-9011-808b8f9859b9 tempest-CreateVolumesFromSnapshotTest-405548807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d848e64e-0132-492f-ae40-b97334eb11a0 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:39 devstack sudo[106335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d848e64e-0132-492f-ae40-b97334eb11a0
Jul 03 01:28:39 devstack sudo[106335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:39 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c17c215-19c7-4ca9-bc1d-c68533cf4585 tempest-ProjectMemberTests-1866302072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:28:39 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-2c17c215-19c7-4ca9-bc1d-c68533cf4585 tempest-ProjectMemberTests-1866302072 None] Flow 'volume_create_manager' (4d8577c7-a095-4dbf-957b-9383709b676b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:28:39 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-2c17c215-19c7-4ca9-bc1d-c68533cf4585 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (864a7c4d-facd-4cb5-85e8-0e92fc94420f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:39 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-2c17c215-19c7-4ca9-bc1d-c68533cf4585 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (864a7c4d-facd-4cb5-85e8-0e92fc94420f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:28:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1076739782',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ea1672a-0874-448b-8331-528a04b1268f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16429f2745354b0591f4044f3a99b9fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:28:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:28:39Z,use_quota=True,user_id='31dd51f2dcdd4724a4c6b78cb80e6d8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:39 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-2c17c215-19c7-4ca9-bc1d-c68533cf4585 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79852972-34b2-4412-aed1-df1b10890248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:39 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-2c17c215-19c7-4ca9-bc1d-c68533cf4585 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79852972-34b2-4412-aed1-df1b10890248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:39 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-2c17c215-19c7-4ca9-bc1d-c68533cf4585 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (816fdd5e-474c-4f8e-9ce7-64ce757fc088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:39 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-2c17c215-19c7-4ca9-bc1d-c68533cf4585 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (816fdd5e-474c-4f8e-9ce7-64ce757fc088) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ea1672a-0874-448b-8331-528a04b1268f', 'volume_name': 'volume-9ea1672a-0874-448b-8331-528a04b1268f', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:39 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-2c17c215-19c7-4ca9-bc1d-c68533cf4585 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bb95f2e-dcc9-43e8-a6e7-613bda46e10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:39 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-2c17c215-19c7-4ca9-bc1d-c68533cf4585 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bb95f2e-dcc9-43e8-a6e7-613bda46e10f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:39 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-2c17c215-19c7-4ca9-bc1d-c68533cf4585 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (814b524e-81d5-4143-bbc9-db658e7953c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:39 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-2c17c215-19c7-4ca9-bc1d-c68533cf4585 tempest-ProjectMemberTests-1866302072 None] Volume 9ea1672a-0874-448b-8331-528a04b1268f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ea1672a-0874-448b-8331-528a04b1268f', 'volume_size': 1}
Jul 03 01:28:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-2c17c215-19c7-4ca9-bc1d-c68533cf4585 tempest-ProjectMemberTests-1866302072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:28:39 devstack sudo[106335]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-dd4e93c1-8cc8-4c24-9011-808b8f9859b9 tempest-CreateVolumesFromSnapshotTest-405548807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d848e64e-0132-492f-ae40-b97334eb11a0" returned: 0 in 0.744s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:39 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-dd4e93c1-8cc8-4c24-9011-808b8f9859b9 tempest-CreateVolumesFromSnapshotTest-405548807 None] <== create_volume: return (1772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:28:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-dd4e93c1-8cc8-4c24-9011-808b8f9859b9 tempest-CreateVolumesFromSnapshotTest-405548807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.776s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:28:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-2c17c215-19c7-4ca9-bc1d-c68533cf4585 tempest-ProjectMemberTests-1866302072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.377s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:28:39 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-2c17c215-19c7-4ca9-bc1d-c68533cf4585 tempest-ProjectMemberTests-1866302072 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:28:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1076739782',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ea1672a-0874-448b-8331-528a04b1268f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16429f2745354b0591f4044f3a99b9fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:28:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:28:39Z,use_quota=True,user_id='31dd51f2dcdd4724a4c6b78cb80e6d8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:28:39 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-2c17c215-19c7-4ca9-bc1d-c68533cf4585 tempest-ProjectMemberTests-1866302072 None] Creating volume 9ea1672a-0874-448b-8331-528a04b1268f {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:28:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-2c17c215-19c7-4ca9-bc1d-c68533cf4585 tempest-ProjectMemberTests-1866302072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:28:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-2c17c215-19c7-4ca9-bc1d-c68533cf4585 tempest-ProjectMemberTests-1866302072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:28:39 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-2c17c215-19c7-4ca9-bc1d-c68533cf4585 tempest-ProjectMemberTests-1866302072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:28:39 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-2c17c215-19c7-4ca9-bc1d-c68533cf4585 tempest-ProjectMemberTests-1866302072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:28:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-2c17c215-19c7-4ca9-bc1d-c68533cf4585 tempest-ProjectMemberTests-1866302072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:28:39 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-2c17c215-19c7-4ca9-bc1d-c68533cf4585 tempest-ProjectMemberTests-1866302072 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:28:39 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-2c17c215-19c7-4ca9-bc1d-c68533cf4585 tempest-ProjectMemberTests-1866302072 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:28:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-2c17c215-19c7-4ca9-bc1d-c68533cf4585 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9ea1672a-0874-448b-8331-528a04b1268f 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:39 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-dd4e93c1-8cc8-4c24-9011-808b8f9859b9 tempest-CreateVolumesFromSnapshotTest-405548807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3b967e0-d428-4db3-aa23-21e57827953b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d848e64e-0132-492f-ae40-b97334eb11a0', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:39 devstack sudo[106338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9ea1672a-0874-448b-8331-528a04b1268f 1073741824
Jul 03 01:28:39 devstack sudo[106338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:39 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-dd4e93c1-8cc8-4c24-9011-808b8f9859b9 tempest-CreateVolumesFromSnapshotTest-405548807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c42e28a-99ce-4f01-aa7c-b7820d05623a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:39 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-dd4e93c1-8cc8-4c24-9011-808b8f9859b9 tempest-CreateVolumesFromSnapshotTest-405548807 None] Volume volume-d848e64e-0132-492f-ae40-b97334eb11a0 (d848e64e-0132-492f-ae40-b97334eb11a0): created successfully
Jul 03 01:28:39 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-dd4e93c1-8cc8-4c24-9011-808b8f9859b9 tempest-CreateVolumesFromSnapshotTest-405548807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c42e28a-99ce-4f01-aa7c-b7820d05623a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:39 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-dd4e93c1-8cc8-4c24-9011-808b8f9859b9 tempest-CreateVolumesFromSnapshotTest-405548807 None] Flow 'volume_create_manager' (00ce3149-fc2b-4f34-bab2-ec4b39cb828e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:28:39 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-dd4e93c1-8cc8-4c24-9011-808b8f9859b9 tempest-CreateVolumesFromSnapshotTest-405548807 None] Created volume successfully.
Jul 03 01:28:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b9549d64-da01-4971-bbf1-ceb334ad803a tempest-CreateVolumesFromSnapshotTest-405548807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:28:40 devstack sudo[106338]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-2c17c215-19c7-4ca9-bc1d-c68533cf4585 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9ea1672a-0874-448b-8331-528a04b1268f 1073741824" returned: 0 in 1.119s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-2c17c215-19c7-4ca9-bc1d-c68533cf4585 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9ea1672a-0874-448b-8331-528a04b1268f {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:40 devstack sudo[106344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9ea1672a-0874-448b-8331-528a04b1268f
Jul 03 01:28:40 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:41 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:28:41 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] Flow 'volume_create_manager' (532b8f34-b41c-44a4-87ec-7fbfdc4d40ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:28:41 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (335560d1-7a96-4e16-9c93-bc6d9728cac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:41 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (335560d1-7a96-4e16-9c93-bc6d9728cac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:28:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bf43a33-20d0-443b-b52b-4fa74bb25616,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6563e733af447119e3b7053f3c3b1f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:28:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:28:41Z,use_quota=True,user_id='c421e69cca9643c4a0685495da019d05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:41 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cffb509-6f11-4f15-8fe8-9a56ef32fabf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:41 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cffb509-6f11-4f15-8fe8-9a56ef32fabf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:41 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d8b8490-ac47-4a2a-b110-f4f69a2484e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:41 devstack cinder-volume[86891]: DEBUG cinder.image.glance [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] Creating Keystone auth plugin from conf {{(pid=86891) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 03 01:28:41 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-2c17c215-19c7-4ca9-bc1d-c68533cf4585 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9ea1672a-0874-448b-8331-528a04b1268f" returned: 0 in 0.732s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:41 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-2c17c215-19c7-4ca9-bc1d-c68533cf4585 tempest-ProjectMemberTests-1866302072 None] <== create_volume: return (1896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:28:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-2c17c215-19c7-4ca9-bc1d-c68533cf4585 tempest-ProjectMemberTests-1866302072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.899s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:28:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b9549d64-da01-4971-bbf1-ceb334ad803a tempest-CreateVolumesFromSnapshotTest-405548807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.361s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:28:41 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-2c17c215-19c7-4ca9-bc1d-c68533cf4585 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (814b524e-81d5-4143-bbc9-db658e7953c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ea1672a-0874-448b-8331-528a04b1268f', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:41 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-2c17c215-19c7-4ca9-bc1d-c68533cf4585 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8feaadc5-955e-4260-8451-c2aaa37146fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:41 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-b9549d64-da01-4971-bbf1-ceb334ad803a tempest-CreateVolumesFromSnapshotTest-405548807 None] Creating offline snapshot b0ceb4db-4cff-4fed-a435-bb7eba4a9d65 of volume d848e64e-0132-492f-ae40-b97334eb11a0 {{(pid=86891) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 01:28:41 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-2c17c215-19c7-4ca9-bc1d-c68533cf4585 tempest-ProjectMemberTests-1866302072 None] Volume volume-9ea1672a-0874-448b-8331-528a04b1268f (9ea1672a-0874-448b-8331-528a04b1268f): created successfully
Jul 03 01:28:41 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-2c17c215-19c7-4ca9-bc1d-c68533cf4585 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8feaadc5-955e-4260-8451-c2aaa37146fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:41 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-2c17c215-19c7-4ca9-bc1d-c68533cf4585 tempest-ProjectMemberTests-1866302072 None] Flow 'volume_create_manager' (4d8577c7-a095-4dbf-957b-9383709b676b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:28:41 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[69800dad-0883-47fb-a74a-1437438c0738]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:28:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b9549d64-da01-4971-bbf1-ceb334ad803a tempest-CreateVolumesFromSnapshotTest-405548807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d848e64e-0132-492f-ae40-b97334eb11a0 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:41 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-2c17c215-19c7-4ca9-bc1d-c68533cf4585 tempest-ProjectMemberTests-1866302072 None] Created volume successfully.
Jul 03 01:28:41 devstack sudo[106353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d848e64e-0132-492f-ae40-b97334eb11a0
Jul 03 01:28:41 devstack sudo[106353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:41 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d8b8490-ac47-4a2a-b110-f4f69a2484e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8bf43a33-20d0-443b-b52b-4fa74bb25616', 'volume_name': 'volume-8bf43a33-20d0-443b-b52b-4fa74bb25616', 'volume_size': 1, 'image_id': 'cf8c8570-d17b-49f7-8d5f-8b5c8abf879e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cf8c8570-d17b-49f7-8d5f-8b5c8abf879e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '38cd87eea0c24646ab5dc3946452b966', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a6563e733af447119e3b7053f3c3b1f1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '88b34bbd65dfac70a061e9510a01ed2c24367101276328d97b8290a1f37e31064ce588b31c8e3831a51d9b3034fd2ee3cc7023dcffb86151395f37e0884dbc11', 'id': 'cf8c8570-d17b-49f7-8d5f-8b5c8abf879e', 'created_at': datetime.datetime(2026, 7, 2, 23, 28, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 23, 28, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cf8c8570-d17b-49f7-8d5f-8b5c8abf879e/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7c5b357813d0>}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:41 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (371e265e-1abc-4c25-bfc2-ef4f43edb523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:41 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (371e265e-1abc-4c25-bfc2-ef4f43edb523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:41 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7227e882-367c-4240-91ec-7160a980d5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:41 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] Volume 8bf43a33-20d0-443b-b52b-4fa74bb25616: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8bf43a33-20d0-443b-b52b-4fa74bb25616', 'volume_size': 1, 'image_id': 'cf8c8570-d17b-49f7-8d5f-8b5c8abf879e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cf8c8570-d17b-49f7-8d5f-8b5c8abf879e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '38cd87eea0c24646ab5dc3946452b966', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a6563e733af447119e3b7053f3c3b1f1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '88b34bbd65dfac70a061e9510a01ed2c24367101276328d97b8290a1f37e31064ce588b31c8e3831a51d9b3034fd2ee3cc7023dcffb86151395f37e0884dbc11', 'id': 'cf8c8570-d17b-49f7-8d5f-8b5c8abf879e', 'created_at': datetime.datetime(2026, 7, 2, 23, 28, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 23, 28, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cf8c8570-d17b-49f7-8d5f-8b5c8abf879e/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7c5b357813d0>}
Jul 03 01:28:41 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] Trying to clone 8bf43a33-20d0-443b-b52b-4fa74bb25616 from image cf8c8570-d17b-49f7-8d5f-8b5c8abf879e at location (None, [{'url': 'file:///opt/stack/data/glance/images/cf8c8570-d17b-49f7-8d5f-8b5c8abf879e', 'metadata': {}}]). {{(pid=86891) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 03 01:28:42 devstack cinder-volume[86891]: DEBUG cinder.image.image_utils [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cf8c8570-d17b-49f7-8d5f-8b5c8abf879e_nfe2cfp_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86891) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 03 01:28:42 devstack cinder-volume[86891]: INFO cinder.image.image_utils [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] Image download 0.00 MB at 0.00 MB/s
Jul 03 01:28:42 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[8267dd75-4674-430d-b3d9-c19bf55c2613]: (4, 'raw') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:28:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf8c8570-d17b-49f7-8d5f-8b5c8abf879e_nfe2cfp_devstack@QuobyteHD {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:42 devstack sudo[106355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf8c8570-d17b-49f7-8d5f-8b5c8abf879e_nfe2cfp_devstack@QuobyteHD
Jul 03 01:28:42 devstack sudo[106355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:42 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:28:42 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Flow 'volume_create_manager' (8d5a686e-1424-46d2-b813-92ff6886c01f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:28:42 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bbeec35-6740-4748-bf26-4a62a28251d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:42 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bbeec35-6740-4748-bf26-4a62a28251d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:28:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=143286f3-3101-47fe-a8ee-f429c5f1ea4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd8babb4dd864a91b6e815550cb0fa6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:28:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:28:42Z,use_quota=True,user_id='ac3f6fcc82604dae880b875ac8f51095',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(913647e5-bea4-45dc-bb78-f1e7dd4f182c),volume_type_id=913647e5-bea4-45dc-bb78-f1e7dd4f182c)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:42 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40fe062b-3a80-4622-ae0a-19905b979f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:42 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40fe062b-3a80-4622-ae0a-19905b979f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:42 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf2fee7b-5dfd-4d69-965f-7ce2073161a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:42 devstack cinder-volume[86891]: DEBUG cinder.image.glance [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Creating Keystone auth plugin from conf {{(pid=86891) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 03 01:28:42 devstack sudo[106353]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b9549d64-da01-4971-bbf1-ceb334ad803a tempest-CreateVolumesFromSnapshotTest-405548807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d848e64e-0132-492f-ae40-b97334eb11a0" returned: 0 in 0.865s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b9549d64-da01-4971-bbf1-ceb334ad803a tempest-CreateVolumesFromSnapshotTest-405548807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d848e64e-0132-492f-ae40-b97334eb11a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d848e64e-0132-492f-ae40-b97334eb11a0.b0ceb4db-4cff-4fed-a435-bb7eba4a9d65 1G {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:42 devstack sudo[106361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d848e64e-0132-492f-ae40-b97334eb11a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d848e64e-0132-492f-ae40-b97334eb11a0.b0ceb4db-4cff-4fed-a435-bb7eba4a9d65 1G
Jul 03 01:28:42 devstack sudo[106361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:42 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf2fee7b-5dfd-4d69-965f-7ce2073161a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '143286f3-3101-47fe-a8ee-f429c5f1ea4f', 'volume_name': 'volume-143286f3-3101-47fe-a8ee-f429c5f1ea4f', 'volume_size': 1, 'image_id': '7557ec9c-f219-4c35-805e-2f4920891f90', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7557ec9c-f219-4c35-805e-2f4920891f90', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ed2df184ac9287f73c5fc21d3d5f5b19', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fd8babb4dd864a91b6e815550cb0fa6e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1af025bbd759850cecf2702c61109d01b778e9894b2916cee38a183bccedb5a389b8c1bcab85cbc6dab2189415c251cefa3d82401cc004aba571e173e1dc6d63', 'id': '7557ec9c-f219-4c35-805e-2f4920891f90', 'created_at': datetime.datetime(2026, 7, 2, 23, 28, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 23, 28, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7557ec9c-f219-4c35-805e-2f4920891f90/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7c5b353df410>}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:42 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fb039af-5645-459d-ab01-25eecb73e47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:42 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fb039af-5645-459d-ab01-25eecb73e47d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:42 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c71e75cc-a937-4211-a63c-559a8e99e1db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:42 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Volume 143286f3-3101-47fe-a8ee-f429c5f1ea4f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-143286f3-3101-47fe-a8ee-f429c5f1ea4f', 'volume_size': 1, 'image_id': '7557ec9c-f219-4c35-805e-2f4920891f90', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7557ec9c-f219-4c35-805e-2f4920891f90', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ed2df184ac9287f73c5fc21d3d5f5b19', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fd8babb4dd864a91b6e815550cb0fa6e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1af025bbd759850cecf2702c61109d01b778e9894b2916cee38a183bccedb5a389b8c1bcab85cbc6dab2189415c251cefa3d82401cc004aba571e173e1dc6d63', 'id': '7557ec9c-f219-4c35-805e-2f4920891f90', 'created_at': datetime.datetime(2026, 7, 2, 23, 28, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 23, 28, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7557ec9c-f219-4c35-805e-2f4920891f90/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7c5b353df410>}
Jul 03 01:28:42 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Trying to clone 143286f3-3101-47fe-a8ee-f429c5f1ea4f from image 7557ec9c-f219-4c35-805e-2f4920891f90 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7557ec9c-f219-4c35-805e-2f4920891f90', 'metadata': {}}]). {{(pid=86891) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 03 01:28:42 devstack sudo[106355]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf8c8570-d17b-49f7-8d5f-8b5c8abf879e_nfe2cfp_devstack@QuobyteHD" returned: 0 in 0.840s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf8c8570-d17b-49f7-8d5f-8b5c8abf879e_nfe2cfp_devstack@QuobyteHD {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-d206957b-e9d4-497f-bbb8-15b7199c70b5 tempest-ProjectMemberTests-1866302072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:28:43 devstack cinder-volume[86891]: DEBUG cinder.image.image_utils [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7557ec9c-f219-4c35-805e-2f4920891f90_av7iag92devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86891) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 03 01:28:43 devstack cinder-volume[86891]: INFO cinder.image.image_utils [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Image download 0.00 MB at 0.00 MB/s
Jul 03 01:28:43 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e79fa9-e404-4290-9947-049f4f474a39]: (4, 'raw') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:28:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7557ec9c-f219-4c35-805e-2f4920891f90_av7iag92devstack@QuobyteHD {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:43 devstack sudo[106365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf8c8570-d17b-49f7-8d5f-8b5c8abf879e_nfe2cfp_devstack@QuobyteHD
Jul 03 01:28:43 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:43 devstack sudo[106366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7557ec9c-f219-4c35-805e-2f4920891f90_av7iag92devstack@QuobyteHD
Jul 03 01:28:43 devstack sudo[106366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:43 devstack sudo[106361]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b9549d64-da01-4971-bbf1-ceb334ad803a tempest-CreateVolumesFromSnapshotTest-405548807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d848e64e-0132-492f-ae40-b97334eb11a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d848e64e-0132-492f-ae40-b97334eb11a0.b0ceb4db-4cff-4fed-a435-bb7eba4a9d65 1G" returned: 0 in 0.883s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b9549d64-da01-4971-bbf1-ceb334ad803a tempest-CreateVolumesFromSnapshotTest-405548807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d848e64e-0132-492f-ae40-b97334eb11a0 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d848e64e-0132-492f-ae40-b97334eb11a0.b0ceb4db-4cff-4fed-a435-bb7eba4a9d65 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:43 devstack sudo[106373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d848e64e-0132-492f-ae40-b97334eb11a0 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d848e64e-0132-492f-ae40-b97334eb11a0.b0ceb4db-4cff-4fed-a435-bb7eba4a9d65
Jul 03 01:28:43 devstack sudo[106373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:43 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf8c8570-d17b-49f7-8d5f-8b5c8abf879e_nfe2cfp_devstack@QuobyteHD" returned: 1 in 0.737s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf8c8570-d17b-49f7-8d5f-8b5c8abf879e_nfe2cfp_devstack@QuobyteHD' failed. Not Retrying. {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 01:28:43 devstack cinder-volume[86891]: DEBUG cinder.image.image_utils [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] Temporary image cf8c8570-d17b-49f7-8d5f-8b5c8abf879e is fetched for user c421e69cca9643c4a0685495da019d05. {{(pid=86891) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 03 01:28:43 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[4074d6e4-12e8-42d7-9571-be8eed3931ea]: (4, 'raw') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:28:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf8c8570-d17b-49f7-8d5f-8b5c8abf879e_nfe2cfp_devstack@QuobyteHD {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:43 devstack sudo[106378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf8c8570-d17b-49f7-8d5f-8b5c8abf879e_nfe2cfp_devstack@QuobyteHD
Jul 03 01:28:43 devstack sudo[106378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:43 devstack sudo[106366]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7557ec9c-f219-4c35-805e-2f4920891f90_av7iag92devstack@QuobyteHD" returned: 0 in 0.814s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7557ec9c-f219-4c35-805e-2f4920891f90_av7iag92devstack@QuobyteHD {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:44 devstack sudo[106382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7557ec9c-f219-4c35-805e-2f4920891f90_av7iag92devstack@QuobyteHD
Jul 03 01:28:44 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:44 devstack sudo[106373]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b9549d64-da01-4971-bbf1-ceb334ad803a tempest-CreateVolumesFromSnapshotTest-405548807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d848e64e-0132-492f-ae40-b97334eb11a0 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d848e64e-0132-492f-ae40-b97334eb11a0.b0ceb4db-4cff-4fed-a435-bb7eba4a9d65" returned: 0 in 0.724s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:44 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-b9549d64-da01-4971-bbf1-ceb334ad803a tempest-CreateVolumesFromSnapshotTest-405548807 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d848e64e-0132-492f-ae40-b97334eb11a0.b0ceb4db-4cff-4fed-a435-bb7eba4a9d65 is being set with open permissions: ugo+rw
Jul 03 01:28:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b9549d64-da01-4971-bbf1-ceb334ad803a tempest-CreateVolumesFromSnapshotTest-405548807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d848e64e-0132-492f-ae40-b97334eb11a0.b0ceb4db-4cff-4fed-a435-bb7eba4a9d65 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:44 devstack sudo[106387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d848e64e-0132-492f-ae40-b97334eb11a0.b0ceb4db-4cff-4fed-a435-bb7eba4a9d65
Jul 03 01:28:44 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:44 devstack sudo[106378]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf8c8570-d17b-49f7-8d5f-8b5c8abf879e_nfe2cfp_devstack@QuobyteHD" returned: 0 in 0.775s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf8c8570-d17b-49f7-8d5f-8b5c8abf879e_nfe2cfp_devstack@QuobyteHD {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:44 devstack sudo[106391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf8c8570-d17b-49f7-8d5f-8b5c8abf879e_nfe2cfp_devstack@QuobyteHD
Jul 03 01:28:44 devstack sudo[106391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:44 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7557ec9c-f219-4c35-805e-2f4920891f90_av7iag92devstack@QuobyteHD" returned: 1 in 0.754s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7557ec9c-f219-4c35-805e-2f4920891f90_av7iag92devstack@QuobyteHD' failed. Not Retrying. {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 01:28:44 devstack cinder-volume[86891]: DEBUG cinder.image.image_utils [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Temporary image 7557ec9c-f219-4c35-805e-2f4920891f90 is fetched for user ac3f6fcc82604dae880b875ac8f51095. {{(pid=86891) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 03 01:28:44 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[126fe534-ec23-446f-96e9-840a52252b45]: (4, 'raw') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:28:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7557ec9c-f219-4c35-805e-2f4920891f90_av7iag92devstack@QuobyteHD {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:44 devstack sudo[106396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7557ec9c-f219-4c35-805e-2f4920891f90_av7iag92devstack@QuobyteHD
Jul 03 01:28:44 devstack sudo[106396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:44 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b9549d64-da01-4971-bbf1-ceb334ad803a tempest-CreateVolumesFromSnapshotTest-405548807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d848e64e-0132-492f-ae40-b97334eb11a0.b0ceb4db-4cff-4fed-a435-bb7eba4a9d65" returned: 0 in 0.711s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b9549d64-da01-4971-bbf1-ceb334ad803a tempest-CreateVolumesFromSnapshotTest-405548807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d848e64e-0132-492f-ae40-b97334eb11a0.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:44 devstack sudo[106399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d848e64e-0132-492f-ae40-b97334eb11a0.info
Jul 03 01:28:44 devstack sudo[106399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:45 devstack sudo[106391]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf8c8570-d17b-49f7-8d5f-8b5c8abf879e_nfe2cfp_devstack@QuobyteHD" returned: 1 in 0.760s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf8c8570-d17b-49f7-8d5f-8b5c8abf879e_nfe2cfp_devstack@QuobyteHD' failed. Not Retrying. {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 01:28:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:28:45 devstack sudo[106396]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7557ec9c-f219-4c35-805e-2f4920891f90_av7iag92devstack@QuobyteHD" returned: 0 in 0.793s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7557ec9c-f219-4c35-805e-2f4920891f90_av7iag92devstack@QuobyteHD {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:45 devstack sudo[106399]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b9549d64-da01-4971-bbf1-ceb334ad803a tempest-CreateVolumesFromSnapshotTest-405548807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d848e64e-0132-492f-ae40-b97334eb11a0.info" returned: 0 in 0.648s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:45 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-b9549d64-da01-4971-bbf1-ceb334ad803a tempest-CreateVolumesFromSnapshotTest-405548807 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d848e64e-0132-492f-ae40-b97334eb11a0.info is being set with open permissions: ugo+rw
Jul 03 01:28:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b9549d64-da01-4971-bbf1-ceb334ad803a tempest-CreateVolumesFromSnapshotTest-405548807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d848e64e-0132-492f-ae40-b97334eb11a0.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:45 devstack sudo[106408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d848e64e-0132-492f-ae40-b97334eb11a0.info
Jul 03 01:28:45 devstack sudo[106408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:45 devstack sudo[106407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7557ec9c-f219-4c35-805e-2f4920891f90_av7iag92devstack@QuobyteHD
Jul 03 01:28:45 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:46 devstack sudo[106408]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b9549d64-da01-4971-bbf1-ceb334ad803a tempest-CreateVolumesFromSnapshotTest-405548807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d848e64e-0132-492f-ae40-b97334eb11a0.info" returned: 0 in 0.633s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b9549d64-da01-4971-bbf1-ceb334ad803a tempest-CreateVolumesFromSnapshotTest-405548807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.589s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:28:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-d206957b-e9d4-497f-bbb8-15b7199c70b5 tempest-ProjectMemberTests-1866302072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.262s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:28:46 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-d206957b-e9d4-497f-bbb8-15b7199c70b5 tempest-ProjectMemberTests-1866302072 None] Creating offline snapshot 5b091362-3b68-41cc-afd7-7cd76c282506 of volume 9ea1672a-0874-448b-8331-528a04b1268f {{(pid=86891) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 01:28:46 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-b9549d64-da01-4971-bbf1-ceb334ad803a tempest-CreateVolumesFromSnapshotTest-405548807 None] Create snapshot completed successfully
Jul 03 01:28:46 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:46 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae46ae54-678d-45f7-84d8-ed8f79f5c270]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:28:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d206957b-e9d4-497f-bbb8-15b7199c70b5 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9ea1672a-0874-448b-8331-528a04b1268f {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7557ec9c-f219-4c35-805e-2f4920891f90_av7iag92devstack@QuobyteHD" returned: 1 in 0.793s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7557ec9c-f219-4c35-805e-2f4920891f90_av7iag92devstack@QuobyteHD' failed. Not Retrying. {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 01:28:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:28:46 devstack sudo[106415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9ea1672a-0874-448b-8331-528a04b1268f
Jul 03 01:28:46 devstack sudo[106415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:46 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f393811-b96b-4a22-b8f9-93f48c04d344 tempest-CreateVolumesFromSnapshotTest-405548807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:28:46 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-5f393811-b96b-4a22-b8f9-93f48c04d344 tempest-CreateVolumesFromSnapshotTest-405548807 None] Flow 'volume_create_manager' (01a42309-64bf-43b5-b645-f2ba2c887c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:28:46 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-5f393811-b96b-4a22-b8f9-93f48c04d344 tempest-CreateVolumesFromSnapshotTest-405548807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b18fe2d6-0338-46bf-ae1c-53930ddb573f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-5f393811-b96b-4a22-b8f9-93f48c04d344 tempest-CreateVolumesFromSnapshotTest-405548807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b18fe2d6-0338-46bf-ae1c-53930ddb573f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:28:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-604356832',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10c5e421-4da6-40a6-86ac-10f7e20bbd7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22132ab0ea9b4ea988edd18ae904eedf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:28:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:28:47Z,use_quota=True,user_id='a2a91733885b484e97b56b50f871d19f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-5f393811-b96b-4a22-b8f9-93f48c04d344 tempest-CreateVolumesFromSnapshotTest-405548807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0bc2a13-ea77-4487-84cf-b5d6835e6128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-5f393811-b96b-4a22-b8f9-93f48c04d344 tempest-CreateVolumesFromSnapshotTest-405548807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0bc2a13-ea77-4487-84cf-b5d6835e6128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-5f393811-b96b-4a22-b8f9-93f48c04d344 tempest-CreateVolumesFromSnapshotTest-405548807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7aa765f-f709-4f9d-8839-0d688358e725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-5f393811-b96b-4a22-b8f9-93f48c04d344 tempest-CreateVolumesFromSnapshotTest-405548807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7aa765f-f709-4f9d-8839-0d688358e725) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10c5e421-4da6-40a6-86ac-10f7e20bbd7a', 'volume_name': 'volume-10c5e421-4da6-40a6-86ac-10f7e20bbd7a', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-5f393811-b96b-4a22-b8f9-93f48c04d344 tempest-CreateVolumesFromSnapshotTest-405548807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4d89e63-0a1b-4ab9-87a7-7436520674b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-5f393811-b96b-4a22-b8f9-93f48c04d344 tempest-CreateVolumesFromSnapshotTest-405548807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4d89e63-0a1b-4ab9-87a7-7436520674b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-5f393811-b96b-4a22-b8f9-93f48c04d344 tempest-CreateVolumesFromSnapshotTest-405548807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f93fa68-4baf-494d-9e78-a96e62fa14e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:47 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-5f393811-b96b-4a22-b8f9-93f48c04d344 tempest-CreateVolumesFromSnapshotTest-405548807 None] Volume 10c5e421-4da6-40a6-86ac-10f7e20bbd7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10c5e421-4da6-40a6-86ac-10f7e20bbd7a', 'volume_size': 1}
Jul 03 01:28:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-5f393811-b96b-4a22-b8f9-93f48c04d344 tempest-CreateVolumesFromSnapshotTest-405548807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:28:47 devstack sudo[106415]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d206957b-e9d4-497f-bbb8-15b7199c70b5 tempest-ProjectMemberTests-1866302072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9ea1672a-0874-448b-8331-528a04b1268f" returned: 0 in 0.850s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d206957b-e9d4-497f-bbb8-15b7199c70b5 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9ea1672a-0874-448b-8331-528a04b1268f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9ea1672a-0874-448b-8331-528a04b1268f.5b091362-3b68-41cc-afd7-7cd76c282506 1G {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:47 devstack sudo[106421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9ea1672a-0874-448b-8331-528a04b1268f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9ea1672a-0874-448b-8331-528a04b1268f.5b091362-3b68-41cc-afd7-7cd76c282506 1G
Jul 03 01:28:47 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:47 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-43212fdf-9e94-4b1b-91c9-fa56366b0650 tempest-CreateVolumesFromSnapshotTest-405548807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:28:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-43212fdf-9e94-4b1b-91c9-fa56366b0650 tempest-CreateVolumesFromSnapshotTest-405548807 None] Flow 'volume_create_manager' (49461e6f-4c8d-49b8-b631-9775dd1f3dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:28:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-43212fdf-9e94-4b1b-91c9-fa56366b0650 tempest-CreateVolumesFromSnapshotTest-405548807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c44ac652-8944-40e6-be08-63f55d7715af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-43212fdf-9e94-4b1b-91c9-fa56366b0650 tempest-CreateVolumesFromSnapshotTest-405548807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c44ac652-8944-40e6-be08-63f55d7715af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:28:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-951200257',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54ae1e57-27ed-46ca-ae69-356605f0e341,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22132ab0ea9b4ea988edd18ae904eedf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:28:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:28:47Z,use_quota=True,user_id='a2a91733885b484e97b56b50f871d19f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-43212fdf-9e94-4b1b-91c9-fa56366b0650 tempest-CreateVolumesFromSnapshotTest-405548807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (142f679f-d38b-491b-bb37-d4f6fa5cf05b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-43212fdf-9e94-4b1b-91c9-fa56366b0650 tempest-CreateVolumesFromSnapshotTest-405548807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (142f679f-d38b-491b-bb37-d4f6fa5cf05b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-43212fdf-9e94-4b1b-91c9-fa56366b0650 tempest-CreateVolumesFromSnapshotTest-405548807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b63332ba-0cb6-4c3a-8a15-fe0e4a450d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-43212fdf-9e94-4b1b-91c9-fa56366b0650 tempest-CreateVolumesFromSnapshotTest-405548807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b63332ba-0cb6-4c3a-8a15-fe0e4a450d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54ae1e57-27ed-46ca-ae69-356605f0e341', 'volume_name': 'volume-54ae1e57-27ed-46ca-ae69-356605f0e341', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-43212fdf-9e94-4b1b-91c9-fa56366b0650 tempest-CreateVolumesFromSnapshotTest-405548807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19e7ccc1-1a5d-4791-82d3-1800d18dce54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-43212fdf-9e94-4b1b-91c9-fa56366b0650 tempest-CreateVolumesFromSnapshotTest-405548807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19e7ccc1-1a5d-4791-82d3-1800d18dce54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-43212fdf-9e94-4b1b-91c9-fa56366b0650 tempest-CreateVolumesFromSnapshotTest-405548807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (549a7234-2230-4617-8fa1-e91a27a5089c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:47 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-43212fdf-9e94-4b1b-91c9-fa56366b0650 tempest-CreateVolumesFromSnapshotTest-405548807 None] Volume 54ae1e57-27ed-46ca-ae69-356605f0e341: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54ae1e57-27ed-46ca-ae69-356605f0e341', 'volume_size': 1}
Jul 03 01:28:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-43212fdf-9e94-4b1b-91c9-fa56366b0650 tempest-CreateVolumesFromSnapshotTest-405548807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:28:47 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-747af607-353a-4f08-868d-ae88b5a9e6fc tempest-CreateVolumesFromSnapshotTest-405548807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:28:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-747af607-353a-4f08-868d-ae88b5a9e6fc tempest-CreateVolumesFromSnapshotTest-405548807 None] Flow 'volume_create_manager' (ed592777-8222-47e9-b4c8-8011f0ab6931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:28:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-747af607-353a-4f08-868d-ae88b5a9e6fc tempest-CreateVolumesFromSnapshotTest-405548807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20f0fe28-3e6e-4620-8cc0-c8e90d22ebaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-747af607-353a-4f08-868d-ae88b5a9e6fc tempest-CreateVolumesFromSnapshotTest-405548807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20f0fe28-3e6e-4620-8cc0-c8e90d22ebaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:28:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-330358388',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c380941a-ec4b-48d5-98a9-b76d42c2643b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22132ab0ea9b4ea988edd18ae904eedf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:28:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:28:48Z,use_quota=True,user_id='a2a91733885b484e97b56b50f871d19f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-747af607-353a-4f08-868d-ae88b5a9e6fc tempest-CreateVolumesFromSnapshotTest-405548807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f1f9ecb-1b98-4d4c-af8a-c50df6504beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-747af607-353a-4f08-868d-ae88b5a9e6fc tempest-CreateVolumesFromSnapshotTest-405548807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f1f9ecb-1b98-4d4c-af8a-c50df6504beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-747af607-353a-4f08-868d-ae88b5a9e6fc tempest-CreateVolumesFromSnapshotTest-405548807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18e853e6-4439-41f8-90f2-1adf998a6a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-747af607-353a-4f08-868d-ae88b5a9e6fc tempest-CreateVolumesFromSnapshotTest-405548807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18e853e6-4439-41f8-90f2-1adf998a6a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c380941a-ec4b-48d5-98a9-b76d42c2643b', 'volume_name': 'volume-c380941a-ec4b-48d5-98a9-b76d42c2643b', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-747af607-353a-4f08-868d-ae88b5a9e6fc tempest-CreateVolumesFromSnapshotTest-405548807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d373311-df41-4ebe-b51e-b443ba35862f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-747af607-353a-4f08-868d-ae88b5a9e6fc tempest-CreateVolumesFromSnapshotTest-405548807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d373311-df41-4ebe-b51e-b443ba35862f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-747af607-353a-4f08-868d-ae88b5a9e6fc tempest-CreateVolumesFromSnapshotTest-405548807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1cae43c-ea29-404d-877a-dc6174891d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:47 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-747af607-353a-4f08-868d-ae88b5a9e6fc tempest-CreateVolumesFromSnapshotTest-405548807 None] Volume c380941a-ec4b-48d5-98a9-b76d42c2643b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c380941a-ec4b-48d5-98a9-b76d42c2643b', 'volume_size': 1}
Jul 03 01:28:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-747af607-353a-4f08-868d-ae88b5a9e6fc tempest-CreateVolumesFromSnapshotTest-405548807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:28:48 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d206957b-e9d4-497f-bbb8-15b7199c70b5 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9ea1672a-0874-448b-8331-528a04b1268f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9ea1672a-0874-448b-8331-528a04b1268f.5b091362-3b68-41cc-afd7-7cd76c282506 1G" returned: 0 in 0.909s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d206957b-e9d4-497f-bbb8-15b7199c70b5 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ea1672a-0874-448b-8331-528a04b1268f -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9ea1672a-0874-448b-8331-528a04b1268f.5b091362-3b68-41cc-afd7-7cd76c282506 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:48 devstack sudo[106427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ea1672a-0874-448b-8331-528a04b1268f -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9ea1672a-0874-448b-8331-528a04b1268f.5b091362-3b68-41cc-afd7-7cd76c282506
Jul 03 01:28:48 devstack sudo[106427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:48 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-2394ad4b-7360-45d1-be03-c25751a3c68d tempest-CreateVolumesFromSnapshotTest-405548807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:28:48 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-2394ad4b-7360-45d1-be03-c25751a3c68d tempest-CreateVolumesFromSnapshotTest-405548807 None] Flow 'volume_create_manager' (e0d5b289-c160-413a-98fe-9c3ccb01e0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:28:48 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-2394ad4b-7360-45d1-be03-c25751a3c68d tempest-CreateVolumesFromSnapshotTest-405548807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b687085-a76a-4f6d-a1e9-b4c1b10a6e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:48 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-2394ad4b-7360-45d1-be03-c25751a3c68d tempest-CreateVolumesFromSnapshotTest-405548807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b687085-a76a-4f6d-a1e9-b4c1b10a6e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:28:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1203259148',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51f722e2-1253-4b59-ae08-1d27e93636c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22132ab0ea9b4ea988edd18ae904eedf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:28:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:28:48Z,use_quota=True,user_id='a2a91733885b484e97b56b50f871d19f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:48 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-2394ad4b-7360-45d1-be03-c25751a3c68d tempest-CreateVolumesFromSnapshotTest-405548807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7c4b359-9fc4-40ed-a428-d2ee584ac204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:48 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-2394ad4b-7360-45d1-be03-c25751a3c68d tempest-CreateVolumesFromSnapshotTest-405548807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7c4b359-9fc4-40ed-a428-d2ee584ac204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:48 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-2394ad4b-7360-45d1-be03-c25751a3c68d tempest-CreateVolumesFromSnapshotTest-405548807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0589d200-738c-4889-932c-6e9cba5c9da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:48 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-2394ad4b-7360-45d1-be03-c25751a3c68d tempest-CreateVolumesFromSnapshotTest-405548807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0589d200-738c-4889-932c-6e9cba5c9da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51f722e2-1253-4b59-ae08-1d27e93636c9', 'volume_name': 'volume-51f722e2-1253-4b59-ae08-1d27e93636c9', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:48 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-2394ad4b-7360-45d1-be03-c25751a3c68d tempest-CreateVolumesFromSnapshotTest-405548807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e4f07a3-9394-4c16-93ec-7acaccf5ee81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:48 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-2394ad4b-7360-45d1-be03-c25751a3c68d tempest-CreateVolumesFromSnapshotTest-405548807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e4f07a3-9394-4c16-93ec-7acaccf5ee81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:48 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-2394ad4b-7360-45d1-be03-c25751a3c68d tempest-CreateVolumesFromSnapshotTest-405548807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2462267b-080d-4c33-8549-52bb70c9d8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:48 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-2394ad4b-7360-45d1-be03-c25751a3c68d tempest-CreateVolumesFromSnapshotTest-405548807 None] Volume 51f722e2-1253-4b59-ae08-1d27e93636c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51f722e2-1253-4b59-ae08-1d27e93636c9', 'volume_size': 1}
Jul 03 01:28:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-2394ad4b-7360-45d1-be03-c25751a3c68d tempest-CreateVolumesFromSnapshotTest-405548807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:28:48 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe80738e-9c5d-4e78-ad50-5ff0c473d3b7 tempest-CreateVolumesFromSnapshotTest-405548807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:28:48 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fe80738e-9c5d-4e78-ad50-5ff0c473d3b7 tempest-CreateVolumesFromSnapshotTest-405548807 None] Flow 'volume_create_manager' (e653a898-51ef-41c8-95a1-14e3fefc1b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:28:48 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fe80738e-9c5d-4e78-ad50-5ff0c473d3b7 tempest-CreateVolumesFromSnapshotTest-405548807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81067bd6-8aaf-482f-a9e2-45bca43e8ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:48 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fe80738e-9c5d-4e78-ad50-5ff0c473d3b7 tempest-CreateVolumesFromSnapshotTest-405548807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81067bd6-8aaf-482f-a9e2-45bca43e8ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:28:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-228338739',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5df7303f-aec9-48c9-a478-24e570ddce34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22132ab0ea9b4ea988edd18ae904eedf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:28:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:28:48Z,use_quota=True,user_id='a2a91733885b484e97b56b50f871d19f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:48 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fe80738e-9c5d-4e78-ad50-5ff0c473d3b7 tempest-CreateVolumesFromSnapshotTest-405548807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cebcdc8-b4b9-43b3-a516-f21af30daa37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:48 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fe80738e-9c5d-4e78-ad50-5ff0c473d3b7 tempest-CreateVolumesFromSnapshotTest-405548807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cebcdc8-b4b9-43b3-a516-f21af30daa37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:48 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fe80738e-9c5d-4e78-ad50-5ff0c473d3b7 tempest-CreateVolumesFromSnapshotTest-405548807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea0ee2f8-1de3-4339-ad8d-77d7206f47aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:48 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fe80738e-9c5d-4e78-ad50-5ff0c473d3b7 tempest-CreateVolumesFromSnapshotTest-405548807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea0ee2f8-1de3-4339-ad8d-77d7206f47aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5df7303f-aec9-48c9-a478-24e570ddce34', 'volume_name': 'volume-5df7303f-aec9-48c9-a478-24e570ddce34', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:48 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fe80738e-9c5d-4e78-ad50-5ff0c473d3b7 tempest-CreateVolumesFromSnapshotTest-405548807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e20231fc-dde1-4107-8577-c5c2b95985ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:48 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fe80738e-9c5d-4e78-ad50-5ff0c473d3b7 tempest-CreateVolumesFromSnapshotTest-405548807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e20231fc-dde1-4107-8577-c5c2b95985ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:48 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fe80738e-9c5d-4e78-ad50-5ff0c473d3b7 tempest-CreateVolumesFromSnapshotTest-405548807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5496626-5743-4262-b818-21f0e36078b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:48 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-fe80738e-9c5d-4e78-ad50-5ff0c473d3b7 tempest-CreateVolumesFromSnapshotTest-405548807 None] Volume 5df7303f-aec9-48c9-a478-24e570ddce34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5df7303f-aec9-48c9-a478-24e570ddce34', 'volume_size': 1}
Jul 03 01:28:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-fe80738e-9c5d-4e78-ad50-5ff0c473d3b7 tempest-CreateVolumesFromSnapshotTest-405548807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:28:48 devstack sudo[106427]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d206957b-e9d4-497f-bbb8-15b7199c70b5 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ea1672a-0874-448b-8331-528a04b1268f -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9ea1672a-0874-448b-8331-528a04b1268f.5b091362-3b68-41cc-afd7-7cd76c282506" returned: 0 in 0.693s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:48 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-d206957b-e9d4-497f-bbb8-15b7199c70b5 tempest-ProjectMemberTests-1866302072 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9ea1672a-0874-448b-8331-528a04b1268f.5b091362-3b68-41cc-afd7-7cd76c282506 is being set with open permissions: ugo+rw
Jul 03 01:28:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d206957b-e9d4-497f-bbb8-15b7199c70b5 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9ea1672a-0874-448b-8331-528a04b1268f.5b091362-3b68-41cc-afd7-7cd76c282506 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:48 devstack sudo[106432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9ea1672a-0874-448b-8331-528a04b1268f.5b091362-3b68-41cc-afd7-7cd76c282506
Jul 03 01:28:48 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:49 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d206957b-e9d4-497f-bbb8-15b7199c70b5 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9ea1672a-0874-448b-8331-528a04b1268f.5b091362-3b68-41cc-afd7-7cd76c282506" returned: 0 in 0.629s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d206957b-e9d4-497f-bbb8-15b7199c70b5 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9ea1672a-0874-448b-8331-528a04b1268f.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:49 devstack sudo[106436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9ea1672a-0874-448b-8331-528a04b1268f.info
Jul 03 01:28:49 devstack sudo[106436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:50 devstack sudo[106436]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d206957b-e9d4-497f-bbb8-15b7199c70b5 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9ea1672a-0874-448b-8331-528a04b1268f.info" returned: 0 in 0.615s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:50 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-d206957b-e9d4-497f-bbb8-15b7199c70b5 tempest-ProjectMemberTests-1866302072 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9ea1672a-0874-448b-8331-528a04b1268f.info is being set with open permissions: ugo+rw
Jul 03 01:28:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d206957b-e9d4-497f-bbb8-15b7199c70b5 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9ea1672a-0874-448b-8331-528a04b1268f.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:50 devstack sudo[106439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9ea1672a-0874-448b-8331-528a04b1268f.info
Jul 03 01:28:50 devstack sudo[106439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:50 devstack sudo[106439]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d206957b-e9d4-497f-bbb8-15b7199c70b5 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9ea1672a-0874-448b-8331-528a04b1268f.info" returned: 0 in 0.633s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-d206957b-e9d4-497f-bbb8-15b7199c70b5 tempest-ProjectMemberTests-1866302072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.423s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:28:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.375s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:28:50 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:28:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bf43a33-20d0-443b-b52b-4fa74bb25616,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6563e733af447119e3b7053f3c3b1f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:28:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:28:41Z,use_quota=True,user_id='c421e69cca9643c4a0685495da019d05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:28:50 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] Creating volume 8bf43a33-20d0-443b-b52b-4fa74bb25616 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:28:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:28:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:28:50 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:28:50 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:28:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:28:50 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:28:50 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:28:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8bf43a33-20d0-443b-b52b-4fa74bb25616 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:50 devstack sudo[106442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8bf43a33-20d0-443b-b52b-4fa74bb25616 1073741824
Jul 03 01:28:50 devstack sudo[106442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:50 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-d206957b-e9d4-497f-bbb8-15b7199c70b5 tempest-ProjectMemberTests-1866302072 None] Create snapshot completed successfully
Jul 03 01:28:51 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-de5968d3-dabc-4de6-abc6-3e7ed5e3bbf3 tempest-ProjectMemberTests-1866302072 None] Acquiring lock "cinder-5b091362-3b68-41cc-afd7-7cd76c282506-delete_snapshot" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:28:51 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-de5968d3-dabc-4de6-abc6-3e7ed5e3bbf3 tempest-ProjectMemberTests-1866302072 None] Lock "cinder-5b091362-3b68-41cc-afd7-7cd76c282506-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:28:51 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-de5968d3-dabc-4de6-abc6-3e7ed5e3bbf3 tempest-ProjectMemberTests-1866302072 None] Acquiring lock "cinder-quobyte-9ea1672a-0874-448b-8331-528a04b1268f" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:28:51 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-de5968d3-dabc-4de6-abc6-3e7ed5e3bbf3 tempest-ProjectMemberTests-1866302072 None] Lock "cinder-quobyte-9ea1672a-0874-448b-8331-528a04b1268f" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:28:51 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-de5968d3-dabc-4de6-abc6-3e7ed5e3bbf3 tempest-ProjectMemberTests-1866302072 None] Acquiring lock "cinder-quobyte-5b091362-3b68-41cc-afd7-7cd76c282506" by "_delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:28:51 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-de5968d3-dabc-4de6-abc6-3e7ed5e3bbf3 tempest-ProjectMemberTests-1866302072 None] Lock "cinder-quobyte-5b091362-3b68-41cc-afd7-7cd76c282506" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:28:51 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-de5968d3-dabc-4de6-abc6-3e7ed5e3bbf3 tempest-ProjectMemberTests-1866302072 None] Deleting offline snapshot 5b091362-3b68-41cc-afd7-7cd76c282506 of volume 9ea1672a-0874-448b-8331-528a04b1268f {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 01:28:51 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-de5968d3-dabc-4de6-abc6-3e7ed5e3bbf3 tempest-ProjectMemberTests-1866302072 None] snapshot_file for this snap is: volume-9ea1672a-0874-448b-8331-528a04b1268f.5b091362-3b68-41cc-afd7-7cd76c282506 {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 01:28:51 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[13459266-1caf-4198-8bc2-2eb57bdd99e6]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:28:51 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-de5968d3-dabc-4de6-abc6-3e7ed5e3bbf3 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9ea1672a-0874-448b-8331-528a04b1268f.5b091362-3b68-41cc-afd7-7cd76c282506 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:51 devstack sudo[106447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9ea1672a-0874-448b-8331-528a04b1268f.5b091362-3b68-41cc-afd7-7cd76c282506
Jul 03 01:28:51 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:51 devstack sudo[106442]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:51 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8bf43a33-20d0-443b-b52b-4fa74bb25616 1073741824" returned: 0 in 0.834s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:51 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8bf43a33-20d0-443b-b52b-4fa74bb25616 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:51 devstack sudo[106450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8bf43a33-20d0-443b-b52b-4fa74bb25616
Jul 03 01:28:51 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:52 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-de5968d3-dabc-4de6-abc6-3e7ed5e3bbf3 tempest-ProjectMemberTests-1866302072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9ea1672a-0874-448b-8331-528a04b1268f.5b091362-3b68-41cc-afd7-7cd76c282506" returned: 0 in 0.771s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:52 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-de5968d3-dabc-4de6-abc6-3e7ed5e3bbf3 tempest-ProjectMemberTests-1866302072 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ea1672a-0874-448b-8331-528a04b1268f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:28:52 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0dc7683-8823-42dd-9a17-0b9340f84096]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:28:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-de5968d3-dabc-4de6-abc6-3e7ed5e3bbf3 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9ea1672a-0874-448b-8331-528a04b1268f {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:52 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8bf43a33-20d0-443b-b52b-4fa74bb25616" returned: 0 in 0.641s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:52 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] <== create_volume: return (1524ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:28:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.526s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:28:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.895s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:28:52 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:28:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=143286f3-3101-47fe-a8ee-f429c5f1ea4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd8babb4dd864a91b6e815550cb0fa6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:28:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:28:42Z,use_quota=True,user_id='ac3f6fcc82604dae880b875ac8f51095',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(913647e5-bea4-45dc-bb78-f1e7dd4f182c),volume_type_id=913647e5-bea4-45dc-bb78-f1e7dd4f182c)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:28:52 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Creating volume 143286f3-3101-47fe-a8ee-f429c5f1ea4f {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:28:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:28:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:28:52 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:28:52 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:28:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:28:52 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:28:52 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:28:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-143286f3-3101-47fe-a8ee-f429c5f1ea4f 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:52 devstack sudo[106457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-143286f3-3101-47fe-a8ee-f429c5f1ea4f 1073741824
Jul 03 01:28:52 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:52 devstack cinder-volume[86891]: DEBUG cinder.volume.volume_utils [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] Attempting download of cf8c8570-d17b-49f7-8d5f-8b5c8abf879e ((None, [{'url': 'file:///opt/stack/data/glance/images/cf8c8570-d17b-49f7-8d5f-8b5c8abf879e', 'metadata': {}}])) to volume 8bf43a33-20d0-443b-b52b-4fa74bb25616. {{(pid=86891) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 03 01:28:52 devstack sudo[106456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9ea1672a-0874-448b-8331-528a04b1268f
Jul 03 01:28:52 devstack sudo[106456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:52 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab5b982-c853-46c4-9a16-9d8e2f50e331]: (4, 'raw') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:28:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cf8c8570-d17b-49f7-8d5f-8b5c8abf879e_y79t4r6w {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:52 devstack sudo[106460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cf8c8570-d17b-49f7-8d5f-8b5c8abf879e_y79t4r6w
Jul 03 01:28:52 devstack sudo[106460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:52 devstack sudo[106456]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-de5968d3-dabc-4de6-abc6-3e7ed5e3bbf3 tempest-ProjectMemberTests-1866302072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9ea1672a-0874-448b-8331-528a04b1268f" returned: 0 in 0.833s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-de5968d3-dabc-4de6-abc6-3e7ed5e3bbf3 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9ea1672a-0874-448b-8331-528a04b1268f.5b091362-3b68-41cc-afd7-7cd76c282506 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:53 devstack sudo[106470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9ea1672a-0874-448b-8331-528a04b1268f.5b091362-3b68-41cc-afd7-7cd76c282506
Jul 03 01:28:53 devstack sudo[106470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:53 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-143286f3-3101-47fe-a8ee-f429c5f1ea4f 1073741824" returned: 0 in 0.864s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:53 devstack sudo[106460]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cf8c8570-d17b-49f7-8d5f-8b5c8abf879e_y79t4r6w" returned: 0 in 0.810s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cf8c8570-d17b-49f7-8d5f-8b5c8abf879e_y79t4r6w {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-143286f3-3101-47fe-a8ee-f429c5f1ea4f {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:53 devstack sudo[106473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-143286f3-3101-47fe-a8ee-f429c5f1ea4f
Jul 03 01:28:53 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:53 devstack sudo[106472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cf8c8570-d17b-49f7-8d5f-8b5c8abf879e_y79t4r6w
Jul 03 01:28:53 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:53 devstack sudo[106470]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-de5968d3-dabc-4de6-abc6-3e7ed5e3bbf3 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9ea1672a-0874-448b-8331-528a04b1268f.5b091362-3b68-41cc-afd7-7cd76c282506" returned: 0 in 0.762s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-de5968d3-dabc-4de6-abc6-3e7ed5e3bbf3 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9ea1672a-0874-448b-8331-528a04b1268f.5b091362-3b68-41cc-afd7-7cd76c282506 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:53 devstack sudo[106482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9ea1672a-0874-448b-8331-528a04b1268f.5b091362-3b68-41cc-afd7-7cd76c282506
Jul 03 01:28:53 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:53 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-143286f3-3101-47fe-a8ee-f429c5f1ea4f" returned: 0 in 0.680s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:53 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] <== create_volume: return (1605ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:28:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.607s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:28:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-5f393811-b96b-4a22-b8f9-93f48c04d344 tempest-CreateVolumesFromSnapshotTest-405548807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.717s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:28:53 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-5f393811-b96b-4a22-b8f9-93f48c04d344 tempest-CreateVolumesFromSnapshotTest-405548807 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:28:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-604356832',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10c5e421-4da6-40a6-86ac-10f7e20bbd7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22132ab0ea9b4ea988edd18ae904eedf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:28:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:28:47Z,use_quota=True,user_id='a2a91733885b484e97b56b50f871d19f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:28:53 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-5f393811-b96b-4a22-b8f9-93f48c04d344 tempest-CreateVolumesFromSnapshotTest-405548807 None] Creating volume 10c5e421-4da6-40a6-86ac-10f7e20bbd7a {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:28:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-5f393811-b96b-4a22-b8f9-93f48c04d344 tempest-CreateVolumesFromSnapshotTest-405548807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:28:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-5f393811-b96b-4a22-b8f9-93f48c04d344 tempest-CreateVolumesFromSnapshotTest-405548807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:28:53 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-5f393811-b96b-4a22-b8f9-93f48c04d344 tempest-CreateVolumesFromSnapshotTest-405548807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:28:53 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-5f393811-b96b-4a22-b8f9-93f48c04d344 tempest-CreateVolumesFromSnapshotTest-405548807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:28:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-5f393811-b96b-4a22-b8f9-93f48c04d344 tempest-CreateVolumesFromSnapshotTest-405548807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:28:53 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-5f393811-b96b-4a22-b8f9-93f48c04d344 tempest-CreateVolumesFromSnapshotTest-405548807 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:28:53 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-5f393811-b96b-4a22-b8f9-93f48c04d344 tempest-CreateVolumesFromSnapshotTest-405548807 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:28:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5f393811-b96b-4a22-b8f9-93f48c04d344 tempest-CreateVolumesFromSnapshotTest-405548807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-10c5e421-4da6-40a6-86ac-10f7e20bbd7a 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:53 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cf8c8570-d17b-49f7-8d5f-8b5c8abf879e_y79t4r6w" returned: 1 in 0.725s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cf8c8570-d17b-49f7-8d5f-8b5c8abf879e_y79t4r6w' failed. Not Retrying. {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 01:28:53 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[440d8f11-8078-4396-b119-32e3611e55b1]: (4, 'raw') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:28:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf8c8570-d17b-49f7-8d5f-8b5c8abf879e_nfe2cfp_devstack@QuobyteHD {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:53 devstack sudo[106484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-10c5e421-4da6-40a6-86ac-10f7e20bbd7a 1073741824
Jul 03 01:28:53 devstack sudo[106484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:53 devstack cinder-volume[86891]: DEBUG cinder.volume.volume_utils [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Attempting download of 7557ec9c-f219-4c35-805e-2f4920891f90 ((None, [{'url': 'file:///opt/stack/data/glance/images/7557ec9c-f219-4c35-805e-2f4920891f90', 'metadata': {}}])) to volume 143286f3-3101-47fe-a8ee-f429c5f1ea4f. {{(pid=86891) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 03 01:28:53 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c10af0-3708-43e3-9c5e-c91ac175a6c1]: (4, 'raw') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:28:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7557ec9c-f219-4c35-805e-2f4920891f90_r6rae7bp {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:53 devstack sudo[106485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf8c8570-d17b-49f7-8d5f-8b5c8abf879e_nfe2cfp_devstack@QuobyteHD
Jul 03 01:28:53 devstack sudo[106485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:54 devstack sudo[106487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7557ec9c-f219-4c35-805e-2f4920891f90_r6rae7bp
Jul 03 01:28:54 devstack sudo[106487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:54 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:54 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-de5968d3-dabc-4de6-abc6-3e7ed5e3bbf3 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9ea1672a-0874-448b-8331-528a04b1268f.5b091362-3b68-41cc-afd7-7cd76c282506" returned: 0 in 0.740s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:54 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-de5968d3-dabc-4de6-abc6-3e7ed5e3bbf3 tempest-ProjectMemberTests-1866302072 None] Lock "cinder-quobyte-5b091362-3b68-41cc-afd7-7cd76c282506" released by "_delete_snapshot" :: held 3.214s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:28:54 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-de5968d3-dabc-4de6-abc6-3e7ed5e3bbf3 tempest-ProjectMemberTests-1866302072 None] Lock "cinder-quobyte-9ea1672a-0874-448b-8331-528a04b1268f" released by "delete_snapshot" :: held 3.237s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:28:54 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-de5968d3-dabc-4de6-abc6-3e7ed5e3bbf3 tempest-ProjectMemberTests-1866302072 None] Created reservations ['a2d3adf1-1ff0-46d1-909e-64d87ddd5556', '74b6310e-fd91-4757-bda2-047a3d7d782c', '59c61d8d-8d77-4f5c-b07e-c80eb4489230', '3bb9a842-6aed-4c77-9f5b-a5d5f7fa5cc8'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:28:54 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-de5968d3-dabc-4de6-abc6-3e7ed5e3bbf3 tempest-ProjectMemberTests-1866302072 None] Delete snapshot completed successfully.
Jul 03 01:28:54 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-de5968d3-dabc-4de6-abc6-3e7ed5e3bbf3 tempest-ProjectMemberTests-1866302072 None] Lock "cinder-5b091362-3b68-41cc-afd7-7cd76c282506-delete_snapshot" released by "delete_snapshot" :: held 3.411s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:28:54 devstack sudo[106485]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:54 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf8c8570-d17b-49f7-8d5f-8b5c8abf879e_nfe2cfp_devstack@QuobyteHD" returned: 0 in 0.899s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:54 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf8c8570-d17b-49f7-8d5f-8b5c8abf879e_nfe2cfp_devstack@QuobyteHD {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:54 devstack sudo[106484]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:54 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5f393811-b96b-4a22-b8f9-93f48c04d344 tempest-CreateVolumesFromSnapshotTest-405548807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-10c5e421-4da6-40a6-86ac-10f7e20bbd7a 1073741824" returned: 0 in 0.975s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:54 devstack sudo[106487]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:54 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7557ec9c-f219-4c35-805e-2f4920891f90_r6rae7bp" returned: 0 in 0.876s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:54 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7557ec9c-f219-4c35-805e-2f4920891f90_r6rae7bp {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:54 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5f393811-b96b-4a22-b8f9-93f48c04d344 tempest-CreateVolumesFromSnapshotTest-405548807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-10c5e421-4da6-40a6-86ac-10f7e20bbd7a {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:54 devstack sudo[106499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf8c8570-d17b-49f7-8d5f-8b5c8abf879e_nfe2cfp_devstack@QuobyteHD
Jul 03 01:28:54 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:54 devstack sudo[106501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-10c5e421-4da6-40a6-86ac-10f7e20bbd7a
Jul 03 01:28:54 devstack sudo[106501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:54 devstack sudo[106500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7557ec9c-f219-4c35-805e-2f4920891f90_r6rae7bp
Jul 03 01:28:54 devstack sudo[106500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:55 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf8c8570-d17b-49f7-8d5f-8b5c8abf879e_nfe2cfp_devstack@QuobyteHD" returned: 1 in 0.759s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf8c8570-d17b-49f7-8d5f-8b5c8abf879e_nfe2cfp_devstack@QuobyteHD' failed. Not Retrying. {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 01:28:55 devstack cinder-volume[86891]: DEBUG cinder.image.image_utils [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] cf8c8570-d17b-49f7-8d5f-8b5c8abf879e was raw, converting to raw {{(pid=86891) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 03 01:28:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_cf8c8570-d17b-49f7-8d5f-8b5c8abf879e_nfe2cfp_devstack@QuobyteHD /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8bf43a33-20d0-443b-b52b-4fa74bb25616 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:55 devstack sudo[106511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_cf8c8570-d17b-49f7-8d5f-8b5c8abf879e_nfe2cfp_devstack@QuobyteHD /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8bf43a33-20d0-443b-b52b-4fa74bb25616
Jul 03 01:28:55 devstack sudo[106511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:55 devstack sudo[106500]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:55 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-dea9d810-3645-44d7-b364-8c4339b0e3e2 tempest-ProjectMemberTests-1866302072 None] Acquiring lock "cinder-9ea1672a-0874-448b-8331-528a04b1268f-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:28:55 devstack sudo[106501]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7557ec9c-f219-4c35-805e-2f4920891f90_r6rae7bp" returned: 1 in 0.766s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7557ec9c-f219-4c35-805e-2f4920891f90_r6rae7bp' failed. Not Retrying. {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 01:28:55 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[1912c086-d68a-4690-ab27-a22f147d9afe]: (4, 'raw') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:28:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7557ec9c-f219-4c35-805e-2f4920891f90_av7iag92devstack@QuobyteHD {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5f393811-b96b-4a22-b8f9-93f48c04d344 tempest-CreateVolumesFromSnapshotTest-405548807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-10c5e421-4da6-40a6-86ac-10f7e20bbd7a" returned: 0 in 0.746s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:55 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-5f393811-b96b-4a22-b8f9-93f48c04d344 tempest-CreateVolumesFromSnapshotTest-405548807 None] <== create_volume: return (1784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:28:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-5f393811-b96b-4a22-b8f9-93f48c04d344 tempest-CreateVolumesFromSnapshotTest-405548807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.787s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:28:55 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-dea9d810-3645-44d7-b364-8c4339b0e3e2 tempest-ProjectMemberTests-1866302072 None] Lock "cinder-9ea1672a-0874-448b-8331-528a04b1268f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:28:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-43212fdf-9e94-4b1b-91c9-fa56366b0650 tempest-CreateVolumesFromSnapshotTest-405548807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.099s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:28:55 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-43212fdf-9e94-4b1b-91c9-fa56366b0650 tempest-CreateVolumesFromSnapshotTest-405548807 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:28:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-951200257',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54ae1e57-27ed-46ca-ae69-356605f0e341,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22132ab0ea9b4ea988edd18ae904eedf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:28:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:28:47Z,use_quota=True,user_id='a2a91733885b484e97b56b50f871d19f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:28:55 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-43212fdf-9e94-4b1b-91c9-fa56366b0650 tempest-CreateVolumesFromSnapshotTest-405548807 None] Creating volume 54ae1e57-27ed-46ca-ae69-356605f0e341 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:28:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-43212fdf-9e94-4b1b-91c9-fa56366b0650 tempest-CreateVolumesFromSnapshotTest-405548807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:28:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-43212fdf-9e94-4b1b-91c9-fa56366b0650 tempest-CreateVolumesFromSnapshotTest-405548807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:28:55 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-43212fdf-9e94-4b1b-91c9-fa56366b0650 tempest-CreateVolumesFromSnapshotTest-405548807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:28:55 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-43212fdf-9e94-4b1b-91c9-fa56366b0650 tempest-CreateVolumesFromSnapshotTest-405548807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:28:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-43212fdf-9e94-4b1b-91c9-fa56366b0650 tempest-CreateVolumesFromSnapshotTest-405548807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:28:55 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-43212fdf-9e94-4b1b-91c9-fa56366b0650 tempest-CreateVolumesFromSnapshotTest-405548807 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:28:55 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-43212fdf-9e94-4b1b-91c9-fa56366b0650 tempest-CreateVolumesFromSnapshotTest-405548807 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:28:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-43212fdf-9e94-4b1b-91c9-fa56366b0650 tempest-CreateVolumesFromSnapshotTest-405548807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-54ae1e57-27ed-46ca-ae69-356605f0e341 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:55 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-5f393811-b96b-4a22-b8f9-93f48c04d344 tempest-CreateVolumesFromSnapshotTest-405548807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f93fa68-4baf-494d-9e78-a96e62fa14e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10c5e421-4da6-40a6-86ac-10f7e20bbd7a', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:55 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-5f393811-b96b-4a22-b8f9-93f48c04d344 tempest-CreateVolumesFromSnapshotTest-405548807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (757a7643-0bde-4635-9c08-5b2589ee99f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:55 devstack sudo[106514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-54ae1e57-27ed-46ca-ae69-356605f0e341 1073741824
Jul 03 01:28:55 devstack sudo[106514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:55 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-5f393811-b96b-4a22-b8f9-93f48c04d344 tempest-CreateVolumesFromSnapshotTest-405548807 None] Volume volume-10c5e421-4da6-40a6-86ac-10f7e20bbd7a (10c5e421-4da6-40a6-86ac-10f7e20bbd7a): created successfully
Jul 03 01:28:55 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-5f393811-b96b-4a22-b8f9-93f48c04d344 tempest-CreateVolumesFromSnapshotTest-405548807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (757a7643-0bde-4635-9c08-5b2589ee99f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:55 devstack sudo[106513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7557ec9c-f219-4c35-805e-2f4920891f90_av7iag92devstack@QuobyteHD
Jul 03 01:28:55 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-5f393811-b96b-4a22-b8f9-93f48c04d344 tempest-CreateVolumesFromSnapshotTest-405548807 None] Flow 'volume_create_manager' (01a42309-64bf-43b5-b645-f2ba2c887c7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:28:55 devstack sudo[106513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:55 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-dea9d810-3645-44d7-b364-8c4339b0e3e2 tempest-ProjectMemberTests-1866302072 None] Acquiring lock "cinder-quobyte-9ea1672a-0874-448b-8331-528a04b1268f" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:28:55 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-dea9d810-3645-44d7-b364-8c4339b0e3e2 tempest-ProjectMemberTests-1866302072 None] Lock "cinder-quobyte-9ea1672a-0874-448b-8331-528a04b1268f" acquired by "delete_volume" :: waited 0.022s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:28:55 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-5f393811-b96b-4a22-b8f9-93f48c04d344 tempest-CreateVolumesFromSnapshotTest-405548807 None] Created volume successfully.
Jul 03 01:28:55 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[a416c2f7-247f-42c8-830f-79e32e4249f3]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:28:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-dea9d810-3645-44d7-b364-8c4339b0e3e2 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9ea1672a-0874-448b-8331-528a04b1268f {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:55 devstack sudo[106517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9ea1672a-0874-448b-8331-528a04b1268f
Jul 03 01:28:55 devstack sudo[106517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:56 devstack sudo[106513]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7557ec9c-f219-4c35-805e-2f4920891f90_av7iag92devstack@QuobyteHD" returned: 0 in 0.846s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7557ec9c-f219-4c35-805e-2f4920891f90_av7iag92devstack@QuobyteHD {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:56 devstack sudo[106511]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_cf8c8570-d17b-49f7-8d5f-8b5c8abf879e_nfe2cfp_devstack@QuobyteHD /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8bf43a33-20d0-443b-b52b-4fa74bb25616" returned: 0 in 0.958s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:56 devstack cinder-volume[86891]: DEBUG cinder.image.image_utils [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cf8c8570-d17b-49f7-8d5f-8b5c8abf879e_nfe2cfp_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8bf43a33-20d0-443b-b52b-4fa74bb25616 {{(pid=86891) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 03 01:28:56 devstack cinder-volume[86891]: INFO cinder.image.image_utils [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] Converted 0.00 MB image at 0.00 MB/s
Jul 03 01:28:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8bf43a33-20d0-443b-b52b-4fa74bb25616 1G {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:56 devstack sudo[106528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8bf43a33-20d0-443b-b52b-4fa74bb25616 1G
Jul 03 01:28:56 devstack sudo[106528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:56 devstack sudo[106527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7557ec9c-f219-4c35-805e-2f4920891f90_av7iag92devstack@QuobyteHD
Jul 03 01:28:56 devstack sudo[106527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:56 devstack sudo[106514]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-43212fdf-9e94-4b1b-91c9-fa56366b0650 tempest-CreateVolumesFromSnapshotTest-405548807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-54ae1e57-27ed-46ca-ae69-356605f0e341 1073741824" returned: 0 in 1.008s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-43212fdf-9e94-4b1b-91c9-fa56366b0650 tempest-CreateVolumesFromSnapshotTest-405548807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-54ae1e57-27ed-46ca-ae69-356605f0e341 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:56 devstack sudo[106534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-54ae1e57-27ed-46ca-ae69-356605f0e341
Jul 03 01:28:56 devstack sudo[106534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:56 devstack sudo[106517]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-dea9d810-3645-44d7-b364-8c4339b0e3e2 tempest-ProjectMemberTests-1866302072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9ea1672a-0874-448b-8331-528a04b1268f" returned: 0 in 0.998s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-dea9d810-3645-44d7-b364-8c4339b0e3e2 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9ea1672a-0874-448b-8331-528a04b1268f {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:56 devstack sudo[106536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9ea1672a-0874-448b-8331-528a04b1268f
Jul 03 01:28:56 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:57 devstack sudo[106527]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7557ec9c-f219-4c35-805e-2f4920891f90_av7iag92devstack@QuobyteHD" returned: 1 in 0.829s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7557ec9c-f219-4c35-805e-2f4920891f90_av7iag92devstack@QuobyteHD' failed. Not Retrying. {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 01:28:57 devstack cinder-volume[86891]: DEBUG cinder.image.image_utils [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] 7557ec9c-f219-4c35-805e-2f4920891f90 was raw, converting to raw {{(pid=86891) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 03 01:28:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_7557ec9c-f219-4c35-805e-2f4920891f90_av7iag92devstack@QuobyteHD /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-143286f3-3101-47fe-a8ee-f429c5f1ea4f {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:57 devstack sudo[106544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_7557ec9c-f219-4c35-805e-2f4920891f90_av7iag92devstack@QuobyteHD /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-143286f3-3101-47fe-a8ee-f429c5f1ea4f
Jul 03 01:28:57 devstack sudo[106544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:57 devstack sudo[106528]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8bf43a33-20d0-443b-b52b-4fa74bb25616 1G" returned: 0 in 0.836s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:57 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[db2830ba-5bb9-40f9-8ad7-bd6098677aa5]: (4, 'raw') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:28:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8bf43a33-20d0-443b-b52b-4fa74bb25616 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:57 devstack sudo[106534]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-43212fdf-9e94-4b1b-91c9-fa56366b0650 tempest-CreateVolumesFromSnapshotTest-405548807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-54ae1e57-27ed-46ca-ae69-356605f0e341" returned: 0 in 0.812s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:57 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-43212fdf-9e94-4b1b-91c9-fa56366b0650 tempest-CreateVolumesFromSnapshotTest-405548807 None] <== create_volume: return (1876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:28:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-43212fdf-9e94-4b1b-91c9-fa56366b0650 tempest-CreateVolumesFromSnapshotTest-405548807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.880s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:28:57 devstack sudo[106547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8bf43a33-20d0-443b-b52b-4fa74bb25616
Jul 03 01:28:57 devstack sudo[106547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-747af607-353a-4f08-868d-ae88b5a9e6fc tempest-CreateVolumesFromSnapshotTest-405548807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.622s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:28:57 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-747af607-353a-4f08-868d-ae88b5a9e6fc tempest-CreateVolumesFromSnapshotTest-405548807 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:28:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-330358388',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c380941a-ec4b-48d5-98a9-b76d42c2643b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22132ab0ea9b4ea988edd18ae904eedf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:28:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:28:48Z,use_quota=True,user_id='a2a91733885b484e97b56b50f871d19f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:28:57 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-747af607-353a-4f08-868d-ae88b5a9e6fc tempest-CreateVolumesFromSnapshotTest-405548807 None] Creating volume c380941a-ec4b-48d5-98a9-b76d42c2643b {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:28:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-747af607-353a-4f08-868d-ae88b5a9e6fc tempest-CreateVolumesFromSnapshotTest-405548807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:28:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-747af607-353a-4f08-868d-ae88b5a9e6fc tempest-CreateVolumesFromSnapshotTest-405548807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:28:57 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-747af607-353a-4f08-868d-ae88b5a9e6fc tempest-CreateVolumesFromSnapshotTest-405548807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:28:57 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-747af607-353a-4f08-868d-ae88b5a9e6fc tempest-CreateVolumesFromSnapshotTest-405548807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:28:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-747af607-353a-4f08-868d-ae88b5a9e6fc tempest-CreateVolumesFromSnapshotTest-405548807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:28:57 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-747af607-353a-4f08-868d-ae88b5a9e6fc tempest-CreateVolumesFromSnapshotTest-405548807 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:28:57 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-747af607-353a-4f08-868d-ae88b5a9e6fc tempest-CreateVolumesFromSnapshotTest-405548807 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:28:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-747af607-353a-4f08-868d-ae88b5a9e6fc tempest-CreateVolumesFromSnapshotTest-405548807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c380941a-ec4b-48d5-98a9-b76d42c2643b 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:57 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:57 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-43212fdf-9e94-4b1b-91c9-fa56366b0650 tempest-CreateVolumesFromSnapshotTest-405548807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (549a7234-2230-4617-8fa1-e91a27a5089c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54ae1e57-27ed-46ca-ae69-356605f0e341', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:57 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-43212fdf-9e94-4b1b-91c9-fa56366b0650 tempest-CreateVolumesFromSnapshotTest-405548807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec9d480d-ab08-47d5-98c1-a0ad1113172b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-dea9d810-3645-44d7-b364-8c4339b0e3e2 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-9ea1672a-0874-448b-8331-528a04b1268f" returned: 0 in 0.742s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:57 devstack sudo[106550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c380941a-ec4b-48d5-98a9-b76d42c2643b 1073741824
Jul 03 01:28:57 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:57 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-dea9d810-3645-44d7-b364-8c4339b0e3e2 tempest-ProjectMemberTests-1866302072 None] Lock "cinder-quobyte-9ea1672a-0874-448b-8331-528a04b1268f" released by "delete_volume" :: held 1.841s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:28:57 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-43212fdf-9e94-4b1b-91c9-fa56366b0650 tempest-CreateVolumesFromSnapshotTest-405548807 None] Volume volume-54ae1e57-27ed-46ca-ae69-356605f0e341 (54ae1e57-27ed-46ca-ae69-356605f0e341): created successfully
Jul 03 01:28:57 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-43212fdf-9e94-4b1b-91c9-fa56366b0650 tempest-CreateVolumesFromSnapshotTest-405548807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec9d480d-ab08-47d5-98c1-a0ad1113172b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:57 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-43212fdf-9e94-4b1b-91c9-fa56366b0650 tempest-CreateVolumesFromSnapshotTest-405548807 None] Flow 'volume_create_manager' (49461e6f-4c8d-49b8-b631-9775dd1f3dfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:28:57 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-43212fdf-9e94-4b1b-91c9-fa56366b0650 tempest-CreateVolumesFromSnapshotTest-405548807 None] Created volume successfully.
Jul 03 01:28:57 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-dea9d810-3645-44d7-b364-8c4339b0e3e2 tempest-ProjectMemberTests-1866302072 None] Created reservations ['9f057c2f-5be0-4e74-b719-a7e653c16f96', 'f3d9baff-c1be-4a19-a5d1-1fae6b63e9d2', '9594b8f2-64eb-4d4e-abcb-47b0d72a3cc1', '445a5254-c73e-43bf-8c28-958e2769a6c5'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:28:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-dea9d810-3645-44d7-b364-8c4339b0e3e2 tempest-ProjectMemberTests-1866302072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:28:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-dea9d810-3645-44d7-b364-8c4339b0e3e2 tempest-ProjectMemberTests-1866302072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:28:57 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-dea9d810-3645-44d7-b364-8c4339b0e3e2 tempest-ProjectMemberTests-1866302072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:28:57 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-dea9d810-3645-44d7-b364-8c4339b0e3e2 tempest-ProjectMemberTests-1866302072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:28:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-dea9d810-3645-44d7-b364-8c4339b0e3e2 tempest-ProjectMemberTests-1866302072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:28:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-dea9d810-3645-44d7-b364-8c4339b0e3e2 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:57 devstack sudo[106552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:28:57 devstack sudo[106552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:58 devstack sudo[106544]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_7557ec9c-f219-4c35-805e-2f4920891f90_av7iag92devstack@QuobyteHD /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-143286f3-3101-47fe-a8ee-f429c5f1ea4f" returned: 0 in 1.119s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:58 devstack cinder-volume[86891]: DEBUG cinder.image.image_utils [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7557ec9c-f219-4c35-805e-2f4920891f90_av7iag92devstack@QuobyteHD, size 0.00 MB, duration 1.12 sec, destination /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-143286f3-3101-47fe-a8ee-f429c5f1ea4f {{(pid=86891) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 03 01:28:58 devstack cinder-volume[86891]: INFO cinder.image.image_utils [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Converted 0.00 MB image at 0.00 MB/s
Jul 03 01:28:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-143286f3-3101-47fe-a8ee-f429c5f1ea4f 1G {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:58 devstack sudo[106559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-143286f3-3101-47fe-a8ee-f429c5f1ea4f 1G
Jul 03 01:28:58 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:58 devstack sudo[106547]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8bf43a33-20d0-443b-b52b-4fa74bb25616" returned: 0 in 1.189s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8bf43a33-20d0-443b-b52b-4fa74bb25616 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:58 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c55fc80-5ba1-4cf6-a779-b90dca692945 tempest-ProjectMemberTests-1866302072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:28:58 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-8c55fc80-5ba1-4cf6-a779-b90dca692945 tempest-ProjectMemberTests-1866302072 None] Flow 'volume_create_manager' (37216961-164b-4a58-8f2b-9d60a08e6cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:28:58 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-8c55fc80-5ba1-4cf6-a779-b90dca692945 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c5cae05-77ea-4cbe-b413-aee4b136198c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:58 devstack sudo[106564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8bf43a33-20d0-443b-b52b-4fa74bb25616
Jul 03 01:28:58 devstack sudo[106564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:58 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-8c55fc80-5ba1-4cf6-a779-b90dca692945 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c5cae05-77ea-4cbe-b413-aee4b136198c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1240053958',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93ded461-71d6-453a-99f3-c58f053e5532,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16429f2745354b0591f4044f3a99b9fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:28:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:28:59Z,use_quota=True,user_id='31dd51f2dcdd4724a4c6b78cb80e6d8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:58 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-8c55fc80-5ba1-4cf6-a779-b90dca692945 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ef47a4b-4d92-411e-8027-a02dbd51282a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:58 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-8c55fc80-5ba1-4cf6-a779-b90dca692945 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ef47a4b-4d92-411e-8027-a02dbd51282a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:58 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-8c55fc80-5ba1-4cf6-a779-b90dca692945 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7daf9bb9-b1fc-4da2-aa55-0bf9479b36f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:58 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-8c55fc80-5ba1-4cf6-a779-b90dca692945 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7daf9bb9-b1fc-4da2-aa55-0bf9479b36f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93ded461-71d6-453a-99f3-c58f053e5532', 'volume_name': 'volume-93ded461-71d6-453a-99f3-c58f053e5532', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:58 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-8c55fc80-5ba1-4cf6-a779-b90dca692945 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dba6734-7a09-43cf-8d36-7923339e7ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:58 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-8c55fc80-5ba1-4cf6-a779-b90dca692945 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dba6734-7a09-43cf-8d36-7923339e7ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:58 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-8c55fc80-5ba1-4cf6-a779-b90dca692945 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa3bd074-5de1-490c-bcab-ea30022ecf6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:58 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-8c55fc80-5ba1-4cf6-a779-b90dca692945 tempest-ProjectMemberTests-1866302072 None] Volume 93ded461-71d6-453a-99f3-c58f053e5532: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93ded461-71d6-453a-99f3-c58f053e5532', 'volume_size': 1}
Jul 03 01:28:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-8c55fc80-5ba1-4cf6-a779-b90dca692945 tempest-ProjectMemberTests-1866302072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:28:58 devstack sudo[106552]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-dea9d810-3645-44d7-b364-8c4339b0e3e2 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.984s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:58 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-dea9d810-3645-44d7-b364-8c4339b0e3e2 tempest-ProjectMemberTests-1866302072 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:28:58 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-dea9d810-3645-44d7-b364-8c4339b0e3e2 tempest-ProjectMemberTests-1866302072 None] Deleted volume successfully.
Jul 03 01:28:58 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-dea9d810-3645-44d7-b364-8c4339b0e3e2 tempest-ProjectMemberTests-1866302072 None] Lock "cinder-9ea1672a-0874-448b-8331-528a04b1268f-delete_volume" released by "delete_volume" :: held 3.213s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:28:58 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-747af607-353a-4f08-868d-ae88b5a9e6fc tempest-CreateVolumesFromSnapshotTest-405548807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c380941a-ec4b-48d5-98a9-b76d42c2643b 1073741824" returned: 0 in 1.393s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-747af607-353a-4f08-868d-ae88b5a9e6fc tempest-CreateVolumesFromSnapshotTest-405548807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c380941a-ec4b-48d5-98a9-b76d42c2643b {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:58 devstack sudo[106569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c380941a-ec4b-48d5-98a9-b76d42c2643b
Jul 03 01:28:58 devstack sudo[106569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:59 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-143286f3-3101-47fe-a8ee-f429c5f1ea4f 1G" returned: 0 in 0.854s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:59 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ccdaed7-9451-4694-afb1-dce7674bdbee]: (4, 'raw') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:28:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-143286f3-3101-47fe-a8ee-f429c5f1ea4f {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:59 devstack sudo[106574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-143286f3-3101-47fe-a8ee-f429c5f1ea4f
Jul 03 01:28:59 devstack sudo[106574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:59 devstack sudo[106564]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8bf43a33-20d0-443b-b52b-4fa74bb25616" returned: 1 in 0.941s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8bf43a33-20d0-443b-b52b-4fa74bb25616' failed. Not Retrying. {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 01:28:59 devstack cinder-volume[86891]: DEBUG cinder.volume.volume_utils [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] Downloaded image cf8c8570-d17b-49f7-8d5f-8b5c8abf879e ((None, [{'url': 'file:///opt/stack/data/glance/images/cf8c8570-d17b-49f7-8d5f-8b5c8abf879e', 'metadata': {}}])) to volume 8bf43a33-20d0-443b-b52b-4fa74bb25616 successfully. {{(pid=86891) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 03 01:28:59 devstack cinder-volume[86891]: DEBUG cinder.image.image_utils [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] Temporary image cf8c8570-d17b-49f7-8d5f-8b5c8abf879e for user c421e69cca9643c4a0685495da019d05 is deleted. {{(pid=86891) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 03 01:28:59 devstack cinder-volume[86891]: DEBUG cinder.volume.volume_utils [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] Marking volume 8bf43a33-20d0-443b-b52b-4fa74bb25616 as bootable. {{(pid=86891) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 03 01:28:59 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] Copying metadata from image cf8c8570-d17b-49f7-8d5f-8b5c8abf879e to 8bf43a33-20d0-443b-b52b-4fa74bb25616. {{(pid=86891) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 03 01:28:59 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] Creating volume glance metadata for volume 8bf43a33-20d0-443b-b52b-4fa74bb25616 backed by image cf8c8570-d17b-49f7-8d5f-8b5c8abf879e with: {'image_id': 'cf8c8570-d17b-49f7-8d5f-8b5c8abf879e', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '38cd87eea0c24646ab5dc3946452b966', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86891) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 03 01:28:59 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7227e882-367c-4240-91ec-7160a980d5e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bf43a33-20d0-443b-b52b-4fa74bb25616', 'volume_size': 1, 'image_id': 'cf8c8570-d17b-49f7-8d5f-8b5c8abf879e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cf8c8570-d17b-49f7-8d5f-8b5c8abf879e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '38cd87eea0c24646ab5dc3946452b966', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a6563e733af447119e3b7053f3c3b1f1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '88b34bbd65dfac70a061e9510a01ed2c24367101276328d97b8290a1f37e31064ce588b31c8e3831a51d9b3034fd2ee3cc7023dcffb86151395f37e0884dbc11', 'id': 'cf8c8570-d17b-49f7-8d5f-8b5c8abf879e', 'created_at': datetime.datetime(2026, 7, 2, 23, 28, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 23, 28, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cf8c8570-d17b-49f7-8d5f-8b5c8abf879e/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7c5b357813d0>}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:59 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ded2668-8cfb-4c9d-9f5b-42718f4c4de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:59 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] Volume volume-8bf43a33-20d0-443b-b52b-4fa74bb25616 (8bf43a33-20d0-443b-b52b-4fa74bb25616): created successfully
Jul 03 01:28:59 devstack sudo[106569]: pam_unix(sudo:session): session closed for user root
Jul 03 01:28:59 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ded2668-8cfb-4c9d-9f5b-42718f4c4de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:59 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] Flow 'volume_create_manager' (532b8f34-b41c-44a4-87ec-7fbfdc4d40ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:28:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-747af607-353a-4f08-868d-ae88b5a9e6fc tempest-CreateVolumesFromSnapshotTest-405548807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c380941a-ec4b-48d5-98a9-b76d42c2643b" returned: 0 in 0.701s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:28:59 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-747af607-353a-4f08-868d-ae88b5a9e6fc tempest-CreateVolumesFromSnapshotTest-405548807 None] <== create_volume: return (2144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:28:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-747af607-353a-4f08-868d-ae88b5a9e6fc tempest-CreateVolumesFromSnapshotTest-405548807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.149s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:28:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-2394ad4b-7360-45d1-be03-c25751a3c68d tempest-CreateVolumesFromSnapshotTest-405548807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.409s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:28:59 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-2394ad4b-7360-45d1-be03-c25751a3c68d tempest-CreateVolumesFromSnapshotTest-405548807 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:28:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1203259148',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51f722e2-1253-4b59-ae08-1d27e93636c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22132ab0ea9b4ea988edd18ae904eedf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:28:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:28:48Z,use_quota=True,user_id='a2a91733885b484e97b56b50f871d19f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:28:59 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-2394ad4b-7360-45d1-be03-c25751a3c68d tempest-CreateVolumesFromSnapshotTest-405548807 None] Creating volume 51f722e2-1253-4b59-ae08-1d27e93636c9 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:28:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-2394ad4b-7360-45d1-be03-c25751a3c68d tempest-CreateVolumesFromSnapshotTest-405548807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:28:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-2394ad4b-7360-45d1-be03-c25751a3c68d tempest-CreateVolumesFromSnapshotTest-405548807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:28:59 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-2394ad4b-7360-45d1-be03-c25751a3c68d tempest-CreateVolumesFromSnapshotTest-405548807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:28:59 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-2394ad4b-7360-45d1-be03-c25751a3c68d tempest-CreateVolumesFromSnapshotTest-405548807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:28:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-2394ad4b-7360-45d1-be03-c25751a3c68d tempest-CreateVolumesFromSnapshotTest-405548807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:28:59 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-2394ad4b-7360-45d1-be03-c25751a3c68d tempest-CreateVolumesFromSnapshotTest-405548807 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:28:59 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-2394ad4b-7360-45d1-be03-c25751a3c68d tempest-CreateVolumesFromSnapshotTest-405548807 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:28:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-2394ad4b-7360-45d1-be03-c25751a3c68d tempest-CreateVolumesFromSnapshotTest-405548807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-51f722e2-1253-4b59-ae08-1d27e93636c9 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:28:59 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-bf722602-42ca-4ffe-92bc-dbe1fe0a6253 tempest-VolumeImageDependencyTests-1221049938 None] Created volume successfully.
Jul 03 01:28:59 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-747af607-353a-4f08-868d-ae88b5a9e6fc tempest-CreateVolumesFromSnapshotTest-405548807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1cae43c-ea29-404d-877a-dc6174891d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c380941a-ec4b-48d5-98a9-b76d42c2643b', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:59 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-747af607-353a-4f08-868d-ae88b5a9e6fc tempest-CreateVolumesFromSnapshotTest-405548807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64949986-5008-4e4a-b668-8b5bf5da9f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:28:59 devstack sudo[106580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-51f722e2-1253-4b59-ae08-1d27e93636c9 1073741824
Jul 03 01:28:59 devstack sudo[106580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:28:59 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-747af607-353a-4f08-868d-ae88b5a9e6fc tempest-CreateVolumesFromSnapshotTest-405548807 None] Volume volume-c380941a-ec4b-48d5-98a9-b76d42c2643b (c380941a-ec4b-48d5-98a9-b76d42c2643b): created successfully
Jul 03 01:28:59 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-747af607-353a-4f08-868d-ae88b5a9e6fc tempest-CreateVolumesFromSnapshotTest-405548807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64949986-5008-4e4a-b668-8b5bf5da9f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:28:59 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-747af607-353a-4f08-868d-ae88b5a9e6fc tempest-CreateVolumesFromSnapshotTest-405548807 None] Flow 'volume_create_manager' (ed592777-8222-47e9-b4c8-8011f0ab6931) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:28:59 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-747af607-353a-4f08-868d-ae88b5a9e6fc tempest-CreateVolumesFromSnapshotTest-405548807 None] Created volume successfully.
Jul 03 01:29:00 devstack sudo[106574]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:00 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-143286f3-3101-47fe-a8ee-f429c5f1ea4f" returned: 0 in 0.833s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:00 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-143286f3-3101-47fe-a8ee-f429c5f1ea4f {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:00 devstack sudo[106584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-143286f3-3101-47fe-a8ee-f429c5f1ea4f
Jul 03 01:29:00 devstack sudo[106584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:00 devstack sudo[106580]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:00 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-2394ad4b-7360-45d1-be03-c25751a3c68d tempest-CreateVolumesFromSnapshotTest-405548807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-51f722e2-1253-4b59-ae08-1d27e93636c9 1073741824" returned: 0 in 0.973s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:00 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-2394ad4b-7360-45d1-be03-c25751a3c68d tempest-CreateVolumesFromSnapshotTest-405548807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-51f722e2-1253-4b59-ae08-1d27e93636c9 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:00 devstack sudo[106589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-51f722e2-1253-4b59-ae08-1d27e93636c9
Jul 03 01:29:00 devstack sudo[106589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:00 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8b0ec8b9-0c5a-4b88-b37e-a54d56b83ff4 tempest-VolumeImageDependencyTests-1221049938 None] Acquiring lock "cinder-8bf43a33-20d0-443b-b52b-4fa74bb25616-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:29:00 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8b0ec8b9-0c5a-4b88-b37e-a54d56b83ff4 tempest-VolumeImageDependencyTests-1221049938 None] Lock "cinder-8bf43a33-20d0-443b-b52b-4fa74bb25616-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:29:00 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8b0ec8b9-0c5a-4b88-b37e-a54d56b83ff4 tempest-VolumeImageDependencyTests-1221049938 None] Acquiring lock "cinder-quobyte-8bf43a33-20d0-443b-b52b-4fa74bb25616" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:29:00 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8b0ec8b9-0c5a-4b88-b37e-a54d56b83ff4 tempest-VolumeImageDependencyTests-1221049938 None] Lock "cinder-quobyte-8bf43a33-20d0-443b-b52b-4fa74bb25616" acquired by "delete_volume" :: waited 0.017s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:29:00 devstack sudo[106584]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:00 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-143286f3-3101-47fe-a8ee-f429c5f1ea4f" returned: 1 in 0.856s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:00 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-143286f3-3101-47fe-a8ee-f429c5f1ea4f' failed. Not Retrying. {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 01:29:00 devstack cinder-volume[86891]: DEBUG cinder.volume.volume_utils [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Downloaded image 7557ec9c-f219-4c35-805e-2f4920891f90 ((None, [{'url': 'file:///opt/stack/data/glance/images/7557ec9c-f219-4c35-805e-2f4920891f90', 'metadata': {}}])) to volume 143286f3-3101-47fe-a8ee-f429c5f1ea4f successfully. {{(pid=86891) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 03 01:29:00 devstack cinder-volume[86891]: DEBUG cinder.image.image_utils [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Temporary image 7557ec9c-f219-4c35-805e-2f4920891f90 for user ac3f6fcc82604dae880b875ac8f51095 is deleted. {{(pid=86891) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 03 01:29:00 devstack cinder-volume[86891]: DEBUG cinder.volume.volume_utils [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Marking volume 143286f3-3101-47fe-a8ee-f429c5f1ea4f as bootable. {{(pid=86891) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 03 01:29:00 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[c281ff4c-ab0c-46f8-bd03-8f8c3ab19055]: (4, 'raw') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:29:00 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8b0ec8b9-0c5a-4b88-b37e-a54d56b83ff4 tempest-VolumeImageDependencyTests-1221049938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8bf43a33-20d0-443b-b52b-4fa74bb25616 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:01 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Copying metadata from image 7557ec9c-f219-4c35-805e-2f4920891f90 to 143286f3-3101-47fe-a8ee-f429c5f1ea4f. {{(pid=86891) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 03 01:29:01 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Creating volume glance metadata for volume 143286f3-3101-47fe-a8ee-f429c5f1ea4f backed by image 7557ec9c-f219-4c35-805e-2f4920891f90 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '7557ec9c-f219-4c35-805e-2f4920891f90', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'ed2df184ac9287f73c5fc21d3d5f5b19', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86891) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 03 01:29:01 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c71e75cc-a937-4211-a63c-559a8e99e1db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-143286f3-3101-47fe-a8ee-f429c5f1ea4f', 'volume_size': 1, 'image_id': '7557ec9c-f219-4c35-805e-2f4920891f90', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7557ec9c-f219-4c35-805e-2f4920891f90', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ed2df184ac9287f73c5fc21d3d5f5b19', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fd8babb4dd864a91b6e815550cb0fa6e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1af025bbd759850cecf2702c61109d01b778e9894b2916cee38a183bccedb5a389b8c1bcab85cbc6dab2189415c251cefa3d82401cc004aba571e173e1dc6d63', 'id': '7557ec9c-f219-4c35-805e-2f4920891f90', 'created_at': datetime.datetime(2026, 7, 2, 23, 28, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 23, 28, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7557ec9c-f219-4c35-805e-2f4920891f90/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7c5b353df410>}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:01 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b90d2658-c4de-40ff-ac08-988fe478e2ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:01 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Volume volume-143286f3-3101-47fe-a8ee-f429c5f1ea4f (143286f3-3101-47fe-a8ee-f429c5f1ea4f): created successfully
Jul 03 01:29:01 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b90d2658-c4de-40ff-ac08-988fe478e2ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:01 devstack sudo[106594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8bf43a33-20d0-443b-b52b-4fa74bb25616
Jul 03 01:29:01 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:01 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Flow 'volume_create_manager' (8d5a686e-1424-46d2-b813-92ff6886c01f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:29:01 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-e234001c-1951-4429-8f0a-3851092272b9 tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Created volume successfully.
Jul 03 01:29:01 devstack sudo[106589]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-2394ad4b-7360-45d1-be03-c25751a3c68d tempest-CreateVolumesFromSnapshotTest-405548807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-51f722e2-1253-4b59-ae08-1d27e93636c9" returned: 0 in 0.681s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-2394ad4b-7360-45d1-be03-c25751a3c68d tempest-CreateVolumesFromSnapshotTest-405548807 None] <== create_volume: return (1697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:29:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-2394ad4b-7360-45d1-be03-c25751a3c68d tempest-CreateVolumesFromSnapshotTest-405548807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.699s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:29:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-fe80738e-9c5d-4e78-ad50-5ff0c473d3b7 tempest-CreateVolumesFromSnapshotTest-405548807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.772s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:29:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-fe80738e-9c5d-4e78-ad50-5ff0c473d3b7 tempest-CreateVolumesFromSnapshotTest-405548807 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:28:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-228338739',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5df7303f-aec9-48c9-a478-24e570ddce34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22132ab0ea9b4ea988edd18ae904eedf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:28:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:28:48Z,use_quota=True,user_id='a2a91733885b484e97b56b50f871d19f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:29:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-fe80738e-9c5d-4e78-ad50-5ff0c473d3b7 tempest-CreateVolumesFromSnapshotTest-405548807 None] Creating volume 5df7303f-aec9-48c9-a478-24e570ddce34 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:29:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-fe80738e-9c5d-4e78-ad50-5ff0c473d3b7 tempest-CreateVolumesFromSnapshotTest-405548807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:29:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-fe80738e-9c5d-4e78-ad50-5ff0c473d3b7 tempest-CreateVolumesFromSnapshotTest-405548807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:29:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-fe80738e-9c5d-4e78-ad50-5ff0c473d3b7 tempest-CreateVolumesFromSnapshotTest-405548807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:29:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-fe80738e-9c5d-4e78-ad50-5ff0c473d3b7 tempest-CreateVolumesFromSnapshotTest-405548807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:29:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-fe80738e-9c5d-4e78-ad50-5ff0c473d3b7 tempest-CreateVolumesFromSnapshotTest-405548807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:29:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-fe80738e-9c5d-4e78-ad50-5ff0c473d3b7 tempest-CreateVolumesFromSnapshotTest-405548807 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:29:01 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-fe80738e-9c5d-4e78-ad50-5ff0c473d3b7 tempest-CreateVolumesFromSnapshotTest-405548807 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:29:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-fe80738e-9c5d-4e78-ad50-5ff0c473d3b7 tempest-CreateVolumesFromSnapshotTest-405548807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-5df7303f-aec9-48c9-a478-24e570ddce34 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:01 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-2394ad4b-7360-45d1-be03-c25751a3c68d tempest-CreateVolumesFromSnapshotTest-405548807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2462267b-080d-4c33-8549-52bb70c9d8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51f722e2-1253-4b59-ae08-1d27e93636c9', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:01 devstack sudo[106597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-5df7303f-aec9-48c9-a478-24e570ddce34 1073741824
Jul 03 01:29:01 devstack sudo[106597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:01 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-2394ad4b-7360-45d1-be03-c25751a3c68d tempest-CreateVolumesFromSnapshotTest-405548807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a65acbaa-5e09-4e10-9c5b-18eb7b41b3fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:01 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-2394ad4b-7360-45d1-be03-c25751a3c68d tempest-CreateVolumesFromSnapshotTest-405548807 None] Volume volume-51f722e2-1253-4b59-ae08-1d27e93636c9 (51f722e2-1253-4b59-ae08-1d27e93636c9): created successfully
Jul 03 01:29:01 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-2394ad4b-7360-45d1-be03-c25751a3c68d tempest-CreateVolumesFromSnapshotTest-405548807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a65acbaa-5e09-4e10-9c5b-18eb7b41b3fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:01 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-2394ad4b-7360-45d1-be03-c25751a3c68d tempest-CreateVolumesFromSnapshotTest-405548807 None] Flow 'volume_create_manager' (e0d5b289-c160-413a-98fe-9c3ccb01e0f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:29:01 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-2394ad4b-7360-45d1-be03-c25751a3c68d tempest-CreateVolumesFromSnapshotTest-405548807 None] Created volume successfully.
Jul 03 01:29:01 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-588c15da-24d4-4384-b84f-fae3139c696b tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Acquiring lock "cinder-143286f3-3101-47fe-a8ee-f429c5f1ea4f-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:29:01 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-588c15da-24d4-4384-b84f-fae3139c696b tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Lock "cinder-143286f3-3101-47fe-a8ee-f429c5f1ea4f-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:29:01 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-588c15da-24d4-4384-b84f-fae3139c696b tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Acquiring lock "cinder-quobyte-143286f3-3101-47fe-a8ee-f429c5f1ea4f" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:29:01 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-588c15da-24d4-4384-b84f-fae3139c696b tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Lock "cinder-quobyte-143286f3-3101-47fe-a8ee-f429c5f1ea4f" acquired by "delete_volume" :: waited 0.018s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:29:01 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8ebe3b-0d91-40d9-8a5a-a17e3a03d54e]: (4, 'raw') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:29:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-588c15da-24d4-4384-b84f-fae3139c696b tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-143286f3-3101-47fe-a8ee-f429c5f1ea4f {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:01 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8b0ec8b9-0c5a-4b88-b37e-a54d56b83ff4 tempest-VolumeImageDependencyTests-1221049938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8bf43a33-20d0-443b-b52b-4fa74bb25616" returned: 0 in 0.866s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8b0ec8b9-0c5a-4b88-b37e-a54d56b83ff4 tempest-VolumeImageDependencyTests-1221049938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8bf43a33-20d0-443b-b52b-4fa74bb25616 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:01 devstack cinder-volume[86891]: DEBUG oslo_service.periodic_task [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86891) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 01:29:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:29:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:29:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:29:01 devstack sudo[106601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-143286f3-3101-47fe-a8ee-f429c5f1ea4f
Jul 03 01:29:01 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:29:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:29:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:01 devstack sudo[106602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8bf43a33-20d0-443b-b52b-4fa74bb25616
Jul 03 01:29:01 devstack sudo[106602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:02 devstack sudo[106608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:29:02 devstack sudo[106608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:02 devstack sudo[106597]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-fe80738e-9c5d-4e78-ad50-5ff0c473d3b7 tempest-CreateVolumesFromSnapshotTest-405548807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-5df7303f-aec9-48c9-a478-24e570ddce34 1073741824" returned: 0 in 0.869s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-fe80738e-9c5d-4e78-ad50-5ff0c473d3b7 tempest-CreateVolumesFromSnapshotTest-405548807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-5df7303f-aec9-48c9-a478-24e570ddce34 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:02 devstack sudo[106611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-5df7303f-aec9-48c9-a478-24e570ddce34
Jul 03 01:29:02 devstack sudo[106611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:02 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-588c15da-24d4-4384-b84f-fae3139c696b tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-143286f3-3101-47fe-a8ee-f429c5f1ea4f" returned: 0 in 0.803s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-588c15da-24d4-4384-b84f-fae3139c696b tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-143286f3-3101-47fe-a8ee-f429c5f1ea4f {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:02 devstack sudo[106602]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8b0ec8b9-0c5a-4b88-b37e-a54d56b83ff4 tempest-VolumeImageDependencyTests-1221049938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8bf43a33-20d0-443b-b52b-4fa74bb25616" returned: 1 in 0.823s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8b0ec8b9-0c5a-4b88-b37e-a54d56b83ff4 tempest-VolumeImageDependencyTests-1221049938 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8bf43a33-20d0-443b-b52b-4fa74bb25616' failed. Not Retrying. {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 01:29:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8b0ec8b9-0c5a-4b88-b37e-a54d56b83ff4 tempest-VolumeImageDependencyTests-1221049938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8bf43a33-20d0-443b-b52b-4fa74bb25616 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:02 devstack sudo[106620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8bf43a33-20d0-443b-b52b-4fa74bb25616
Jul 03 01:29:02 devstack sudo[106620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:02 devstack sudo[106619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-143286f3-3101-47fe-a8ee-f429c5f1ea4f
Jul 03 01:29:02 devstack sudo[106619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:02 devstack sudo[106608]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.861s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:02 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:29:02 devstack cinder-volume[86891]: DEBUG oslo_service.periodic_task [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running periodic task VolumeManager._thread_info {{(pid=86891) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 01:29:02 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] thread count: 28 {{(pid=86891) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 01:29:02 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] thread info: [<_MainThread(MainThread, started 136731296534656)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136731184953280)>, <Thread(Thread-3 (stat_writer), started daemon 136731184058816)>, <Thread(Rabbit-heartbeat, started daemon 136731184846080)>, <Thread(Thread-5 (_runner), started daemon 136731182936576)>, <Thread(Thread-7 (_runner), started daemon 136731182954944)>, <Thread(fd_logger, started daemon 136731181916416)>, <Thread(privsep_reader, started daemon 136731180942208)>, <Thread(tpool_thread_0, started daemon 136731172161216)>, <Thread(tpool_thread_1, started daemon 136731163768512)>, <Thread(tpool_thread_2, started daemon 136731155375808)>, <Thread(tpool_thread_3, started daemon 136731146983104)>, <Thread(tpool_thread_4, started daemon 136731138590400)>, <Thread(tpool_thread_5, started daemon 136731130197696)>, <Thread(tpool_thread_6, started daemon 136731121804992)>, <Thread(tpool_thread_7, started daemon 136731113412288)>, <Thread(tpool_thread_8, started daemon 136731105003200)>, <Thread(tpool_thread_9, started daemon 136731096594112)>, <Thread(tpool_thread_10, started daemon 136731088185024)>, <Thread(tpool_thread_11, started daemon 136731079775936)>, <Thread(tpool_thread_12, started daemon 136731071366848)>, <Thread(tpool_thread_13, started daemon 136731062957760)>, <Thread(tpool_thread_14, started daemon 136731054548672)>, <Thread(tpool_thread_15, started daemon 136731046139584)>, <Thread(tpool_thread_16, started daemon 136731037730496)>, <Thread(tpool_thread_17, started daemon 136731029321408)>, <Thread(tpool_thread_18, started daemon 136731020912320)>, <Thread(tpool_thread_19, started daemon 136731012503232)>] {{(pid=86891) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 01:29:03 devstack sudo[106611]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-fe80738e-9c5d-4e78-ad50-5ff0c473d3b7 tempest-CreateVolumesFromSnapshotTest-405548807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-5df7303f-aec9-48c9-a478-24e570ddce34" returned: 0 in 0.741s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:03 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-fe80738e-9c5d-4e78-ad50-5ff0c473d3b7 tempest-CreateVolumesFromSnapshotTest-405548807 None] <== create_volume: return (1666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:29:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-fe80738e-9c5d-4e78-ad50-5ff0c473d3b7 tempest-CreateVolumesFromSnapshotTest-405548807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.671s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:29:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-8c55fc80-5ba1-4cf6-a779-b90dca692945 tempest-ProjectMemberTests-1866302072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.260s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:29:03 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-8c55fc80-5ba1-4cf6-a779-b90dca692945 tempest-ProjectMemberTests-1866302072 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1240053958',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93ded461-71d6-453a-99f3-c58f053e5532,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16429f2745354b0591f4044f3a99b9fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:28:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:28:59Z,use_quota=True,user_id='31dd51f2dcdd4724a4c6b78cb80e6d8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:29:03 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-8c55fc80-5ba1-4cf6-a779-b90dca692945 tempest-ProjectMemberTests-1866302072 None] Creating volume 93ded461-71d6-453a-99f3-c58f053e5532 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:29:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-8c55fc80-5ba1-4cf6-a779-b90dca692945 tempest-ProjectMemberTests-1866302072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:29:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-8c55fc80-5ba1-4cf6-a779-b90dca692945 tempest-ProjectMemberTests-1866302072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:29:03 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-8c55fc80-5ba1-4cf6-a779-b90dca692945 tempest-ProjectMemberTests-1866302072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:29:03 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-8c55fc80-5ba1-4cf6-a779-b90dca692945 tempest-ProjectMemberTests-1866302072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:29:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-8c55fc80-5ba1-4cf6-a779-b90dca692945 tempest-ProjectMemberTests-1866302072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:29:03 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-8c55fc80-5ba1-4cf6-a779-b90dca692945 tempest-ProjectMemberTests-1866302072 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:29:03 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-8c55fc80-5ba1-4cf6-a779-b90dca692945 tempest-ProjectMemberTests-1866302072 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:29:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8c55fc80-5ba1-4cf6-a779-b90dca692945 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-93ded461-71d6-453a-99f3-c58f053e5532 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:03 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fe80738e-9c5d-4e78-ad50-5ff0c473d3b7 tempest-CreateVolumesFromSnapshotTest-405548807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5496626-5743-4262-b818-21f0e36078b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5df7303f-aec9-48c9-a478-24e570ddce34', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:03 devstack sudo[106624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-93ded461-71d6-453a-99f3-c58f053e5532 1073741824
Jul 03 01:29:03 devstack sudo[106624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:03 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fe80738e-9c5d-4e78-ad50-5ff0c473d3b7 tempest-CreateVolumesFromSnapshotTest-405548807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb75e6fd-cc32-4740-8943-4e5fbccaa283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:03 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-fe80738e-9c5d-4e78-ad50-5ff0c473d3b7 tempest-CreateVolumesFromSnapshotTest-405548807 None] Volume volume-5df7303f-aec9-48c9-a478-24e570ddce34 (5df7303f-aec9-48c9-a478-24e570ddce34): created successfully
Jul 03 01:29:03 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fe80738e-9c5d-4e78-ad50-5ff0c473d3b7 tempest-CreateVolumesFromSnapshotTest-405548807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb75e6fd-cc32-4740-8943-4e5fbccaa283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:03 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fe80738e-9c5d-4e78-ad50-5ff0c473d3b7 tempest-CreateVolumesFromSnapshotTest-405548807 None] Flow 'volume_create_manager' (e653a898-51ef-41c8-95a1-14e3fefc1b86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:29:03 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-fe80738e-9c5d-4e78-ad50-5ff0c473d3b7 tempest-CreateVolumesFromSnapshotTest-405548807 None] Created volume successfully.
Jul 03 01:29:03 devstack sudo[106619]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-588c15da-24d4-4384-b84f-fae3139c696b tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-143286f3-3101-47fe-a8ee-f429c5f1ea4f" returned: 1 in 0.798s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-588c15da-24d4-4384-b84f-fae3139c696b tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-143286f3-3101-47fe-a8ee-f429c5f1ea4f' failed. Not Retrying. {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 01:29:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-588c15da-24d4-4384-b84f-fae3139c696b tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-143286f3-3101-47fe-a8ee-f429c5f1ea4f {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:03 devstack sudo[106620]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8b0ec8b9-0c5a-4b88-b37e-a54d56b83ff4 tempest-VolumeImageDependencyTests-1221049938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8bf43a33-20d0-443b-b52b-4fa74bb25616" returned: 0 in 0.780s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:03 devstack sudo[106630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-143286f3-3101-47fe-a8ee-f429c5f1ea4f
Jul 03 01:29:03 devstack sudo[106630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:03 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8b0ec8b9-0c5a-4b88-b37e-a54d56b83ff4 tempest-VolumeImageDependencyTests-1221049938 None] Lock "cinder-quobyte-8bf43a33-20d0-443b-b52b-4fa74bb25616" released by "delete_volume" :: held 2.541s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:29:03 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-8b0ec8b9-0c5a-4b88-b37e-a54d56b83ff4 tempest-VolumeImageDependencyTests-1221049938 None] Created reservations ['d31345bf-5e47-4847-8c20-15c3950843d7', 'e81bdaf8-f38d-4874-9914-0c736e626a59', 'bd92a68c-5f76-4192-84bb-914a59a7bf76', '126e97f4-53a7-41aa-a64a-19d166bfaf0d'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:29:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-8b0ec8b9-0c5a-4b88-b37e-a54d56b83ff4 tempest-VolumeImageDependencyTests-1221049938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:29:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-8b0ec8b9-0c5a-4b88-b37e-a54d56b83ff4 tempest-VolumeImageDependencyTests-1221049938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:29:03 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-8b0ec8b9-0c5a-4b88-b37e-a54d56b83ff4 tempest-VolumeImageDependencyTests-1221049938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:29:03 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-8b0ec8b9-0c5a-4b88-b37e-a54d56b83ff4 tempest-VolumeImageDependencyTests-1221049938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:29:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-8b0ec8b9-0c5a-4b88-b37e-a54d56b83ff4 tempest-VolumeImageDependencyTests-1221049938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:29:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8b0ec8b9-0c5a-4b88-b37e-a54d56b83ff4 tempest-VolumeImageDependencyTests-1221049938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:03 devstack sudo[106632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:29:03 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:03 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-655c418b-4bb8-4b3d-b98c-21450864387b tempest-CreateVolumesFromSnapshotTest-405548807 None] Acquiring lock "cinder-5df7303f-aec9-48c9-a478-24e570ddce34-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:29:03 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-655c418b-4bb8-4b3d-b98c-21450864387b tempest-CreateVolumesFromSnapshotTest-405548807 None] Lock "cinder-5df7303f-aec9-48c9-a478-24e570ddce34-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:29:04 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-655c418b-4bb8-4b3d-b98c-21450864387b tempest-CreateVolumesFromSnapshotTest-405548807 None] Acquiring lock "cinder-quobyte-5df7303f-aec9-48c9-a478-24e570ddce34" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:29:04 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-655c418b-4bb8-4b3d-b98c-21450864387b tempest-CreateVolumesFromSnapshotTest-405548807 None] Lock "cinder-quobyte-5df7303f-aec9-48c9-a478-24e570ddce34" acquired by "delete_volume" :: waited 0.018s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:29:04 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4788dc4-b828-4421-ad39-759c8da41a5d]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:29:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-655c418b-4bb8-4b3d-b98c-21450864387b tempest-CreateVolumesFromSnapshotTest-405548807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-5df7303f-aec9-48c9-a478-24e570ddce34 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:04 devstack sudo[106624]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8c55fc80-5ba1-4cf6-a779-b90dca692945 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-93ded461-71d6-453a-99f3-c58f053e5532 1073741824" returned: 0 in 1.091s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:04 devstack sudo[106630]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8c55fc80-5ba1-4cf6-a779-b90dca692945 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-93ded461-71d6-453a-99f3-c58f053e5532 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-588c15da-24d4-4384-b84f-fae3139c696b tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-143286f3-3101-47fe-a8ee-f429c5f1ea4f" returned: 0 in 0.784s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:04 devstack sudo[106639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-5df7303f-aec9-48c9-a478-24e570ddce34
Jul 03 01:29:04 devstack sudo[106639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:04 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-588c15da-24d4-4384-b84f-fae3139c696b tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Lock "cinder-quobyte-143286f3-3101-47fe-a8ee-f429c5f1ea4f" released by "delete_volume" :: held 2.466s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:29:04 devstack sudo[106640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-93ded461-71d6-453a-99f3-c58f053e5532
Jul 03 01:29:04 devstack sudo[106640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:04 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-588c15da-24d4-4384-b84f-fae3139c696b tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Created reservations ['365bbc96-7e8c-4e9b-9d28-843061f9bf70', '25a716f6-823f-4b8e-9e27-c81baa7b6b2e', '4469f802-9f81-446c-8396-4a1308609f96', '00e70b58-ebe4-47fb-a612-2731c4c13e78'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:29:04 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8b0ec8b9-0c5a-4b88-b37e-a54d56b83ff4 tempest-VolumeImageDependencyTests-1221049938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.838s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:04 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-8b0ec8b9-0c5a-4b88-b37e-a54d56b83ff4 tempest-VolumeImageDependencyTests-1221049938 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:29:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-588c15da-24d4-4384-b84f-fae3139c696b tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:29:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-588c15da-24d4-4384-b84f-fae3139c696b tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:29:04 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-588c15da-24d4-4384-b84f-fae3139c696b tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:29:04 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-588c15da-24d4-4384-b84f-fae3139c696b tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:29:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-588c15da-24d4-4384-b84f-fae3139c696b tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:29:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-588c15da-24d4-4384-b84f-fae3139c696b tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:04 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-8b0ec8b9-0c5a-4b88-b37e-a54d56b83ff4 tempest-VolumeImageDependencyTests-1221049938 None] Deleted volume successfully.
Jul 03 01:29:04 devstack sudo[106644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:29:04 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:04 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8b0ec8b9-0c5a-4b88-b37e-a54d56b83ff4 tempest-VolumeImageDependencyTests-1221049938 None] Lock "cinder-8bf43a33-20d0-443b-b52b-4fa74bb25616-delete_volume" released by "delete_volume" :: held 3.634s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:29:05 devstack sudo[106640]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:05 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8c55fc80-5ba1-4cf6-a779-b90dca692945 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-93ded461-71d6-453a-99f3-c58f053e5532" returned: 0 in 0.928s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:05 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-8c55fc80-5ba1-4cf6-a779-b90dca692945 tempest-ProjectMemberTests-1866302072 None] <== create_volume: return (2110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:29:05 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-8c55fc80-5ba1-4cf6-a779-b90dca692945 tempest-ProjectMemberTests-1866302072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.116s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:29:05 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-8c55fc80-5ba1-4cf6-a779-b90dca692945 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa3bd074-5de1-490c-bcab-ea30022ecf6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93ded461-71d6-453a-99f3-c58f053e5532', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:05 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-8c55fc80-5ba1-4cf6-a779-b90dca692945 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fef5b53-8a54-42e1-897d-2aeabbb09d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:05 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-8c55fc80-5ba1-4cf6-a779-b90dca692945 tempest-ProjectMemberTests-1866302072 None] Volume volume-93ded461-71d6-453a-99f3-c58f053e5532 (93ded461-71d6-453a-99f3-c58f053e5532): created successfully
Jul 03 01:29:05 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-8c55fc80-5ba1-4cf6-a779-b90dca692945 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fef5b53-8a54-42e1-897d-2aeabbb09d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:05 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-8c55fc80-5ba1-4cf6-a779-b90dca692945 tempest-ProjectMemberTests-1866302072 None] Flow 'volume_create_manager' (37216961-164b-4a58-8f2b-9d60a08e6cc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:29:05 devstack sudo[106639]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:05 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-655c418b-4bb8-4b3d-b98c-21450864387b tempest-CreateVolumesFromSnapshotTest-405548807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-5df7303f-aec9-48c9-a478-24e570ddce34" returned: 0 in 1.121s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:05 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-655c418b-4bb8-4b3d-b98c-21450864387b tempest-CreateVolumesFromSnapshotTest-405548807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-5df7303f-aec9-48c9-a478-24e570ddce34 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:05 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-8c55fc80-5ba1-4cf6-a779-b90dca692945 tempest-ProjectMemberTests-1866302072 None] Created volume successfully.
Jul 03 01:29:05 devstack sudo[106652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-5df7303f-aec9-48c9-a478-24e570ddce34
Jul 03 01:29:05 devstack sudo[106652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:05 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:05 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-588c15da-24d4-4384-b84f-fae3139c696b tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.880s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:05 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-588c15da-24d4-4384-b84f-fae3139c696b tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:29:05 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-588c15da-24d4-4384-b84f-fae3139c696b tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Deleted volume successfully.
Jul 03 01:29:05 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-588c15da-24d4-4384-b84f-fae3139c696b tempest-VolumeAndVolumeTypeFromImageTest-2022021281 None] Lock "cinder-143286f3-3101-47fe-a8ee-f429c5f1ea4f-delete_volume" released by "delete_volume" :: held 3.661s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:29:06 devstack sudo[106652]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-655c418b-4bb8-4b3d-b98c-21450864387b tempest-CreateVolumesFromSnapshotTest-405548807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-5df7303f-aec9-48c9-a478-24e570ddce34" returned: 0 in 0.792s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:06 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-655c418b-4bb8-4b3d-b98c-21450864387b tempest-CreateVolumesFromSnapshotTest-405548807 None] Lock "cinder-quobyte-5df7303f-aec9-48c9-a478-24e570ddce34" released by "delete_volume" :: held 1.971s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:29:06 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-655c418b-4bb8-4b3d-b98c-21450864387b tempest-CreateVolumesFromSnapshotTest-405548807 None] Created reservations ['40f20a2b-00a9-438c-a24a-f8499be66be6', 'd5ff020d-8ecf-4446-904e-001e1c8feecf', '07e274b8-83e9-43c9-8f49-a44e2afc10c5', 'dbc225cc-aae2-4d64-9e42-3283be69081c'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:29:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-655c418b-4bb8-4b3d-b98c-21450864387b tempest-CreateVolumesFromSnapshotTest-405548807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:29:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-655c418b-4bb8-4b3d-b98c-21450864387b tempest-CreateVolumesFromSnapshotTest-405548807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:29:06 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-655c418b-4bb8-4b3d-b98c-21450864387b tempest-CreateVolumesFromSnapshotTest-405548807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:29:06 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-655c418b-4bb8-4b3d-b98c-21450864387b tempest-CreateVolumesFromSnapshotTest-405548807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:29:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-655c418b-4bb8-4b3d-b98c-21450864387b tempest-CreateVolumesFromSnapshotTest-405548807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:29:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-655c418b-4bb8-4b3d-b98c-21450864387b tempest-CreateVolumesFromSnapshotTest-405548807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:06 devstack sudo[106656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:29:06 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:06 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e4bc95e0-59d1-4f78-b998-bd101fe0a3ed tempest-CreateVolumesFromSnapshotTest-405548807 None] Acquiring lock "cinder-51f722e2-1253-4b59-ae08-1d27e93636c9-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:29:06 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e4bc95e0-59d1-4f78-b998-bd101fe0a3ed tempest-CreateVolumesFromSnapshotTest-405548807 None] Lock "cinder-51f722e2-1253-4b59-ae08-1d27e93636c9-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:29:06 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e4bc95e0-59d1-4f78-b998-bd101fe0a3ed tempest-CreateVolumesFromSnapshotTest-405548807 None] Acquiring lock "cinder-quobyte-51f722e2-1253-4b59-ae08-1d27e93636c9" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:29:06 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e4bc95e0-59d1-4f78-b998-bd101fe0a3ed tempest-CreateVolumesFromSnapshotTest-405548807 None] Lock "cinder-quobyte-51f722e2-1253-4b59-ae08-1d27e93636c9" acquired by "delete_volume" :: waited 0.027s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:29:06 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[097ddabd-134d-4368-bc67-aaf500798bea]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:29:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e4bc95e0-59d1-4f78-b998-bd101fe0a3ed tempest-CreateVolumesFromSnapshotTest-405548807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-51f722e2-1253-4b59-ae08-1d27e93636c9 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a1b576b6-0291-4348-ad7e-43286b0a1652 tempest-ProjectMemberTests-1866302072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:29:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a1b576b6-0291-4348-ad7e-43286b0a1652 tempest-ProjectMemberTests-1866302072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:29:06 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-a1b576b6-0291-4348-ad7e-43286b0a1652 tempest-ProjectMemberTests-1866302072 None] Creating offline snapshot f0da0a76-1e0d-41a0-ab11-8e1d439973ea of volume 93ded461-71d6-453a-99f3-c58f053e5532 {{(pid=86891) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 01:29:06 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e1764c-0303-41c5-86db-4ed65132cd17]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:29:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a1b576b6-0291-4348-ad7e-43286b0a1652 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-93ded461-71d6-453a-99f3-c58f053e5532 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:06 devstack sudo[106658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-51f722e2-1253-4b59-ae08-1d27e93636c9
Jul 03 01:29:06 devstack sudo[106658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:06 devstack sudo[106659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-93ded461-71d6-453a-99f3-c58f053e5532
Jul 03 01:29:06 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:07 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:07 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-655c418b-4bb8-4b3d-b98c-21450864387b tempest-CreateVolumesFromSnapshotTest-405548807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 1.061s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:07 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-655c418b-4bb8-4b3d-b98c-21450864387b tempest-CreateVolumesFromSnapshotTest-405548807 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:29:07 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-655c418b-4bb8-4b3d-b98c-21450864387b tempest-CreateVolumesFromSnapshotTest-405548807 None] Deleted volume successfully.
Jul 03 01:29:07 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-655c418b-4bb8-4b3d-b98c-21450864387b tempest-CreateVolumesFromSnapshotTest-405548807 None] Lock "cinder-5df7303f-aec9-48c9-a478-24e570ddce34-delete_volume" released by "delete_volume" :: held 3.395s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:29:07 devstack sudo[106658]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:07 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e4bc95e0-59d1-4f78-b998-bd101fe0a3ed tempest-CreateVolumesFromSnapshotTest-405548807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-51f722e2-1253-4b59-ae08-1d27e93636c9" returned: 0 in 1.056s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:07 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e4bc95e0-59d1-4f78-b998-bd101fe0a3ed tempest-CreateVolumesFromSnapshotTest-405548807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-51f722e2-1253-4b59-ae08-1d27e93636c9 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:07 devstack sudo[106668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-51f722e2-1253-4b59-ae08-1d27e93636c9
Jul 03 01:29:07 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:07 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a1b576b6-0291-4348-ad7e-43286b0a1652 tempest-ProjectMemberTests-1866302072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-93ded461-71d6-453a-99f3-c58f053e5532" returned: 0 in 1.165s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:07 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:07 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a1b576b6-0291-4348-ad7e-43286b0a1652 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-93ded461-71d6-453a-99f3-c58f053e5532,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-93ded461-71d6-453a-99f3-c58f053e5532.f0da0a76-1e0d-41a0-ab11-8e1d439973ea 1G {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:07 devstack sudo[106671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-93ded461-71d6-453a-99f3-c58f053e5532,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-93ded461-71d6-453a-99f3-c58f053e5532.f0da0a76-1e0d-41a0-ab11-8e1d439973ea 1G
Jul 03 01:29:07 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:08 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:08 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e4bc95e0-59d1-4f78-b998-bd101fe0a3ed tempest-CreateVolumesFromSnapshotTest-405548807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-51f722e2-1253-4b59-ae08-1d27e93636c9" returned: 0 in 0.820s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:08 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e4bc95e0-59d1-4f78-b998-bd101fe0a3ed tempest-CreateVolumesFromSnapshotTest-405548807 None] Lock "cinder-quobyte-51f722e2-1253-4b59-ae08-1d27e93636c9" released by "delete_volume" :: held 1.962s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:29:08 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-e4bc95e0-59d1-4f78-b998-bd101fe0a3ed tempest-CreateVolumesFromSnapshotTest-405548807 None] Created reservations ['7a9d17aa-a7d6-43b5-9f26-cdc0ce8b971d', '4b0b755d-e200-4b11-ba2f-f029d7277913', '4d6c04a8-10f0-417f-ba60-e8a7a341f558', 'a016f270-95a2-49cf-bbff-6cbeaf894f4a'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:29:08 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e4bc95e0-59d1-4f78-b998-bd101fe0a3ed tempest-CreateVolumesFromSnapshotTest-405548807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:29:08 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e4bc95e0-59d1-4f78-b998-bd101fe0a3ed tempest-CreateVolumesFromSnapshotTest-405548807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:29:08 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-e4bc95e0-59d1-4f78-b998-bd101fe0a3ed tempest-CreateVolumesFromSnapshotTest-405548807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:29:08 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-e4bc95e0-59d1-4f78-b998-bd101fe0a3ed tempest-CreateVolumesFromSnapshotTest-405548807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:29:08 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e4bc95e0-59d1-4f78-b998-bd101fe0a3ed tempest-CreateVolumesFromSnapshotTest-405548807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:29:08 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e4bc95e0-59d1-4f78-b998-bd101fe0a3ed tempest-CreateVolumesFromSnapshotTest-405548807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:08 devstack sudo[106677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:29:08 devstack sudo[106677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:08 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d31489f9-31d4-415d-8bdf-eb3d7e9f1544 tempest-CreateVolumesFromSnapshotTest-405548807 None] Acquiring lock "cinder-c380941a-ec4b-48d5-98a9-b76d42c2643b-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:29:08 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d31489f9-31d4-415d-8bdf-eb3d7e9f1544 tempest-CreateVolumesFromSnapshotTest-405548807 None] Lock "cinder-c380941a-ec4b-48d5-98a9-b76d42c2643b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:29:08 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d31489f9-31d4-415d-8bdf-eb3d7e9f1544 tempest-CreateVolumesFromSnapshotTest-405548807 None] Acquiring lock "cinder-quobyte-c380941a-ec4b-48d5-98a9-b76d42c2643b" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:29:08 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d31489f9-31d4-415d-8bdf-eb3d7e9f1544 tempest-CreateVolumesFromSnapshotTest-405548807 None] Lock "cinder-quobyte-c380941a-ec4b-48d5-98a9-b76d42c2643b" acquired by "delete_volume" :: waited 0.037s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:29:08 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0b0cb4-0066-4890-9d5b-ef82de92bd23]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:29:08 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d31489f9-31d4-415d-8bdf-eb3d7e9f1544 tempest-CreateVolumesFromSnapshotTest-405548807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c380941a-ec4b-48d5-98a9-b76d42c2643b {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:08 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d4da447-cc87-47a6-9924-5186b058382f tempest-CinderUnicodeTest-944587269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:29:08 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:08 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-6d4da447-cc87-47a6-9924-5186b058382f tempest-CinderUnicodeTest-944587269 None] Flow 'volume_create_manager' (eb0db8de-6427-4696-8296-dac57cced974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:29:08 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-6d4da447-cc87-47a6-9924-5186b058382f tempest-CinderUnicodeTest-944587269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a6993f9-cbde-4566-bbd8-8b4618bcdf0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:08 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a1b576b6-0291-4348-ad7e-43286b0a1652 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-93ded461-71d6-453a-99f3-c58f053e5532,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-93ded461-71d6-453a-99f3-c58f053e5532.f0da0a76-1e0d-41a0-ab11-8e1d439973ea 1G" returned: 0 in 1.168s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:08 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a1b576b6-0291-4348-ad7e-43286b0a1652 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93ded461-71d6-453a-99f3-c58f053e5532 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-93ded461-71d6-453a-99f3-c58f053e5532.f0da0a76-1e0d-41a0-ab11-8e1d439973ea {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:08 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-6d4da447-cc87-47a6-9924-5186b058382f tempest-CinderUnicodeTest-944587269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a6993f9-cbde-4566-bbd8-8b4618bcdf0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:29:08Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bf18f36-2368-44de-a105-fdce6a2aed3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6acd06fd7fc942c0886251af963f5aad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:29:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:29:09Z,use_quota=True,user_id='4e593a77b8584ecaadff5fc4c6b6e8b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:08 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-6d4da447-cc87-47a6-9924-5186b058382f tempest-CinderUnicodeTest-944587269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02575619-0e17-4e4d-bca4-7bf580bd77c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:08 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-6d4da447-cc87-47a6-9924-5186b058382f tempest-CinderUnicodeTest-944587269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02575619-0e17-4e4d-bca4-7bf580bd77c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:08 devstack sudo[106682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93ded461-71d6-453a-99f3-c58f053e5532 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-93ded461-71d6-453a-99f3-c58f053e5532.f0da0a76-1e0d-41a0-ab11-8e1d439973ea
Jul 03 01:29:08 devstack sudo[106682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:08 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-6d4da447-cc87-47a6-9924-5186b058382f tempest-CinderUnicodeTest-944587269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11a09626-6dfa-45aa-bad8-d9613d88f490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:09 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-6d4da447-cc87-47a6-9924-5186b058382f tempest-CinderUnicodeTest-944587269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11a09626-6dfa-45aa-bad8-d9613d88f490) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bf18f36-2368-44de-a105-fdce6a2aed3d', 'volume_name': 'volume-3bf18f36-2368-44de-a105-fdce6a2aed3d', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:09 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-6d4da447-cc87-47a6-9924-5186b058382f tempest-CinderUnicodeTest-944587269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (408e02ba-f0ab-4091-b76b-acca098cb3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:09 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-6d4da447-cc87-47a6-9924-5186b058382f tempest-CinderUnicodeTest-944587269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (408e02ba-f0ab-4091-b76b-acca098cb3db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:09 devstack sudo[106681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c380941a-ec4b-48d5-98a9-b76d42c2643b
Jul 03 01:29:09 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:09 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-6d4da447-cc87-47a6-9924-5186b058382f tempest-CinderUnicodeTest-944587269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e63826f-1628-4238-b7a4-a5ef9c30cc69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:09 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-6d4da447-cc87-47a6-9924-5186b058382f tempest-CinderUnicodeTest-944587269 None] Volume 3bf18f36-2368-44de-a105-fdce6a2aed3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bf18f36-2368-44de-a105-fdce6a2aed3d', 'volume_size': 1}
Jul 03 01:29:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-6d4da447-cc87-47a6-9924-5186b058382f tempest-CinderUnicodeTest-944587269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:29:09 devstack sudo[106677]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e4bc95e0-59d1-4f78-b998-bd101fe0a3ed tempest-CreateVolumesFromSnapshotTest-405548807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.915s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:09 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-e4bc95e0-59d1-4f78-b998-bd101fe0a3ed tempest-CreateVolumesFromSnapshotTest-405548807 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:29:09 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-e4bc95e0-59d1-4f78-b998-bd101fe0a3ed tempest-CreateVolumesFromSnapshotTest-405548807 None] Deleted volume successfully.
Jul 03 01:29:09 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e4bc95e0-59d1-4f78-b998-bd101fe0a3ed tempest-CreateVolumesFromSnapshotTest-405548807 None] Lock "cinder-51f722e2-1253-4b59-ae08-1d27e93636c9-delete_volume" released by "delete_volume" :: held 3.213s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:29:09 devstack sudo[106682]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a1b576b6-0291-4348-ad7e-43286b0a1652 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93ded461-71d6-453a-99f3-c58f053e5532 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-93ded461-71d6-453a-99f3-c58f053e5532.f0da0a76-1e0d-41a0-ab11-8e1d439973ea" returned: 0 in 0.825s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:09 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-a1b576b6-0291-4348-ad7e-43286b0a1652 tempest-ProjectMemberTests-1866302072 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-93ded461-71d6-453a-99f3-c58f053e5532.f0da0a76-1e0d-41a0-ab11-8e1d439973ea is being set with open permissions: ugo+rw
Jul 03 01:29:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a1b576b6-0291-4348-ad7e-43286b0a1652 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-93ded461-71d6-453a-99f3-c58f053e5532.f0da0a76-1e0d-41a0-ab11-8e1d439973ea {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:09 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d31489f9-31d4-415d-8bdf-eb3d7e9f1544 tempest-CreateVolumesFromSnapshotTest-405548807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c380941a-ec4b-48d5-98a9-b76d42c2643b" returned: 0 in 0.902s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d31489f9-31d4-415d-8bdf-eb3d7e9f1544 tempest-CreateVolumesFromSnapshotTest-405548807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c380941a-ec4b-48d5-98a9-b76d42c2643b {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:09 devstack sudo[106692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-93ded461-71d6-453a-99f3-c58f053e5532.f0da0a76-1e0d-41a0-ab11-8e1d439973ea
Jul 03 01:29:09 devstack sudo[106692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:09 devstack sudo[106693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c380941a-ec4b-48d5-98a9-b76d42c2643b
Jul 03 01:29:09 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:10 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:10 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d31489f9-31d4-415d-8bdf-eb3d7e9f1544 tempest-CreateVolumesFromSnapshotTest-405548807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-c380941a-ec4b-48d5-98a9-b76d42c2643b" returned: 0 in 0.671s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:10 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d31489f9-31d4-415d-8bdf-eb3d7e9f1544 tempest-CreateVolumesFromSnapshotTest-405548807 None] Lock "cinder-quobyte-c380941a-ec4b-48d5-98a9-b76d42c2643b" released by "delete_volume" :: held 1.646s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:29:10 devstack sudo[106692]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:10 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a1b576b6-0291-4348-ad7e-43286b0a1652 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-93ded461-71d6-453a-99f3-c58f053e5532.f0da0a76-1e0d-41a0-ab11-8e1d439973ea" returned: 0 in 0.726s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:10 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a1b576b6-0291-4348-ad7e-43286b0a1652 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-93ded461-71d6-453a-99f3-c58f053e5532.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:10 devstack sudo[106699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-93ded461-71d6-453a-99f3-c58f053e5532.info
Jul 03 01:29:10 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:10 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-d31489f9-31d4-415d-8bdf-eb3d7e9f1544 tempest-CreateVolumesFromSnapshotTest-405548807 None] Created reservations ['1ccad3e3-aa54-43e6-93b4-052e752f38d3', '05fd1c6f-6fcf-4940-8719-ee5c9781f980', 'aecb6f95-9385-49bc-98b2-3ed77abb1f4b', 'a05f0be6-37ff-4b96-8c3a-70e4ee65e0a4'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:29:10 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-d31489f9-31d4-415d-8bdf-eb3d7e9f1544 tempest-CreateVolumesFromSnapshotTest-405548807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:29:10 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-d31489f9-31d4-415d-8bdf-eb3d7e9f1544 tempest-CreateVolumesFromSnapshotTest-405548807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:29:10 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-d31489f9-31d4-415d-8bdf-eb3d7e9f1544 tempest-CreateVolumesFromSnapshotTest-405548807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:29:10 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-d31489f9-31d4-415d-8bdf-eb3d7e9f1544 tempest-CreateVolumesFromSnapshotTest-405548807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:29:10 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-d31489f9-31d4-415d-8bdf-eb3d7e9f1544 tempest-CreateVolumesFromSnapshotTest-405548807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:29:10 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d31489f9-31d4-415d-8bdf-eb3d7e9f1544 tempest-CreateVolumesFromSnapshotTest-405548807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:10 devstack sudo[106701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:29:10 devstack sudo[106701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:11 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e7028655-47e2-42f8-bd48-372f63229d3a tempest-CreateVolumesFromSnapshotTest-405548807 None] Acquiring lock "cinder-54ae1e57-27ed-46ca-ae69-356605f0e341-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:29:11 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e7028655-47e2-42f8-bd48-372f63229d3a tempest-CreateVolumesFromSnapshotTest-405548807 None] Lock "cinder-54ae1e57-27ed-46ca-ae69-356605f0e341-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:29:11 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e7028655-47e2-42f8-bd48-372f63229d3a tempest-CreateVolumesFromSnapshotTest-405548807 None] Acquiring lock "cinder-quobyte-54ae1e57-27ed-46ca-ae69-356605f0e341" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:29:11 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e7028655-47e2-42f8-bd48-372f63229d3a tempest-CreateVolumesFromSnapshotTest-405548807 None] Lock "cinder-quobyte-54ae1e57-27ed-46ca-ae69-356605f0e341" acquired by "delete_volume" :: waited 0.023s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:29:11 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c698930-7f6d-4751-a0a0-576e2ea3fda1]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:29:11 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e7028655-47e2-42f8-bd48-372f63229d3a tempest-CreateVolumesFromSnapshotTest-405548807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-54ae1e57-27ed-46ca-ae69-356605f0e341 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:11 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:11 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a1b576b6-0291-4348-ad7e-43286b0a1652 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-93ded461-71d6-453a-99f3-c58f053e5532.info" returned: 0 in 0.753s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:11 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-a1b576b6-0291-4348-ad7e-43286b0a1652 tempest-ProjectMemberTests-1866302072 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-93ded461-71d6-453a-99f3-c58f053e5532.info is being set with open permissions: ugo+rw
Jul 03 01:29:11 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a1b576b6-0291-4348-ad7e-43286b0a1652 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-93ded461-71d6-453a-99f3-c58f053e5532.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:11 devstack sudo[106705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-93ded461-71d6-453a-99f3-c58f053e5532.info
Jul 03 01:29:11 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:11 devstack sudo[106704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-54ae1e57-27ed-46ca-ae69-356605f0e341
Jul 03 01:29:11 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:11 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1244c65-8301-4202-a61b-cb1bf8c84025 tempest-CreateVolumesFromImageTest-1460914073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:29:11 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f1244c65-8301-4202-a61b-cb1bf8c84025 tempest-CreateVolumesFromImageTest-1460914073 None] Flow 'volume_create_manager' (0ba11698-b321-4cf1-ae06-e0d95854de74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:29:11 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f1244c65-8301-4202-a61b-cb1bf8c84025 tempest-CreateVolumesFromImageTest-1460914073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2480d686-1e3b-4bff-aa8e-d539c96282f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:11 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f1244c65-8301-4202-a61b-cb1bf8c84025 tempest-CreateVolumesFromImageTest-1460914073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2480d686-1e3b-4bff-aa8e-d539c96282f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:29:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1963109853',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d39a9240-821b-4f22-b7e6-600b1aeac104,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1598479cd5b64fa38b4bf40f1fd0703d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:29:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:29:11Z,use_quota=True,user_id='4616577780d94c31aeddf8f5ecdc6ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:11 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f1244c65-8301-4202-a61b-cb1bf8c84025 tempest-CreateVolumesFromImageTest-1460914073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a251820-92d2-44c0-812d-8695b600f3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:11 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f1244c65-8301-4202-a61b-cb1bf8c84025 tempest-CreateVolumesFromImageTest-1460914073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a251820-92d2-44c0-812d-8695b600f3df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:11 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f1244c65-8301-4202-a61b-cb1bf8c84025 tempest-CreateVolumesFromImageTest-1460914073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e4418f1-9fe9-4d6e-b3d2-9e9798da4f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:11 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f1244c65-8301-4202-a61b-cb1bf8c84025 tempest-CreateVolumesFromImageTest-1460914073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e4418f1-9fe9-4d6e-b3d2-9e9798da4f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd39a9240-821b-4f22-b7e6-600b1aeac104', 'volume_name': 'volume-d39a9240-821b-4f22-b7e6-600b1aeac104', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:11 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f1244c65-8301-4202-a61b-cb1bf8c84025 tempest-CreateVolumesFromImageTest-1460914073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59b59eae-62c6-4997-899c-54e5fbb0ffad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:11 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f1244c65-8301-4202-a61b-cb1bf8c84025 tempest-CreateVolumesFromImageTest-1460914073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59b59eae-62c6-4997-899c-54e5fbb0ffad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:11 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f1244c65-8301-4202-a61b-cb1bf8c84025 tempest-CreateVolumesFromImageTest-1460914073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59f92642-f00f-4c19-b8bb-774bd7db9074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:11 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-f1244c65-8301-4202-a61b-cb1bf8c84025 tempest-CreateVolumesFromImageTest-1460914073 None] Volume d39a9240-821b-4f22-b7e6-600b1aeac104: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d39a9240-821b-4f22-b7e6-600b1aeac104', 'volume_size': 1}
Jul 03 01:29:11 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f1244c65-8301-4202-a61b-cb1bf8c84025 tempest-CreateVolumesFromImageTest-1460914073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:29:11 devstack sudo[106701]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:11 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d31489f9-31d4-415d-8bdf-eb3d7e9f1544 tempest-CreateVolumesFromSnapshotTest-405548807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.936s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:11 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-d31489f9-31d4-415d-8bdf-eb3d7e9f1544 tempest-CreateVolumesFromSnapshotTest-405548807 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:29:11 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-d31489f9-31d4-415d-8bdf-eb3d7e9f1544 tempest-CreateVolumesFromSnapshotTest-405548807 None] Deleted volume successfully.
Jul 03 01:29:11 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d31489f9-31d4-415d-8bdf-eb3d7e9f1544 tempest-CreateVolumesFromSnapshotTest-405548807 None] Lock "cinder-c380941a-ec4b-48d5-98a9-b76d42c2643b-delete_volume" released by "delete_volume" :: held 2.908s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:29:11 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d35037d-07b6-40af-87f1-3aedb2aeccfd tempest-CreateVolumesFromImageTest-1460914073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:29:11 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1d35037d-07b6-40af-87f1-3aedb2aeccfd tempest-CreateVolumesFromImageTest-1460914073 None] Flow 'volume_create_manager' (25935104-dea3-4dc0-9a0a-2a9ab696556a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:29:11 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1d35037d-07b6-40af-87f1-3aedb2aeccfd tempest-CreateVolumesFromImageTest-1460914073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (163893c4-2c0b-4ee6-b4bc-fa86177635a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:11 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1d35037d-07b6-40af-87f1-3aedb2aeccfd tempest-CreateVolumesFromImageTest-1460914073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (163893c4-2c0b-4ee6-b4bc-fa86177635a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:29:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1910280173',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba9f672d-3115-4a5b-a736-65a9cd19b007,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1598479cd5b64fa38b4bf40f1fd0703d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:29:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:29:12Z,use_quota=True,user_id='4616577780d94c31aeddf8f5ecdc6ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:11 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1d35037d-07b6-40af-87f1-3aedb2aeccfd tempest-CreateVolumesFromImageTest-1460914073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f62a1c6-f01b-49ad-957e-99a88c700543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:11 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1d35037d-07b6-40af-87f1-3aedb2aeccfd tempest-CreateVolumesFromImageTest-1460914073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f62a1c6-f01b-49ad-957e-99a88c700543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:12 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1d35037d-07b6-40af-87f1-3aedb2aeccfd tempest-CreateVolumesFromImageTest-1460914073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f78dc655-77f1-46af-881d-00c1991a971d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:12 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1d35037d-07b6-40af-87f1-3aedb2aeccfd tempest-CreateVolumesFromImageTest-1460914073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f78dc655-77f1-46af-881d-00c1991a971d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba9f672d-3115-4a5b-a736-65a9cd19b007', 'volume_name': 'volume-ba9f672d-3115-4a5b-a736-65a9cd19b007', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:12 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1d35037d-07b6-40af-87f1-3aedb2aeccfd tempest-CreateVolumesFromImageTest-1460914073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4d5bb40-3427-4808-b4be-2b9005885bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:12 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1d35037d-07b6-40af-87f1-3aedb2aeccfd tempest-CreateVolumesFromImageTest-1460914073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4d5bb40-3427-4808-b4be-2b9005885bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:12 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1d35037d-07b6-40af-87f1-3aedb2aeccfd tempest-CreateVolumesFromImageTest-1460914073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bcb64c2-0ff7-4b9c-8931-5e2cf5fc938b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:12 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-1d35037d-07b6-40af-87f1-3aedb2aeccfd tempest-CreateVolumesFromImageTest-1460914073 None] Volume ba9f672d-3115-4a5b-a736-65a9cd19b007: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba9f672d-3115-4a5b-a736-65a9cd19b007', 'volume_size': 1}
Jul 03 01:29:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1d35037d-07b6-40af-87f1-3aedb2aeccfd tempest-CreateVolumesFromImageTest-1460914073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:29:12 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e7028655-47e2-42f8-bd48-372f63229d3a tempest-CreateVolumesFromSnapshotTest-405548807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-54ae1e57-27ed-46ca-ae69-356605f0e341" returned: 0 in 0.938s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e7028655-47e2-42f8-bd48-372f63229d3a tempest-CreateVolumesFromSnapshotTest-405548807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-54ae1e57-27ed-46ca-ae69-356605f0e341 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:12 devstack sudo[106714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-54ae1e57-27ed-46ca-ae69-356605f0e341
Jul 03 01:29:12 devstack sudo[106714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:12 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a1b576b6-0291-4348-ad7e-43286b0a1652 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-93ded461-71d6-453a-99f3-c58f053e5532.info" returned: 0 in 1.007s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a1b576b6-0291-4348-ad7e-43286b0a1652 tempest-ProjectMemberTests-1866302072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.769s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:29:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-6d4da447-cc87-47a6-9924-5186b058382f tempest-CinderUnicodeTest-944587269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.293s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:29:12 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-6d4da447-cc87-47a6-9924-5186b058382f tempest-CinderUnicodeTest-944587269 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:29:08Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bf18f36-2368-44de-a105-fdce6a2aed3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6acd06fd7fc942c0886251af963f5aad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:29:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:29:09Z,use_quota=True,user_id='4e593a77b8584ecaadff5fc4c6b6e8b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:29:12 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-6d4da447-cc87-47a6-9924-5186b058382f tempest-CinderUnicodeTest-944587269 None] Creating volume 3bf18f36-2368-44de-a105-fdce6a2aed3d {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:29:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-6d4da447-cc87-47a6-9924-5186b058382f tempest-CinderUnicodeTest-944587269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:29:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-6d4da447-cc87-47a6-9924-5186b058382f tempest-CinderUnicodeTest-944587269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:29:12 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-6d4da447-cc87-47a6-9924-5186b058382f tempest-CinderUnicodeTest-944587269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:29:12 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-6d4da447-cc87-47a6-9924-5186b058382f tempest-CinderUnicodeTest-944587269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:29:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-6d4da447-cc87-47a6-9924-5186b058382f tempest-CinderUnicodeTest-944587269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:29:12 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-6d4da447-cc87-47a6-9924-5186b058382f tempest-CinderUnicodeTest-944587269 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:29:12 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-6d4da447-cc87-47a6-9924-5186b058382f tempest-CinderUnicodeTest-944587269 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:29:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6d4da447-cc87-47a6-9924-5186b058382f tempest-CinderUnicodeTest-944587269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3bf18f36-2368-44de-a105-fdce6a2aed3d 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:12 devstack sudo[106716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3bf18f36-2368-44de-a105-fdce6a2aed3d 1073741824
Jul 03 01:29:12 devstack sudo[106716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:12 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-a1b576b6-0291-4348-ad7e-43286b0a1652 tempest-ProjectMemberTests-1866302072 None] Create snapshot completed successfully
Jul 03 01:29:12 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-199de340-64eb-40ae-a07b-ecbe1b372751 tempest-CreateVolumesFromImageTest-1460914073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:29:12 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-199de340-64eb-40ae-a07b-ecbe1b372751 tempest-CreateVolumesFromImageTest-1460914073 None] Flow 'volume_create_manager' (4f88a324-7b86-46cc-912e-9ffb160c5751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:29:12 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-199de340-64eb-40ae-a07b-ecbe1b372751 tempest-CreateVolumesFromImageTest-1460914073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88a2b39f-6c9f-4165-8ac2-288e34e0638a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:12 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-199de340-64eb-40ae-a07b-ecbe1b372751 tempest-CreateVolumesFromImageTest-1460914073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88a2b39f-6c9f-4165-8ac2-288e34e0638a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:29:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-624970156',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0471779b-dd0b-4589-9550-26b7134d0b97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1598479cd5b64fa38b4bf40f1fd0703d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:29:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:29:12Z,use_quota=True,user_id='4616577780d94c31aeddf8f5ecdc6ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:12 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-199de340-64eb-40ae-a07b-ecbe1b372751 tempest-CreateVolumesFromImageTest-1460914073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aeb25ec7-fa0c-411c-823e-0d7f8c943d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:12 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-199de340-64eb-40ae-a07b-ecbe1b372751 tempest-CreateVolumesFromImageTest-1460914073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aeb25ec7-fa0c-411c-823e-0d7f8c943d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:12 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-199de340-64eb-40ae-a07b-ecbe1b372751 tempest-CreateVolumesFromImageTest-1460914073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6adcb060-68b3-4229-bfab-f047535b1753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:12 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-199de340-64eb-40ae-a07b-ecbe1b372751 tempest-CreateVolumesFromImageTest-1460914073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6adcb060-68b3-4229-bfab-f047535b1753) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0471779b-dd0b-4589-9550-26b7134d0b97', 'volume_name': 'volume-0471779b-dd0b-4589-9550-26b7134d0b97', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:12 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-199de340-64eb-40ae-a07b-ecbe1b372751 tempest-CreateVolumesFromImageTest-1460914073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (648e90a8-5e9f-40eb-aa85-1cf33d530150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:12 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-199de340-64eb-40ae-a07b-ecbe1b372751 tempest-CreateVolumesFromImageTest-1460914073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (648e90a8-5e9f-40eb-aa85-1cf33d530150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:12 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-199de340-64eb-40ae-a07b-ecbe1b372751 tempest-CreateVolumesFromImageTest-1460914073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (606cb517-5ac8-4d23-9eda-7b29223e5ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:12 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-199de340-64eb-40ae-a07b-ecbe1b372751 tempest-CreateVolumesFromImageTest-1460914073 None] Volume 0471779b-dd0b-4589-9550-26b7134d0b97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0471779b-dd0b-4589-9550-26b7134d0b97', 'volume_size': 1}
Jul 03 01:29:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-199de340-64eb-40ae-a07b-ecbe1b372751 tempest-CreateVolumesFromImageTest-1460914073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:29:12 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cd47b64-890f-40a1-84d6-f844a1767392 tempest-CreateVolumesFromImageTest-1460914073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:29:12 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-6cd47b64-890f-40a1-84d6-f844a1767392 tempest-CreateVolumesFromImageTest-1460914073 None] Flow 'volume_create_manager' (dff131e9-3f3a-498d-b0ed-0cfc9cf421a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:29:12 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-6cd47b64-890f-40a1-84d6-f844a1767392 tempest-CreateVolumesFromImageTest-1460914073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f8fb0bf-0d1c-4087-abf7-f37557700fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:12 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-6cd47b64-890f-40a1-84d6-f844a1767392 tempest-CreateVolumesFromImageTest-1460914073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f8fb0bf-0d1c-4087-abf7-f37557700fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:29:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-282093697',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb8c509a-fa8d-4f58-b7a5-92fda1fbb589,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1598479cd5b64fa38b4bf40f1fd0703d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:29:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:29:13Z,use_quota=True,user_id='4616577780d94c31aeddf8f5ecdc6ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:12 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-6cd47b64-890f-40a1-84d6-f844a1767392 tempest-CreateVolumesFromImageTest-1460914073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be01a7b4-8090-432c-b876-417b277e363f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:12 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-6cd47b64-890f-40a1-84d6-f844a1767392 tempest-CreateVolumesFromImageTest-1460914073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be01a7b4-8090-432c-b876-417b277e363f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:12 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-6cd47b64-890f-40a1-84d6-f844a1767392 tempest-CreateVolumesFromImageTest-1460914073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c2d36d4-6223-4cdb-ae41-b9e538ddd282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:12 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-6cd47b64-890f-40a1-84d6-f844a1767392 tempest-CreateVolumesFromImageTest-1460914073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c2d36d4-6223-4cdb-ae41-b9e538ddd282) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb8c509a-fa8d-4f58-b7a5-92fda1fbb589', 'volume_name': 'volume-cb8c509a-fa8d-4f58-b7a5-92fda1fbb589', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:12 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-6cd47b64-890f-40a1-84d6-f844a1767392 tempest-CreateVolumesFromImageTest-1460914073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcbfb805-2bdc-4ce6-9d55-616b87d8481e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:12 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-6cd47b64-890f-40a1-84d6-f844a1767392 tempest-CreateVolumesFromImageTest-1460914073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcbfb805-2bdc-4ce6-9d55-616b87d8481e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:12 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-6cd47b64-890f-40a1-84d6-f844a1767392 tempest-CreateVolumesFromImageTest-1460914073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cc3914f-6574-47d8-a106-b1cf6d247b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:12 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-6cd47b64-890f-40a1-84d6-f844a1767392 tempest-CreateVolumesFromImageTest-1460914073 None] Volume cb8c509a-fa8d-4f58-b7a5-92fda1fbb589: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb8c509a-fa8d-4f58-b7a5-92fda1fbb589', 'volume_size': 1}
Jul 03 01:29:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-6cd47b64-890f-40a1-84d6-f844a1767392 tempest-CreateVolumesFromImageTest-1460914073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:29:12 devstack sudo[106714]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e7028655-47e2-42f8-bd48-372f63229d3a tempest-CreateVolumesFromSnapshotTest-405548807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-54ae1e57-27ed-46ca-ae69-356605f0e341" returned: 0 in 0.836s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:13 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e7028655-47e2-42f8-bd48-372f63229d3a tempest-CreateVolumesFromSnapshotTest-405548807 None] Lock "cinder-quobyte-54ae1e57-27ed-46ca-ae69-356605f0e341" released by "delete_volume" :: held 1.839s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:29:13 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5f33e764-6da4-4b44-86e8-7cfc646298f4 tempest-ProjectMemberTests-1866302072 None] Acquiring lock "cinder-f0da0a76-1e0d-41a0-ab11-8e1d439973ea-delete_snapshot" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:29:13 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5f33e764-6da4-4b44-86e8-7cfc646298f4 tempest-ProjectMemberTests-1866302072 None] Lock "cinder-f0da0a76-1e0d-41a0-ab11-8e1d439973ea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:29:13 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5f33e764-6da4-4b44-86e8-7cfc646298f4 tempest-ProjectMemberTests-1866302072 None] Acquiring lock "cinder-quobyte-93ded461-71d6-453a-99f3-c58f053e5532" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:29:13 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-e7028655-47e2-42f8-bd48-372f63229d3a tempest-CreateVolumesFromSnapshotTest-405548807 None] Created reservations ['40f6f1eb-301b-4377-bb3e-9f3ed3666764', '24aaa252-280b-40b6-8a8a-457fd8471729', '57daec01-cae1-478a-ba7a-476b756a0f9e', '798f0ad5-e71a-49a1-852b-6c1114d71e35'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:29:13 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5f33e764-6da4-4b44-86e8-7cfc646298f4 tempest-ProjectMemberTests-1866302072 None] Lock "cinder-quobyte-93ded461-71d6-453a-99f3-c58f053e5532" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:29:13 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5f33e764-6da4-4b44-86e8-7cfc646298f4 tempest-ProjectMemberTests-1866302072 None] Acquiring lock "cinder-quobyte-f0da0a76-1e0d-41a0-ab11-8e1d439973ea" by "_delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:29:13 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5f33e764-6da4-4b44-86e8-7cfc646298f4 tempest-ProjectMemberTests-1866302072 None] Lock "cinder-quobyte-f0da0a76-1e0d-41a0-ab11-8e1d439973ea" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:29:13 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-5f33e764-6da4-4b44-86e8-7cfc646298f4 tempest-ProjectMemberTests-1866302072 None] Deleting offline snapshot f0da0a76-1e0d-41a0-ab11-8e1d439973ea of volume 93ded461-71d6-453a-99f3-c58f053e5532 {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 01:29:13 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-5f33e764-6da4-4b44-86e8-7cfc646298f4 tempest-ProjectMemberTests-1866302072 None] snapshot_file for this snap is: volume-93ded461-71d6-453a-99f3-c58f053e5532.f0da0a76-1e0d-41a0-ab11-8e1d439973ea {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 01:29:13 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c23233-ea60-486d-9b07-d473d0bb5cff]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:29:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5f33e764-6da4-4b44-86e8-7cfc646298f4 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-93ded461-71d6-453a-99f3-c58f053e5532.f0da0a76-1e0d-41a0-ab11-8e1d439973ea {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e7028655-47e2-42f8-bd48-372f63229d3a tempest-CreateVolumesFromSnapshotTest-405548807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:29:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e7028655-47e2-42f8-bd48-372f63229d3a tempest-CreateVolumesFromSnapshotTest-405548807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:29:13 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-e7028655-47e2-42f8-bd48-372f63229d3a tempest-CreateVolumesFromSnapshotTest-405548807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:29:13 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-e7028655-47e2-42f8-bd48-372f63229d3a tempest-CreateVolumesFromSnapshotTest-405548807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:29:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e7028655-47e2-42f8-bd48-372f63229d3a tempest-CreateVolumesFromSnapshotTest-405548807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:29:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e7028655-47e2-42f8-bd48-372f63229d3a tempest-CreateVolumesFromSnapshotTest-405548807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:13 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-c59ea2f1-2aea-420d-a85e-b0fdf1c4ad0a tempest-CreateVolumesFromImageTest-1460914073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:29:13 devstack sudo[106724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:29:13 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:13 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c59ea2f1-2aea-420d-a85e-b0fdf1c4ad0a tempest-CreateVolumesFromImageTest-1460914073 None] Flow 'volume_create_manager' (1d96e94e-37cc-4d81-bea7-37f338ddd137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:29:13 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c59ea2f1-2aea-420d-a85e-b0fdf1c4ad0a tempest-CreateVolumesFromImageTest-1460914073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20b57780-6eda-4bc6-ad23-1b3c0bf88bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:13 devstack sudo[106723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-93ded461-71d6-453a-99f3-c58f053e5532.f0da0a76-1e0d-41a0-ab11-8e1d439973ea
Jul 03 01:29:13 devstack sudo[106723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:13 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c59ea2f1-2aea-420d-a85e-b0fdf1c4ad0a tempest-CreateVolumesFromImageTest-1460914073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20b57780-6eda-4bc6-ad23-1b3c0bf88bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:29:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1462237974',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61e84693-88bb-4858-a643-05bf24da2f6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1598479cd5b64fa38b4bf40f1fd0703d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:29:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:29:13Z,use_quota=True,user_id='4616577780d94c31aeddf8f5ecdc6ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:13 devstack sudo[106716]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:13 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c59ea2f1-2aea-420d-a85e-b0fdf1c4ad0a tempest-CreateVolumesFromImageTest-1460914073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aad8b5bc-9faa-4959-b5ef-47bf4b88ff0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:13 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c59ea2f1-2aea-420d-a85e-b0fdf1c4ad0a tempest-CreateVolumesFromImageTest-1460914073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aad8b5bc-9faa-4959-b5ef-47bf4b88ff0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:13 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c59ea2f1-2aea-420d-a85e-b0fdf1c4ad0a tempest-CreateVolumesFromImageTest-1460914073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c5656e7-ab14-4a73-947a-14947d6096c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:13 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c59ea2f1-2aea-420d-a85e-b0fdf1c4ad0a tempest-CreateVolumesFromImageTest-1460914073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c5656e7-ab14-4a73-947a-14947d6096c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61e84693-88bb-4858-a643-05bf24da2f6c', 'volume_name': 'volume-61e84693-88bb-4858-a643-05bf24da2f6c', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:13 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c59ea2f1-2aea-420d-a85e-b0fdf1c4ad0a tempest-CreateVolumesFromImageTest-1460914073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7757781-93ad-4bb4-88bf-15e52e3bedf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:13 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c59ea2f1-2aea-420d-a85e-b0fdf1c4ad0a tempest-CreateVolumesFromImageTest-1460914073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7757781-93ad-4bb4-88bf-15e52e3bedf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:13 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c59ea2f1-2aea-420d-a85e-b0fdf1c4ad0a tempest-CreateVolumesFromImageTest-1460914073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b5d64aa-1970-476a-8870-ae274ad3c863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:13 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-c59ea2f1-2aea-420d-a85e-b0fdf1c4ad0a tempest-CreateVolumesFromImageTest-1460914073 None] Volume 61e84693-88bb-4858-a643-05bf24da2f6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61e84693-88bb-4858-a643-05bf24da2f6c', 'volume_size': 1}
Jul 03 01:29:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-c59ea2f1-2aea-420d-a85e-b0fdf1c4ad0a tempest-CreateVolumesFromImageTest-1460914073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:29:13 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-05d80c23-7826-4ff9-adb2-ac1cceabf10c tempest-CreateVolumesFromSnapshotTest-405548807 None] Acquiring lock "cinder-10c5e421-4da6-40a6-86ac-10f7e20bbd7a-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:29:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6d4da447-cc87-47a6-9924-5186b058382f tempest-CinderUnicodeTest-944587269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3bf18f36-2368-44de-a105-fdce6a2aed3d 1073741824" returned: 0 in 1.094s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:13 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-05d80c23-7826-4ff9-adb2-ac1cceabf10c tempest-CreateVolumesFromSnapshotTest-405548807 None] Lock "cinder-10c5e421-4da6-40a6-86ac-10f7e20bbd7a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:29:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6d4da447-cc87-47a6-9924-5186b058382f tempest-CinderUnicodeTest-944587269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3bf18f36-2368-44de-a105-fdce6a2aed3d {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:13 devstack sudo[106727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3bf18f36-2368-44de-a105-fdce6a2aed3d
Jul 03 01:29:13 devstack sudo[106727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:13 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-05d80c23-7826-4ff9-adb2-ac1cceabf10c tempest-CreateVolumesFromSnapshotTest-405548807 None] Acquiring lock "cinder-quobyte-10c5e421-4da6-40a6-86ac-10f7e20bbd7a" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:29:13 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-05d80c23-7826-4ff9-adb2-ac1cceabf10c tempest-CreateVolumesFromSnapshotTest-405548807 None] Lock "cinder-quobyte-10c5e421-4da6-40a6-86ac-10f7e20bbd7a" acquired by "delete_volume" :: waited 0.020s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:29:13 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b01a74-8d34-44ac-98f0-55fb0f6ed290]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:29:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-05d80c23-7826-4ff9-adb2-ac1cceabf10c tempest-CreateVolumesFromSnapshotTest-405548807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-10c5e421-4da6-40a6-86ac-10f7e20bbd7a {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:13 devstack sudo[106729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-10c5e421-4da6-40a6-86ac-10f7e20bbd7a
Jul 03 01:29:13 devstack sudo[106729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:14 devstack sudo[106723]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5f33e764-6da4-4b44-86e8-7cfc646298f4 tempest-ProjectMemberTests-1866302072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-93ded461-71d6-453a-99f3-c58f053e5532.f0da0a76-1e0d-41a0-ab11-8e1d439973ea" returned: 0 in 0.874s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:14 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-5f33e764-6da4-4b44-86e8-7cfc646298f4 tempest-ProjectMemberTests-1866302072 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93ded461-71d6-453a-99f3-c58f053e5532(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:29:14 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:14 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[51293b8a-b1cb-4ac8-957e-679e82a12a8a]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:29:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5f33e764-6da4-4b44-86e8-7cfc646298f4 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-93ded461-71d6-453a-99f3-c58f053e5532 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e7028655-47e2-42f8-bd48-372f63229d3a tempest-CreateVolumesFromSnapshotTest-405548807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.906s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:14 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-e7028655-47e2-42f8-bd48-372f63229d3a tempest-CreateVolumesFromSnapshotTest-405548807 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:29:14 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-e7028655-47e2-42f8-bd48-372f63229d3a tempest-CreateVolumesFromSnapshotTest-405548807 None] Deleted volume successfully.
Jul 03 01:29:14 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e7028655-47e2-42f8-bd48-372f63229d3a tempest-CreateVolumesFromSnapshotTest-405548807 None] Lock "cinder-54ae1e57-27ed-46ca-ae69-356605f0e341-delete_volume" released by "delete_volume" :: held 3.134s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:29:14 devstack sudo[106736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-93ded461-71d6-453a-99f3-c58f053e5532
Jul 03 01:29:14 devstack sudo[106736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:14 devstack sudo[106727]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6d4da447-cc87-47a6-9924-5186b058382f tempest-CinderUnicodeTest-944587269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3bf18f36-2368-44de-a105-fdce6a2aed3d" returned: 0 in 0.822s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:14 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-6d4da447-cc87-47a6-9924-5186b058382f tempest-CinderUnicodeTest-944587269 None] <== create_volume: return (1969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:29:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-6d4da447-cc87-47a6-9924-5186b058382f tempest-CinderUnicodeTest-944587269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.974s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:29:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f1244c65-8301-4202-a61b-cb1bf8c84025 tempest-CreateVolumesFromImageTest-1460914073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.768s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:29:14 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-f1244c65-8301-4202-a61b-cb1bf8c84025 tempest-CreateVolumesFromImageTest-1460914073 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:29:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1963109853',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d39a9240-821b-4f22-b7e6-600b1aeac104,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1598479cd5b64fa38b4bf40f1fd0703d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:29:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:29:11Z,use_quota=True,user_id='4616577780d94c31aeddf8f5ecdc6ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:29:14 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-f1244c65-8301-4202-a61b-cb1bf8c84025 tempest-CreateVolumesFromImageTest-1460914073 None] Creating volume d39a9240-821b-4f22-b7e6-600b1aeac104 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:29:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f1244c65-8301-4202-a61b-cb1bf8c84025 tempest-CreateVolumesFromImageTest-1460914073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:29:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f1244c65-8301-4202-a61b-cb1bf8c84025 tempest-CreateVolumesFromImageTest-1460914073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:29:14 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-f1244c65-8301-4202-a61b-cb1bf8c84025 tempest-CreateVolumesFromImageTest-1460914073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:29:14 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-f1244c65-8301-4202-a61b-cb1bf8c84025 tempest-CreateVolumesFromImageTest-1460914073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:29:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f1244c65-8301-4202-a61b-cb1bf8c84025 tempest-CreateVolumesFromImageTest-1460914073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:29:14 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-f1244c65-8301-4202-a61b-cb1bf8c84025 tempest-CreateVolumesFromImageTest-1460914073 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:29:14 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-f1244c65-8301-4202-a61b-cb1bf8c84025 tempest-CreateVolumesFromImageTest-1460914073 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:29:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f1244c65-8301-4202-a61b-cb1bf8c84025 tempest-CreateVolumesFromImageTest-1460914073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d39a9240-821b-4f22-b7e6-600b1aeac104 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:14 devstack sudo[106741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d39a9240-821b-4f22-b7e6-600b1aeac104 1073741824
Jul 03 01:29:14 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-6d4da447-cc87-47a6-9924-5186b058382f tempest-CinderUnicodeTest-944587269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e63826f-1628-4238-b7a4-a5ef9c30cc69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bf18f36-2368-44de-a105-fdce6a2aed3d', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:14 devstack sudo[106741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:14 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-6d4da447-cc87-47a6-9924-5186b058382f tempest-CinderUnicodeTest-944587269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9af75f9a-aa81-47f4-ac9d-c3c64489cd95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:14 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-6d4da447-cc87-47a6-9924-5186b058382f tempest-CinderUnicodeTest-944587269 None] Volume volume-3bf18f36-2368-44de-a105-fdce6a2aed3d (3bf18f36-2368-44de-a105-fdce6a2aed3d): created successfully
Jul 03 01:29:14 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-6d4da447-cc87-47a6-9924-5186b058382f tempest-CinderUnicodeTest-944587269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9af75f9a-aa81-47f4-ac9d-c3c64489cd95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:14 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-6d4da447-cc87-47a6-9924-5186b058382f tempest-CinderUnicodeTest-944587269 None] Flow 'volume_create_manager' (eb0db8de-6427-4696-8296-dac57cced974) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:29:14 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-6d4da447-cc87-47a6-9924-5186b058382f tempest-CinderUnicodeTest-944587269 None] Created volume successfully.
Jul 03 01:29:14 devstack sudo[106729]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-05d80c23-7826-4ff9-adb2-ac1cceabf10c tempest-CreateVolumesFromSnapshotTest-405548807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-10c5e421-4da6-40a6-86ac-10f7e20bbd7a" returned: 0 in 0.823s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-05d80c23-7826-4ff9-adb2-ac1cceabf10c tempest-CreateVolumesFromSnapshotTest-405548807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-10c5e421-4da6-40a6-86ac-10f7e20bbd7a {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:14 devstack sudo[106743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-10c5e421-4da6-40a6-86ac-10f7e20bbd7a
Jul 03 01:29:14 devstack sudo[106743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:14 devstack sudo[106736]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5f33e764-6da4-4b44-86e8-7cfc646298f4 tempest-ProjectMemberTests-1866302072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-93ded461-71d6-453a-99f3-c58f053e5532" returned: 0 in 0.806s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5f33e764-6da4-4b44-86e8-7cfc646298f4 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-93ded461-71d6-453a-99f3-c58f053e5532.f0da0a76-1e0d-41a0-ab11-8e1d439973ea {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:15 devstack sudo[106752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-93ded461-71d6-453a-99f3-c58f053e5532.f0da0a76-1e0d-41a0-ab11-8e1d439973ea
Jul 03 01:29:15 devstack sudo[106752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:15 devstack sudo[106743]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-05d80c23-7826-4ff9-adb2-ac1cceabf10c tempest-CreateVolumesFromSnapshotTest-405548807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-10c5e421-4da6-40a6-86ac-10f7e20bbd7a" returned: 0 in 0.654s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:15 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-05d80c23-7826-4ff9-adb2-ac1cceabf10c tempest-CreateVolumesFromSnapshotTest-405548807 None] Lock "cinder-quobyte-10c5e421-4da6-40a6-86ac-10f7e20bbd7a" released by "delete_volume" :: held 1.532s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:29:15 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-05d80c23-7826-4ff9-adb2-ac1cceabf10c tempest-CreateVolumesFromSnapshotTest-405548807 None] Created reservations ['2ea5621b-05ea-4567-9882-9379790dc6df', '253b8aab-5455-4807-b6af-7307d0bb4e90', 'c00431a5-0402-4c52-9478-f9768925697d', '097e7e07-1ded-4d33-b12d-6ec64702f906'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:29:15 devstack sudo[106741]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f1244c65-8301-4202-a61b-cb1bf8c84025 tempest-CreateVolumesFromImageTest-1460914073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d39a9240-821b-4f22-b7e6-600b1aeac104 1073741824" returned: 0 in 0.941s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-05d80c23-7826-4ff9-adb2-ac1cceabf10c tempest-CreateVolumesFromSnapshotTest-405548807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:29:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-05d80c23-7826-4ff9-adb2-ac1cceabf10c tempest-CreateVolumesFromSnapshotTest-405548807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:29:15 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-05d80c23-7826-4ff9-adb2-ac1cceabf10c tempest-CreateVolumesFromSnapshotTest-405548807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:29:15 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-05d80c23-7826-4ff9-adb2-ac1cceabf10c tempest-CreateVolumesFromSnapshotTest-405548807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:29:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-05d80c23-7826-4ff9-adb2-ac1cceabf10c tempest-CreateVolumesFromSnapshotTest-405548807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:29:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-05d80c23-7826-4ff9-adb2-ac1cceabf10c tempest-CreateVolumesFromSnapshotTest-405548807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:15 devstack sudo[106755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:29:15 devstack sudo[106755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f1244c65-8301-4202-a61b-cb1bf8c84025 tempest-CreateVolumesFromImageTest-1460914073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d39a9240-821b-4f22-b7e6-600b1aeac104 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:15 devstack sudo[106757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d39a9240-821b-4f22-b7e6-600b1aeac104
Jul 03 01:29:15 devstack sudo[106757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:15 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-22f54d15-fc64-40f6-9ce9-9b3c2c3fb1e5 tempest-CreateVolumesFromSnapshotTest-405548807 None] Acquiring lock "cinder-b0ceb4db-4cff-4fed-a435-bb7eba4a9d65-delete_snapshot" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:29:15 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-22f54d15-fc64-40f6-9ce9-9b3c2c3fb1e5 tempest-CreateVolumesFromSnapshotTest-405548807 None] Lock "cinder-b0ceb4db-4cff-4fed-a435-bb7eba4a9d65-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:29:15 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-22f54d15-fc64-40f6-9ce9-9b3c2c3fb1e5 tempest-CreateVolumesFromSnapshotTest-405548807 None] Acquiring lock "cinder-quobyte-d848e64e-0132-492f-ae40-b97334eb11a0" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:29:15 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-22f54d15-fc64-40f6-9ce9-9b3c2c3fb1e5 tempest-CreateVolumesFromSnapshotTest-405548807 None] Lock "cinder-quobyte-d848e64e-0132-492f-ae40-b97334eb11a0" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:29:15 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-22f54d15-fc64-40f6-9ce9-9b3c2c3fb1e5 tempest-CreateVolumesFromSnapshotTest-405548807 None] Acquiring lock "cinder-quobyte-b0ceb4db-4cff-4fed-a435-bb7eba4a9d65" by "_delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:29:15 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-22f54d15-fc64-40f6-9ce9-9b3c2c3fb1e5 tempest-CreateVolumesFromSnapshotTest-405548807 None] Lock "cinder-quobyte-b0ceb4db-4cff-4fed-a435-bb7eba4a9d65" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:29:15 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-22f54d15-fc64-40f6-9ce9-9b3c2c3fb1e5 tempest-CreateVolumesFromSnapshotTest-405548807 None] Deleting offline snapshot b0ceb4db-4cff-4fed-a435-bb7eba4a9d65 of volume d848e64e-0132-492f-ae40-b97334eb11a0 {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 01:29:15 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-22f54d15-fc64-40f6-9ce9-9b3c2c3fb1e5 tempest-CreateVolumesFromSnapshotTest-405548807 None] snapshot_file for this snap is: volume-d848e64e-0132-492f-ae40-b97334eb11a0.b0ceb4db-4cff-4fed-a435-bb7eba4a9d65 {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 01:29:15 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[9606c46c-87b7-42c6-95fe-cedb12f4d536]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:29:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-22f54d15-fc64-40f6-9ce9-9b3c2c3fb1e5 tempest-CreateVolumesFromSnapshotTest-405548807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d848e64e-0132-492f-ae40-b97334eb11a0.b0ceb4db-4cff-4fed-a435-bb7eba4a9d65 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:15 devstack sudo[106752]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:15 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-e71a60f7-ce5e-489e-88b5-d59a18199a8e tempest-CinderUnicodeTest-944587269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:29:15 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e71a60f7-ce5e-489e-88b5-d59a18199a8e tempest-CinderUnicodeTest-944587269 None] Flow 'volume_create_manager' (b543251e-a379-44b8-b19b-ce2b7efddae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:29:15 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e71a60f7-ce5e-489e-88b5-d59a18199a8e tempest-CinderUnicodeTest-944587269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b24a1e6-c903-4f72-a319-363848a357a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5f33e764-6da4-4b44-86e8-7cfc646298f4 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-93ded461-71d6-453a-99f3-c58f053e5532.f0da0a76-1e0d-41a0-ab11-8e1d439973ea" returned: 0 in 1.010s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5f33e764-6da4-4b44-86e8-7cfc646298f4 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-93ded461-71d6-453a-99f3-c58f053e5532.f0da0a76-1e0d-41a0-ab11-8e1d439973ea {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:16 devstack sudo[106763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d848e64e-0132-492f-ae40-b97334eb11a0.b0ceb4db-4cff-4fed-a435-bb7eba4a9d65
Jul 03 01:29:16 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:16 devstack sudo[106765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-93ded461-71d6-453a-99f3-c58f053e5532.f0da0a76-1e0d-41a0-ab11-8e1d439973ea
Jul 03 01:29:16 devstack sudo[106765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:16 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e71a60f7-ce5e-489e-88b5-d59a18199a8e tempest-CinderUnicodeTest-944587269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b24a1e6-c903-4f72-a319-363848a357a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:29:15Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-163580895',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b64656d-2ed7-4b42-afa1-9b19032b38eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6acd06fd7fc942c0886251af963f5aad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:29:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:29:16Z,use_quota=True,user_id='4e593a77b8584ecaadff5fc4c6b6e8b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:16 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e71a60f7-ce5e-489e-88b5-d59a18199a8e tempest-CinderUnicodeTest-944587269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25a1787c-7d3c-432e-80df-7fb0b2124987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:16 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e71a60f7-ce5e-489e-88b5-d59a18199a8e tempest-CinderUnicodeTest-944587269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25a1787c-7d3c-432e-80df-7fb0b2124987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:16 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e71a60f7-ce5e-489e-88b5-d59a18199a8e tempest-CinderUnicodeTest-944587269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b92d859-f974-4c0b-be0e-addcbb0eea29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:16 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e71a60f7-ce5e-489e-88b5-d59a18199a8e tempest-CinderUnicodeTest-944587269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b92d859-f974-4c0b-be0e-addcbb0eea29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b64656d-2ed7-4b42-afa1-9b19032b38eb', 'volume_name': 'volume-0b64656d-2ed7-4b42-afa1-9b19032b38eb', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:16 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e71a60f7-ce5e-489e-88b5-d59a18199a8e tempest-CinderUnicodeTest-944587269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dc8598d-1bbf-40a7-8cbc-c384ba33d04f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:16 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e71a60f7-ce5e-489e-88b5-d59a18199a8e tempest-CinderUnicodeTest-944587269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dc8598d-1bbf-40a7-8cbc-c384ba33d04f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:16 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e71a60f7-ce5e-489e-88b5-d59a18199a8e tempest-CinderUnicodeTest-944587269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7389695e-ebc0-47f4-aeb8-0a4292859285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:16 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-e71a60f7-ce5e-489e-88b5-d59a18199a8e tempest-CinderUnicodeTest-944587269 None] Volume 0b64656d-2ed7-4b42-afa1-9b19032b38eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b64656d-2ed7-4b42-afa1-9b19032b38eb', 'volume_size': 1}
Jul 03 01:29:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e71a60f7-ce5e-489e-88b5-d59a18199a8e tempest-CinderUnicodeTest-944587269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:29:16 devstack sudo[106755]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-05d80c23-7826-4ff9-adb2-ac1cceabf10c tempest-CreateVolumesFromSnapshotTest-405548807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.879s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:16 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-05d80c23-7826-4ff9-adb2-ac1cceabf10c tempest-CreateVolumesFromSnapshotTest-405548807 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:29:16 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-05d80c23-7826-4ff9-adb2-ac1cceabf10c tempest-CreateVolumesFromSnapshotTest-405548807 None] Deleted volume successfully.
Jul 03 01:29:16 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-05d80c23-7826-4ff9-adb2-ac1cceabf10c tempest-CreateVolumesFromSnapshotTest-405548807 None] Lock "cinder-10c5e421-4da6-40a6-86ac-10f7e20bbd7a-delete_volume" released by "delete_volume" :: held 2.741s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:29:16 devstack sudo[106757]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f1244c65-8301-4202-a61b-cb1bf8c84025 tempest-CreateVolumesFromImageTest-1460914073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d39a9240-821b-4f22-b7e6-600b1aeac104" returned: 0 in 0.905s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:16 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-f1244c65-8301-4202-a61b-cb1bf8c84025 tempest-CreateVolumesFromImageTest-1460914073 None] <== create_volume: return (1940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:29:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f1244c65-8301-4202-a61b-cb1bf8c84025 tempest-CreateVolumesFromImageTest-1460914073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.943s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:29:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1d35037d-07b6-40af-87f1-3aedb2aeccfd tempest-CreateVolumesFromImageTest-1460914073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.219s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:29:16 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-1d35037d-07b6-40af-87f1-3aedb2aeccfd tempest-CreateVolumesFromImageTest-1460914073 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:29:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1910280173',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba9f672d-3115-4a5b-a736-65a9cd19b007,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1598479cd5b64fa38b4bf40f1fd0703d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:29:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:29:12Z,use_quota=True,user_id='4616577780d94c31aeddf8f5ecdc6ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:29:16 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-1d35037d-07b6-40af-87f1-3aedb2aeccfd tempest-CreateVolumesFromImageTest-1460914073 None] Creating volume ba9f672d-3115-4a5b-a736-65a9cd19b007 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:29:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1d35037d-07b6-40af-87f1-3aedb2aeccfd tempest-CreateVolumesFromImageTest-1460914073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:29:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1d35037d-07b6-40af-87f1-3aedb2aeccfd tempest-CreateVolumesFromImageTest-1460914073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:29:16 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-1d35037d-07b6-40af-87f1-3aedb2aeccfd tempest-CreateVolumesFromImageTest-1460914073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:29:16 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-1d35037d-07b6-40af-87f1-3aedb2aeccfd tempest-CreateVolumesFromImageTest-1460914073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:29:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1d35037d-07b6-40af-87f1-3aedb2aeccfd tempest-CreateVolumesFromImageTest-1460914073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:29:16 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-1d35037d-07b6-40af-87f1-3aedb2aeccfd tempest-CreateVolumesFromImageTest-1460914073 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:29:16 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-1d35037d-07b6-40af-87f1-3aedb2aeccfd tempest-CreateVolumesFromImageTest-1460914073 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:29:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1d35037d-07b6-40af-87f1-3aedb2aeccfd tempest-CreateVolumesFromImageTest-1460914073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ba9f672d-3115-4a5b-a736-65a9cd19b007 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:16 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f1244c65-8301-4202-a61b-cb1bf8c84025 tempest-CreateVolumesFromImageTest-1460914073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59f92642-f00f-4c19-b8bb-774bd7db9074) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d39a9240-821b-4f22-b7e6-600b1aeac104', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:16 devstack sudo[106769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ba9f672d-3115-4a5b-a736-65a9cd19b007 1073741824
Jul 03 01:29:16 devstack sudo[106769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:16 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f1244c65-8301-4202-a61b-cb1bf8c84025 tempest-CreateVolumesFromImageTest-1460914073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfff1a86-d02c-436b-be9e-da5600bb2535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:16 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-f1244c65-8301-4202-a61b-cb1bf8c84025 tempest-CreateVolumesFromImageTest-1460914073 None] Volume volume-d39a9240-821b-4f22-b7e6-600b1aeac104 (d39a9240-821b-4f22-b7e6-600b1aeac104): created successfully
Jul 03 01:29:16 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f1244c65-8301-4202-a61b-cb1bf8c84025 tempest-CreateVolumesFromImageTest-1460914073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfff1a86-d02c-436b-be9e-da5600bb2535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:16 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f1244c65-8301-4202-a61b-cb1bf8c84025 tempest-CreateVolumesFromImageTest-1460914073 None] Flow 'volume_create_manager' (0ba11698-b321-4cf1-ae06-e0d95854de74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:29:16 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-f1244c65-8301-4202-a61b-cb1bf8c84025 tempest-CreateVolumesFromImageTest-1460914073 None] Created volume successfully.
Jul 03 01:29:16 devstack sudo[106765]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5f33e764-6da4-4b44-86e8-7cfc646298f4 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-93ded461-71d6-453a-99f3-c58f053e5532.f0da0a76-1e0d-41a0-ab11-8e1d439973ea" returned: 0 in 0.762s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:16 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5f33e764-6da4-4b44-86e8-7cfc646298f4 tempest-ProjectMemberTests-1866302072 None] Lock "cinder-quobyte-f0da0a76-1e0d-41a0-ab11-8e1d439973ea" released by "_delete_snapshot" :: held 3.606s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:29:16 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5f33e764-6da4-4b44-86e8-7cfc646298f4 tempest-ProjectMemberTests-1866302072 None] Lock "cinder-quobyte-93ded461-71d6-453a-99f3-c58f053e5532" released by "delete_snapshot" :: held 3.652s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:29:16 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-22f54d15-fc64-40f6-9ce9-9b3c2c3fb1e5 tempest-CreateVolumesFromSnapshotTest-405548807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d848e64e-0132-492f-ae40-b97334eb11a0.b0ceb4db-4cff-4fed-a435-bb7eba4a9d65" returned: 0 in 0.984s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:16 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-22f54d15-fc64-40f6-9ce9-9b3c2c3fb1e5 tempest-CreateVolumesFromSnapshotTest-405548807 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d848e64e-0132-492f-ae40-b97334eb11a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:29:16 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c89cc8-e7c1-4602-8bbc-42caf4634b28]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:29:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-22f54d15-fc64-40f6-9ce9-9b3c2c3fb1e5 tempest-CreateVolumesFromSnapshotTest-405548807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d848e64e-0132-492f-ae40-b97334eb11a0 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:16 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-5f33e764-6da4-4b44-86e8-7cfc646298f4 tempest-ProjectMemberTests-1866302072 None] Created reservations ['05d7b1ce-28cb-4a46-b68b-80abc2b829f9', '3b4527b5-a387-49f1-aea3-de11fcab7fd7', 'f3499f50-16f4-4d3a-b8bd-c800d96a19b9', '644bb2c4-e8ac-4c32-9e11-53fe84537c6e'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:29:16 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-5f33e764-6da4-4b44-86e8-7cfc646298f4 tempest-ProjectMemberTests-1866302072 None] Delete snapshot completed successfully.
Jul 03 01:29:16 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5f33e764-6da4-4b44-86e8-7cfc646298f4 tempest-ProjectMemberTests-1866302072 None] Lock "cinder-f0da0a76-1e0d-41a0-ab11-8e1d439973ea-delete_snapshot" released by "delete_snapshot" :: held 3.853s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:29:16 devstack sudo[106776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d848e64e-0132-492f-ae40-b97334eb11a0
Jul 03 01:29:16 devstack sudo[106776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:17 devstack sudo[106769]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1d35037d-07b6-40af-87f1-3aedb2aeccfd tempest-CreateVolumesFromImageTest-1460914073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ba9f672d-3115-4a5b-a736-65a9cd19b007 1073741824" returned: 0 in 0.962s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1d35037d-07b6-40af-87f1-3aedb2aeccfd tempest-CreateVolumesFromImageTest-1460914073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ba9f672d-3115-4a5b-a736-65a9cd19b007 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:17 devstack sudo[106781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ba9f672d-3115-4a5b-a736-65a9cd19b007
Jul 03 01:29:17 devstack sudo[106781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:17 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d7537460-cb7d-441a-9ec3-8c3566f9b134 tempest-ProjectMemberTests-1866302072 None] Acquiring lock "cinder-93ded461-71d6-453a-99f3-c58f053e5532-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:29:17 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d7537460-cb7d-441a-9ec3-8c3566f9b134 tempest-ProjectMemberTests-1866302072 None] Lock "cinder-93ded461-71d6-453a-99f3-c58f053e5532-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:29:17 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d7537460-cb7d-441a-9ec3-8c3566f9b134 tempest-ProjectMemberTests-1866302072 None] Acquiring lock "cinder-quobyte-93ded461-71d6-453a-99f3-c58f053e5532" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:29:17 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d7537460-cb7d-441a-9ec3-8c3566f9b134 tempest-ProjectMemberTests-1866302072 None] Lock "cinder-quobyte-93ded461-71d6-453a-99f3-c58f053e5532" acquired by "delete_volume" :: waited 0.017s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:29:17 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d62429-7833-4a6b-ae90-f5e2efa41e99]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:29:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d7537460-cb7d-441a-9ec3-8c3566f9b134 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-93ded461-71d6-453a-99f3-c58f053e5532 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:17 devstack sudo[106776]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-22f54d15-fc64-40f6-9ce9-9b3c2c3fb1e5 tempest-CreateVolumesFromSnapshotTest-405548807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d848e64e-0132-492f-ae40-b97334eb11a0" returned: 0 in 0.827s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-22f54d15-fc64-40f6-9ce9-9b3c2c3fb1e5 tempest-CreateVolumesFromSnapshotTest-405548807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d848e64e-0132-492f-ae40-b97334eb11a0.b0ceb4db-4cff-4fed-a435-bb7eba4a9d65 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:17 devstack sudo[106787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d848e64e-0132-492f-ae40-b97334eb11a0.b0ceb4db-4cff-4fed-a435-bb7eba4a9d65
Jul 03 01:29:17 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:17 devstack sudo[106786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-93ded461-71d6-453a-99f3-c58f053e5532
Jul 03 01:29:17 devstack sudo[106786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:18 devstack sudo[106781]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1d35037d-07b6-40af-87f1-3aedb2aeccfd tempest-CreateVolumesFromImageTest-1460914073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ba9f672d-3115-4a5b-a736-65a9cd19b007" returned: 0 in 0.770s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:18 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-1d35037d-07b6-40af-87f1-3aedb2aeccfd tempest-CreateVolumesFromImageTest-1460914073 None] <== create_volume: return (1780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:29:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1d35037d-07b6-40af-87f1-3aedb2aeccfd tempest-CreateVolumesFromImageTest-1460914073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.783s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:29:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-199de340-64eb-40ae-a07b-ecbe1b372751 tempest-CreateVolumesFromImageTest-1460914073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.513s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:29:18 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-199de340-64eb-40ae-a07b-ecbe1b372751 tempest-CreateVolumesFromImageTest-1460914073 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:29:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-624970156',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0471779b-dd0b-4589-9550-26b7134d0b97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1598479cd5b64fa38b4bf40f1fd0703d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:29:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:29:12Z,use_quota=True,user_id='4616577780d94c31aeddf8f5ecdc6ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:29:18 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-199de340-64eb-40ae-a07b-ecbe1b372751 tempest-CreateVolumesFromImageTest-1460914073 None] Creating volume 0471779b-dd0b-4589-9550-26b7134d0b97 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:29:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-199de340-64eb-40ae-a07b-ecbe1b372751 tempest-CreateVolumesFromImageTest-1460914073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:29:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-199de340-64eb-40ae-a07b-ecbe1b372751 tempest-CreateVolumesFromImageTest-1460914073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:29:18 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-199de340-64eb-40ae-a07b-ecbe1b372751 tempest-CreateVolumesFromImageTest-1460914073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:29:18 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-199de340-64eb-40ae-a07b-ecbe1b372751 tempest-CreateVolumesFromImageTest-1460914073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:29:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-199de340-64eb-40ae-a07b-ecbe1b372751 tempest-CreateVolumesFromImageTest-1460914073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:29:18 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-199de340-64eb-40ae-a07b-ecbe1b372751 tempest-CreateVolumesFromImageTest-1460914073 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:29:18 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-199de340-64eb-40ae-a07b-ecbe1b372751 tempest-CreateVolumesFromImageTest-1460914073 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:29:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-199de340-64eb-40ae-a07b-ecbe1b372751 tempest-CreateVolumesFromImageTest-1460914073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0471779b-dd0b-4589-9550-26b7134d0b97 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:18 devstack sudo[106791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0471779b-dd0b-4589-9550-26b7134d0b97 1073741824
Jul 03 01:29:18 devstack sudo[106791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1d35037d-07b6-40af-87f1-3aedb2aeccfd tempest-CreateVolumesFromImageTest-1460914073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bcb64c2-0ff7-4b9c-8931-5e2cf5fc938b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba9f672d-3115-4a5b-a736-65a9cd19b007', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1d35037d-07b6-40af-87f1-3aedb2aeccfd tempest-CreateVolumesFromImageTest-1460914073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5accab58-f168-40f7-aa42-017ebe8e6bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:18 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-1d35037d-07b6-40af-87f1-3aedb2aeccfd tempest-CreateVolumesFromImageTest-1460914073 None] Volume volume-ba9f672d-3115-4a5b-a736-65a9cd19b007 (ba9f672d-3115-4a5b-a736-65a9cd19b007): created successfully
Jul 03 01:29:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1d35037d-07b6-40af-87f1-3aedb2aeccfd tempest-CreateVolumesFromImageTest-1460914073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5accab58-f168-40f7-aa42-017ebe8e6bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1d35037d-07b6-40af-87f1-3aedb2aeccfd tempest-CreateVolumesFromImageTest-1460914073 None] Flow 'volume_create_manager' (25935104-dea3-4dc0-9a0a-2a9ab696556a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:29:18 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-1d35037d-07b6-40af-87f1-3aedb2aeccfd tempest-CreateVolumesFromImageTest-1460914073 None] Created volume successfully.
Jul 03 01:29:18 devstack sudo[106786]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d7537460-cb7d-441a-9ec3-8c3566f9b134 tempest-ProjectMemberTests-1866302072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-93ded461-71d6-453a-99f3-c58f053e5532" returned: 0 in 0.813s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d7537460-cb7d-441a-9ec3-8c3566f9b134 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-93ded461-71d6-453a-99f3-c58f053e5532 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:18 devstack sudo[106800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-93ded461-71d6-453a-99f3-c58f053e5532
Jul 03 01:29:18 devstack sudo[106800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:18 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-22f54d15-fc64-40f6-9ce9-9b3c2c3fb1e5 tempest-CreateVolumesFromSnapshotTest-405548807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d848e64e-0132-492f-ae40-b97334eb11a0.b0ceb4db-4cff-4fed-a435-bb7eba4a9d65" returned: 0 in 0.902s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-22f54d15-fc64-40f6-9ce9-9b3c2c3fb1e5 tempest-CreateVolumesFromSnapshotTest-405548807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d848e64e-0132-492f-ae40-b97334eb11a0.b0ceb4db-4cff-4fed-a435-bb7eba4a9d65 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:18 devstack sudo[106802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d848e64e-0132-492f-ae40-b97334eb11a0.b0ceb4db-4cff-4fed-a435-bb7eba4a9d65
Jul 03 01:29:18 devstack sudo[106802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:18 devstack sudo[106791]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-199de340-64eb-40ae-a07b-ecbe1b372751 tempest-CreateVolumesFromImageTest-1460914073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0471779b-dd0b-4589-9550-26b7134d0b97 1073741824" returned: 0 in 0.849s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-199de340-64eb-40ae-a07b-ecbe1b372751 tempest-CreateVolumesFromImageTest-1460914073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0471779b-dd0b-4589-9550-26b7134d0b97 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:18 devstack sudo[106808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0471779b-dd0b-4589-9550-26b7134d0b97
Jul 03 01:29:18 devstack sudo[106808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:19 devstack sudo[106800]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:19 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d7537460-cb7d-441a-9ec3-8c3566f9b134 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-93ded461-71d6-453a-99f3-c58f053e5532" returned: 0 in 0.733s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:19 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d7537460-cb7d-441a-9ec3-8c3566f9b134 tempest-ProjectMemberTests-1866302072 None] Lock "cinder-quobyte-93ded461-71d6-453a-99f3-c58f053e5532" released by "delete_volume" :: held 1.604s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:29:19 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-d7537460-cb7d-441a-9ec3-8c3566f9b134 tempest-ProjectMemberTests-1866302072 None] Created reservations ['d47969c9-7005-4d3d-936d-f51cb7f37971', 'd58c7b18-c75e-4873-9489-8ecfc975525c', '88e64f41-f194-4ba4-81ff-3ef3749f0667', '37afc20f-ecf1-4b63-8f26-8defc44ed0ac'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:29:19 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-d7537460-cb7d-441a-9ec3-8c3566f9b134 tempest-ProjectMemberTests-1866302072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:29:19 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-d7537460-cb7d-441a-9ec3-8c3566f9b134 tempest-ProjectMemberTests-1866302072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:29:19 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-d7537460-cb7d-441a-9ec3-8c3566f9b134 tempest-ProjectMemberTests-1866302072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:29:19 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-d7537460-cb7d-441a-9ec3-8c3566f9b134 tempest-ProjectMemberTests-1866302072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:29:19 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-d7537460-cb7d-441a-9ec3-8c3566f9b134 tempest-ProjectMemberTests-1866302072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:29:19 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d7537460-cb7d-441a-9ec3-8c3566f9b134 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:19 devstack sudo[106802]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:19 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-22f54d15-fc64-40f6-9ce9-9b3c2c3fb1e5 tempest-CreateVolumesFromSnapshotTest-405548807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d848e64e-0132-492f-ae40-b97334eb11a0.b0ceb4db-4cff-4fed-a435-bb7eba4a9d65" returned: 0 in 0.767s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:19 devstack sudo[106812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:29:19 devstack sudo[106812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:19 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-22f54d15-fc64-40f6-9ce9-9b3c2c3fb1e5 tempest-CreateVolumesFromSnapshotTest-405548807 None] Lock "cinder-quobyte-b0ceb4db-4cff-4fed-a435-bb7eba4a9d65" released by "_delete_snapshot" :: held 3.606s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:29:19 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-22f54d15-fc64-40f6-9ce9-9b3c2c3fb1e5 tempest-CreateVolumesFromSnapshotTest-405548807 None] Lock "cinder-quobyte-d848e64e-0132-492f-ae40-b97334eb11a0" released by "delete_snapshot" :: held 3.640s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:29:19 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-22f54d15-fc64-40f6-9ce9-9b3c2c3fb1e5 tempest-CreateVolumesFromSnapshotTest-405548807 None] Created reservations ['2c72d2f2-703d-4a16-87b1-1ee59f06151f', '388ceef4-7051-41c4-a6d8-2c63770d56d3', 'ad3b3b27-b084-4d9b-9a45-23de7acc11ab', 'b7f91253-cea8-4fde-85c0-68905580d75f'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:29:19 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-22f54d15-fc64-40f6-9ce9-9b3c2c3fb1e5 tempest-CreateVolumesFromSnapshotTest-405548807 None] Delete snapshot completed successfully.
Jul 03 01:29:19 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-22f54d15-fc64-40f6-9ce9-9b3c2c3fb1e5 tempest-CreateVolumesFromSnapshotTest-405548807 None] Lock "cinder-b0ceb4db-4cff-4fed-a435-bb7eba4a9d65-delete_snapshot" released by "delete_snapshot" :: held 3.790s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:29:19 devstack sudo[106808]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:19 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-199de340-64eb-40ae-a07b-ecbe1b372751 tempest-CreateVolumesFromImageTest-1460914073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0471779b-dd0b-4589-9550-26b7134d0b97" returned: 0 in 0.656s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:19 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-199de340-64eb-40ae-a07b-ecbe1b372751 tempest-CreateVolumesFromImageTest-1460914073 None] <== create_volume: return (1552ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:29:19 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-199de340-64eb-40ae-a07b-ecbe1b372751 tempest-CreateVolumesFromImageTest-1460914073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.556s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:29:19 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-6cd47b64-890f-40a1-84d6-f844a1767392 tempest-CreateVolumesFromImageTest-1460914073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.706s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:29:19 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-6cd47b64-890f-40a1-84d6-f844a1767392 tempest-CreateVolumesFromImageTest-1460914073 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:29:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-282093697',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb8c509a-fa8d-4f58-b7a5-92fda1fbb589,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1598479cd5b64fa38b4bf40f1fd0703d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:29:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:29:13Z,use_quota=True,user_id='4616577780d94c31aeddf8f5ecdc6ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:29:19 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-6cd47b64-890f-40a1-84d6-f844a1767392 tempest-CreateVolumesFromImageTest-1460914073 None] Creating volume cb8c509a-fa8d-4f58-b7a5-92fda1fbb589 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:29:19 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-6cd47b64-890f-40a1-84d6-f844a1767392 tempest-CreateVolumesFromImageTest-1460914073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:29:19 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-6cd47b64-890f-40a1-84d6-f844a1767392 tempest-CreateVolumesFromImageTest-1460914073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:29:19 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-6cd47b64-890f-40a1-84d6-f844a1767392 tempest-CreateVolumesFromImageTest-1460914073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:29:19 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-6cd47b64-890f-40a1-84d6-f844a1767392 tempest-CreateVolumesFromImageTest-1460914073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:29:19 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-6cd47b64-890f-40a1-84d6-f844a1767392 tempest-CreateVolumesFromImageTest-1460914073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:29:19 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-6cd47b64-890f-40a1-84d6-f844a1767392 tempest-CreateVolumesFromImageTest-1460914073 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:29:19 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-6cd47b64-890f-40a1-84d6-f844a1767392 tempest-CreateVolumesFromImageTest-1460914073 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:29:19 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6cd47b64-890f-40a1-84d6-f844a1767392 tempest-CreateVolumesFromImageTest-1460914073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cb8c509a-fa8d-4f58-b7a5-92fda1fbb589 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:19 devstack sudo[106815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cb8c509a-fa8d-4f58-b7a5-92fda1fbb589 1073741824
Jul 03 01:29:19 devstack sudo[106815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:19 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-199de340-64eb-40ae-a07b-ecbe1b372751 tempest-CreateVolumesFromImageTest-1460914073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (606cb517-5ac8-4d23-9eda-7b29223e5ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0471779b-dd0b-4589-9550-26b7134d0b97', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:19 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-199de340-64eb-40ae-a07b-ecbe1b372751 tempest-CreateVolumesFromImageTest-1460914073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0af441f4-579c-4b31-beca-c10ee4fd6b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:19 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-199de340-64eb-40ae-a07b-ecbe1b372751 tempest-CreateVolumesFromImageTest-1460914073 None] Volume volume-0471779b-dd0b-4589-9550-26b7134d0b97 (0471779b-dd0b-4589-9550-26b7134d0b97): created successfully
Jul 03 01:29:19 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-199de340-64eb-40ae-a07b-ecbe1b372751 tempest-CreateVolumesFromImageTest-1460914073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0af441f4-579c-4b31-beca-c10ee4fd6b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:19 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-199de340-64eb-40ae-a07b-ecbe1b372751 tempest-CreateVolumesFromImageTest-1460914073 None] Flow 'volume_create_manager' (4f88a324-7b86-46cc-912e-9ffb160c5751) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:29:19 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-199de340-64eb-40ae-a07b-ecbe1b372751 tempest-CreateVolumesFromImageTest-1460914073 None] Created volume successfully.
Jul 03 01:29:20 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-81f1ca81-aa6a-41d0-b7d6-2a0fb3ca6d69 tempest-CreateVolumesFromSnapshotTest-405548807 None] Acquiring lock "cinder-d848e64e-0132-492f-ae40-b97334eb11a0-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:29:20 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-81f1ca81-aa6a-41d0-b7d6-2a0fb3ca6d69 tempest-CreateVolumesFromSnapshotTest-405548807 None] Lock "cinder-d848e64e-0132-492f-ae40-b97334eb11a0-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:29:20 devstack sudo[106812]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d7537460-cb7d-441a-9ec3-8c3566f9b134 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.824s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:20 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-d7537460-cb7d-441a-9ec3-8c3566f9b134 tempest-ProjectMemberTests-1866302072 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:29:20 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-d7537460-cb7d-441a-9ec3-8c3566f9b134 tempest-ProjectMemberTests-1866302072 None] Deleted volume successfully.
Jul 03 01:29:20 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-81f1ca81-aa6a-41d0-b7d6-2a0fb3ca6d69 tempest-CreateVolumesFromSnapshotTest-405548807 None] Acquiring lock "cinder-quobyte-d848e64e-0132-492f-ae40-b97334eb11a0" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:29:20 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d7537460-cb7d-441a-9ec3-8c3566f9b134 tempest-ProjectMemberTests-1866302072 None] Lock "cinder-93ded461-71d6-453a-99f3-c58f053e5532-delete_volume" released by "delete_volume" :: held 2.689s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:29:20 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-81f1ca81-aa6a-41d0-b7d6-2a0fb3ca6d69 tempest-CreateVolumesFromSnapshotTest-405548807 None] Lock "cinder-quobyte-d848e64e-0132-492f-ae40-b97334eb11a0" acquired by "delete_volume" :: waited 0.026s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:29:20 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89e6d0b-71bc-4f73-a186-8a81c826a9a3]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:29:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-81f1ca81-aa6a-41d0-b7d6-2a0fb3ca6d69 tempest-CreateVolumesFromSnapshotTest-405548807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d848e64e-0132-492f-ae40-b97334eb11a0 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:20 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcad2249-9880-4cb7-830b-ce6fe64ef150 tempest-ProjectMemberTests-1866302072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:29:20 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fcad2249-9880-4cb7-830b-ce6fe64ef150 tempest-ProjectMemberTests-1866302072 None] Flow 'volume_create_manager' (a4159adc-99ff-4bb1-835a-b1f4ca0d998a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:29:20 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fcad2249-9880-4cb7-830b-ce6fe64ef150 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab44ee00-54a5-40ec-90eb-b6e52fc7a918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:20 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fcad2249-9880-4cb7-830b-ce6fe64ef150 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab44ee00-54a5-40ec-90eb-b6e52fc7a918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:29:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-813467001',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce8f9a84-989f-4e2f-ad18-ad88c4731c8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16429f2745354b0591f4044f3a99b9fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:29:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:29:20Z,use_quota=True,user_id='31dd51f2dcdd4724a4c6b78cb80e6d8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:20 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fcad2249-9880-4cb7-830b-ce6fe64ef150 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76817fcb-0e0c-46b8-9ca9-946ee32a9ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:20 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fcad2249-9880-4cb7-830b-ce6fe64ef150 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76817fcb-0e0c-46b8-9ca9-946ee32a9ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:20 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fcad2249-9880-4cb7-830b-ce6fe64ef150 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (889f3056-2c9d-447d-a404-4d04027d3d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:20 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fcad2249-9880-4cb7-830b-ce6fe64ef150 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (889f3056-2c9d-447d-a404-4d04027d3d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce8f9a84-989f-4e2f-ad18-ad88c4731c8f', 'volume_name': 'volume-ce8f9a84-989f-4e2f-ad18-ad88c4731c8f', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:20 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fcad2249-9880-4cb7-830b-ce6fe64ef150 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34eeb3e1-7ad3-45d7-a95c-0b0a3f9cb55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:20 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fcad2249-9880-4cb7-830b-ce6fe64ef150 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34eeb3e1-7ad3-45d7-a95c-0b0a3f9cb55a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:20 devstack sudo[106821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d848e64e-0132-492f-ae40-b97334eb11a0
Jul 03 01:29:20 devstack sudo[106821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:20 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fcad2249-9880-4cb7-830b-ce6fe64ef150 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b9dc05b-5ca4-49fc-b8d6-3f5c09196409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:20 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-fcad2249-9880-4cb7-830b-ce6fe64ef150 tempest-ProjectMemberTests-1866302072 None] Volume ce8f9a84-989f-4e2f-ad18-ad88c4731c8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce8f9a84-989f-4e2f-ad18-ad88c4731c8f', 'volume_size': 1}
Jul 03 01:29:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-fcad2249-9880-4cb7-830b-ce6fe64ef150 tempest-ProjectMemberTests-1866302072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:29:20 devstack sudo[106815]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6cd47b64-890f-40a1-84d6-f844a1767392 tempest-CreateVolumesFromImageTest-1460914073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cb8c509a-fa8d-4f58-b7a5-92fda1fbb589 1073741824" returned: 0 in 0.898s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6cd47b64-890f-40a1-84d6-f844a1767392 tempest-CreateVolumesFromImageTest-1460914073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cb8c509a-fa8d-4f58-b7a5-92fda1fbb589 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:20 devstack sudo[106826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cb8c509a-fa8d-4f58-b7a5-92fda1fbb589
Jul 03 01:29:20 devstack sudo[106826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:21 devstack sudo[106821]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-81f1ca81-aa6a-41d0-b7d6-2a0fb3ca6d69 tempest-CreateVolumesFromSnapshotTest-405548807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d848e64e-0132-492f-ae40-b97334eb11a0" returned: 0 in 0.835s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-81f1ca81-aa6a-41d0-b7d6-2a0fb3ca6d69 tempest-CreateVolumesFromSnapshotTest-405548807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d848e64e-0132-492f-ae40-b97334eb11a0 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:21 devstack sudo[106831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d848e64e-0132-492f-ae40-b97334eb11a0
Jul 03 01:29:21 devstack sudo[106831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:21 devstack sudo[106826]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6cd47b64-890f-40a1-84d6-f844a1767392 tempest-CreateVolumesFromImageTest-1460914073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cb8c509a-fa8d-4f58-b7a5-92fda1fbb589" returned: 0 in 0.705s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:21 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-6cd47b64-890f-40a1-84d6-f844a1767392 tempest-CreateVolumesFromImageTest-1460914073 None] <== create_volume: return (1647ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:29:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-6cd47b64-890f-40a1-84d6-f844a1767392 tempest-CreateVolumesFromImageTest-1460914073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.650s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:29:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-c59ea2f1-2aea-420d-a85e-b0fdf1c4ad0a tempest-CreateVolumesFromImageTest-1460914073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.826s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:29:21 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-c59ea2f1-2aea-420d-a85e-b0fdf1c4ad0a tempest-CreateVolumesFromImageTest-1460914073 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:29:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1462237974',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61e84693-88bb-4858-a643-05bf24da2f6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1598479cd5b64fa38b4bf40f1fd0703d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:29:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:29:13Z,use_quota=True,user_id='4616577780d94c31aeddf8f5ecdc6ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:29:21 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-c59ea2f1-2aea-420d-a85e-b0fdf1c4ad0a tempest-CreateVolumesFromImageTest-1460914073 None] Creating volume 61e84693-88bb-4858-a643-05bf24da2f6c {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:29:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-c59ea2f1-2aea-420d-a85e-b0fdf1c4ad0a tempest-CreateVolumesFromImageTest-1460914073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:29:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-c59ea2f1-2aea-420d-a85e-b0fdf1c4ad0a tempest-CreateVolumesFromImageTest-1460914073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:29:21 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-c59ea2f1-2aea-420d-a85e-b0fdf1c4ad0a tempest-CreateVolumesFromImageTest-1460914073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:29:21 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-c59ea2f1-2aea-420d-a85e-b0fdf1c4ad0a tempest-CreateVolumesFromImageTest-1460914073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:29:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-c59ea2f1-2aea-420d-a85e-b0fdf1c4ad0a tempest-CreateVolumesFromImageTest-1460914073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:29:21 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-c59ea2f1-2aea-420d-a85e-b0fdf1c4ad0a tempest-CreateVolumesFromImageTest-1460914073 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:29:21 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-c59ea2f1-2aea-420d-a85e-b0fdf1c4ad0a tempest-CreateVolumesFromImageTest-1460914073 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:29:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c59ea2f1-2aea-420d-a85e-b0fdf1c4ad0a tempest-CreateVolumesFromImageTest-1460914073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-61e84693-88bb-4858-a643-05bf24da2f6c 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:21 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-6cd47b64-890f-40a1-84d6-f844a1767392 tempest-CreateVolumesFromImageTest-1460914073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cc3914f-6574-47d8-a106-b1cf6d247b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb8c509a-fa8d-4f58-b7a5-92fda1fbb589', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:21 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-6cd47b64-890f-40a1-84d6-f844a1767392 tempest-CreateVolumesFromImageTest-1460914073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8304f8cb-9ecf-4d78-897d-ab7141a4a019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:21 devstack sudo[106834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-61e84693-88bb-4858-a643-05bf24da2f6c 1073741824
Jul 03 01:29:21 devstack sudo[106834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:21 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-6cd47b64-890f-40a1-84d6-f844a1767392 tempest-CreateVolumesFromImageTest-1460914073 None] Volume volume-cb8c509a-fa8d-4f58-b7a5-92fda1fbb589 (cb8c509a-fa8d-4f58-b7a5-92fda1fbb589): created successfully
Jul 03 01:29:21 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-6cd47b64-890f-40a1-84d6-f844a1767392 tempest-CreateVolumesFromImageTest-1460914073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8304f8cb-9ecf-4d78-897d-ab7141a4a019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:21 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-6cd47b64-890f-40a1-84d6-f844a1767392 tempest-CreateVolumesFromImageTest-1460914073 None] Flow 'volume_create_manager' (dff131e9-3f3a-498d-b0ed-0cfc9cf421a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:29:21 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-6cd47b64-890f-40a1-84d6-f844a1767392 tempest-CreateVolumesFromImageTest-1460914073 None] Created volume successfully.
Jul 03 01:29:21 devstack sudo[106831]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-81f1ca81-aa6a-41d0-b7d6-2a0fb3ca6d69 tempest-CreateVolumesFromSnapshotTest-405548807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d848e64e-0132-492f-ae40-b97334eb11a0" returned: 0 in 0.670s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:21 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-81f1ca81-aa6a-41d0-b7d6-2a0fb3ca6d69 tempest-CreateVolumesFromSnapshotTest-405548807 None] Lock "cinder-quobyte-d848e64e-0132-492f-ae40-b97334eb11a0" released by "delete_volume" :: held 1.583s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:29:21 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-81f1ca81-aa6a-41d0-b7d6-2a0fb3ca6d69 tempest-CreateVolumesFromSnapshotTest-405548807 None] Created reservations ['8f5f4447-7d21-4fe3-9f70-79d9057bfa5f', '94c1c076-100b-4856-8faa-204d2290a52a', '68df94bd-2b56-425a-a492-da5a11ae4843', '44c6c0c1-3043-4063-972e-a6799c8e4cc9'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:29:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-81f1ca81-aa6a-41d0-b7d6-2a0fb3ca6d69 tempest-CreateVolumesFromSnapshotTest-405548807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:29:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-81f1ca81-aa6a-41d0-b7d6-2a0fb3ca6d69 tempest-CreateVolumesFromSnapshotTest-405548807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:29:21 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-81f1ca81-aa6a-41d0-b7d6-2a0fb3ca6d69 tempest-CreateVolumesFromSnapshotTest-405548807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:29:21 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-81f1ca81-aa6a-41d0-b7d6-2a0fb3ca6d69 tempest-CreateVolumesFromSnapshotTest-405548807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:29:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-81f1ca81-aa6a-41d0-b7d6-2a0fb3ca6d69 tempest-CreateVolumesFromSnapshotTest-405548807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:29:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-81f1ca81-aa6a-41d0-b7d6-2a0fb3ca6d69 tempest-CreateVolumesFromSnapshotTest-405548807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:21 devstack sudo[106840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:29:21 devstack sudo[106840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:22 devstack sudo[106834]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:22 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c59ea2f1-2aea-420d-a85e-b0fdf1c4ad0a tempest-CreateVolumesFromImageTest-1460914073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-61e84693-88bb-4858-a643-05bf24da2f6c 1073741824" returned: 0 in 0.893s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:22 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c59ea2f1-2aea-420d-a85e-b0fdf1c4ad0a tempest-CreateVolumesFromImageTest-1460914073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-61e84693-88bb-4858-a643-05bf24da2f6c {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:22 devstack sudo[106843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-61e84693-88bb-4858-a643-05bf24da2f6c
Jul 03 01:29:22 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:22 devstack sudo[106840]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:22 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-81f1ca81-aa6a-41d0-b7d6-2a0fb3ca6d69 tempest-CreateVolumesFromSnapshotTest-405548807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.693s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:22 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-81f1ca81-aa6a-41d0-b7d6-2a0fb3ca6d69 tempest-CreateVolumesFromSnapshotTest-405548807 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:29:22 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-81f1ca81-aa6a-41d0-b7d6-2a0fb3ca6d69 tempest-CreateVolumesFromSnapshotTest-405548807 None] Deleted volume successfully.
Jul 03 01:29:22 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-81f1ca81-aa6a-41d0-b7d6-2a0fb3ca6d69 tempest-CreateVolumesFromSnapshotTest-405548807 None] Lock "cinder-d848e64e-0132-492f-ae40-b97334eb11a0-delete_volume" released by "delete_volume" :: held 2.528s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:29:22 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:22 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c59ea2f1-2aea-420d-a85e-b0fdf1c4ad0a tempest-CreateVolumesFromImageTest-1460914073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-61e84693-88bb-4858-a643-05bf24da2f6c" returned: 0 in 0.656s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:22 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-c59ea2f1-2aea-420d-a85e-b0fdf1c4ad0a tempest-CreateVolumesFromImageTest-1460914073 None] <== create_volume: return (1594ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:29:22 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-c59ea2f1-2aea-420d-a85e-b0fdf1c4ad0a tempest-CreateVolumesFromImageTest-1460914073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.596s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:29:22 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e71a60f7-ce5e-489e-88b5-d59a18199a8e tempest-CinderUnicodeTest-944587269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.768s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:29:22 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-e71a60f7-ce5e-489e-88b5-d59a18199a8e tempest-CinderUnicodeTest-944587269 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:29:15Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-163580895',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b64656d-2ed7-4b42-afa1-9b19032b38eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6acd06fd7fc942c0886251af963f5aad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:29:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:29:16Z,use_quota=True,user_id='4e593a77b8584ecaadff5fc4c6b6e8b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:29:22 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-e71a60f7-ce5e-489e-88b5-d59a18199a8e tempest-CinderUnicodeTest-944587269 None] Creating volume 0b64656d-2ed7-4b42-afa1-9b19032b38eb {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:29:22 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e71a60f7-ce5e-489e-88b5-d59a18199a8e tempest-CinderUnicodeTest-944587269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:29:22 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e71a60f7-ce5e-489e-88b5-d59a18199a8e tempest-CinderUnicodeTest-944587269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:29:22 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-e71a60f7-ce5e-489e-88b5-d59a18199a8e tempest-CinderUnicodeTest-944587269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:29:22 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-e71a60f7-ce5e-489e-88b5-d59a18199a8e tempest-CinderUnicodeTest-944587269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:29:22 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e71a60f7-ce5e-489e-88b5-d59a18199a8e tempest-CinderUnicodeTest-944587269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:29:22 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-e71a60f7-ce5e-489e-88b5-d59a18199a8e tempest-CinderUnicodeTest-944587269 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:29:22 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-e71a60f7-ce5e-489e-88b5-d59a18199a8e tempest-CinderUnicodeTest-944587269 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:29:22 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e71a60f7-ce5e-489e-88b5-d59a18199a8e tempest-CinderUnicodeTest-944587269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0b64656d-2ed7-4b42-afa1-9b19032b38eb 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:22 devstack sudo[106847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0b64656d-2ed7-4b42-afa1-9b19032b38eb 1073741824
Jul 03 01:29:22 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c59ea2f1-2aea-420d-a85e-b0fdf1c4ad0a tempest-CreateVolumesFromImageTest-1460914073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b5d64aa-1970-476a-8870-ae274ad3c863) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61e84693-88bb-4858-a643-05bf24da2f6c', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:22 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:22 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c59ea2f1-2aea-420d-a85e-b0fdf1c4ad0a tempest-CreateVolumesFromImageTest-1460914073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b060780-6368-4776-b7ab-7d7eaa8f79bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:22 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-c59ea2f1-2aea-420d-a85e-b0fdf1c4ad0a tempest-CreateVolumesFromImageTest-1460914073 None] Volume volume-61e84693-88bb-4858-a643-05bf24da2f6c (61e84693-88bb-4858-a643-05bf24da2f6c): created successfully
Jul 03 01:29:22 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c59ea2f1-2aea-420d-a85e-b0fdf1c4ad0a tempest-CreateVolumesFromImageTest-1460914073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b060780-6368-4776-b7ab-7d7eaa8f79bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:22 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c59ea2f1-2aea-420d-a85e-b0fdf1c4ad0a tempest-CreateVolumesFromImageTest-1460914073 None] Flow 'volume_create_manager' (1d96e94e-37cc-4d81-bea7-37f338ddd137) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:29:22 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-c59ea2f1-2aea-420d-a85e-b0fdf1c4ad0a tempest-CreateVolumesFromImageTest-1460914073 None] Created volume successfully.
Jul 03 01:29:23 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e71a60f7-ce5e-489e-88b5-d59a18199a8e tempest-CinderUnicodeTest-944587269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0b64656d-2ed7-4b42-afa1-9b19032b38eb 1073741824" returned: 0 in 0.924s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e71a60f7-ce5e-489e-88b5-d59a18199a8e tempest-CinderUnicodeTest-944587269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0b64656d-2ed7-4b42-afa1-9b19032b38eb {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:23 devstack sudo[106853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0b64656d-2ed7-4b42-afa1-9b19032b38eb
Jul 03 01:29:23 devstack sudo[106853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:24 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e3376eff-b912-4313-abe0-cf9252eb5cab tempest-CreateVolumesFromImageTest-1460914073 None] Acquiring lock "cinder-61e84693-88bb-4858-a643-05bf24da2f6c-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:29:24 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e3376eff-b912-4313-abe0-cf9252eb5cab tempest-CreateVolumesFromImageTest-1460914073 None] Lock "cinder-61e84693-88bb-4858-a643-05bf24da2f6c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:29:24 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e3376eff-b912-4313-abe0-cf9252eb5cab tempest-CreateVolumesFromImageTest-1460914073 None] Acquiring lock "cinder-quobyte-61e84693-88bb-4858-a643-05bf24da2f6c" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:29:24 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e3376eff-b912-4313-abe0-cf9252eb5cab tempest-CreateVolumesFromImageTest-1460914073 None] Lock "cinder-quobyte-61e84693-88bb-4858-a643-05bf24da2f6c" acquired by "delete_volume" :: waited 0.025s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:29:24 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b156e75-ecec-441d-a57b-126d72a09dcb]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:29:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e3376eff-b912-4313-abe0-cf9252eb5cab tempest-CreateVolumesFromImageTest-1460914073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-61e84693-88bb-4858-a643-05bf24da2f6c {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:24 devstack sudo[106855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-61e84693-88bb-4858-a643-05bf24da2f6c
Jul 03 01:29:24 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:24 devstack sudo[106853]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e71a60f7-ce5e-489e-88b5-d59a18199a8e tempest-CinderUnicodeTest-944587269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0b64656d-2ed7-4b42-afa1-9b19032b38eb" returned: 0 in 0.759s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:24 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-e71a60f7-ce5e-489e-88b5-d59a18199a8e tempest-CinderUnicodeTest-944587269 None] <== create_volume: return (1729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:29:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e71a60f7-ce5e-489e-88b5-d59a18199a8e tempest-CinderUnicodeTest-944587269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.733s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:29:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-fcad2249-9880-4cb7-830b-ce6fe64ef150 tempest-ProjectMemberTests-1866302072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.189s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:29:24 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-fcad2249-9880-4cb7-830b-ce6fe64ef150 tempest-ProjectMemberTests-1866302072 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:29:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-813467001',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce8f9a84-989f-4e2f-ad18-ad88c4731c8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16429f2745354b0591f4044f3a99b9fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:29:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:29:20Z,use_quota=True,user_id='31dd51f2dcdd4724a4c6b78cb80e6d8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:29:24 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-fcad2249-9880-4cb7-830b-ce6fe64ef150 tempest-ProjectMemberTests-1866302072 None] Creating volume ce8f9a84-989f-4e2f-ad18-ad88c4731c8f {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:29:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-fcad2249-9880-4cb7-830b-ce6fe64ef150 tempest-ProjectMemberTests-1866302072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:29:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-fcad2249-9880-4cb7-830b-ce6fe64ef150 tempest-ProjectMemberTests-1866302072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:29:24 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-fcad2249-9880-4cb7-830b-ce6fe64ef150 tempest-ProjectMemberTests-1866302072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:29:24 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-fcad2249-9880-4cb7-830b-ce6fe64ef150 tempest-ProjectMemberTests-1866302072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:29:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-fcad2249-9880-4cb7-830b-ce6fe64ef150 tempest-ProjectMemberTests-1866302072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:29:24 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-fcad2249-9880-4cb7-830b-ce6fe64ef150 tempest-ProjectMemberTests-1866302072 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:29:24 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-fcad2249-9880-4cb7-830b-ce6fe64ef150 tempest-ProjectMemberTests-1866302072 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:29:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-fcad2249-9880-4cb7-830b-ce6fe64ef150 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ce8f9a84-989f-4e2f-ad18-ad88c4731c8f 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:24 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e71a60f7-ce5e-489e-88b5-d59a18199a8e tempest-CinderUnicodeTest-944587269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7389695e-ebc0-47f4-aeb8-0a4292859285) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b64656d-2ed7-4b42-afa1-9b19032b38eb', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:24 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e71a60f7-ce5e-489e-88b5-d59a18199a8e tempest-CinderUnicodeTest-944587269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1ff43cf-533b-4a60-9204-0375b4ec85c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:24 devstack sudo[106858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ce8f9a84-989f-4e2f-ad18-ad88c4731c8f 1073741824
Jul 03 01:29:24 devstack sudo[106858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:24 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-e71a60f7-ce5e-489e-88b5-d59a18199a8e tempest-CinderUnicodeTest-944587269 None] Volume volume-0b64656d-2ed7-4b42-afa1-9b19032b38eb (0b64656d-2ed7-4b42-afa1-9b19032b38eb): created successfully
Jul 03 01:29:24 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e71a60f7-ce5e-489e-88b5-d59a18199a8e tempest-CinderUnicodeTest-944587269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1ff43cf-533b-4a60-9204-0375b4ec85c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:24 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e71a60f7-ce5e-489e-88b5-d59a18199a8e tempest-CinderUnicodeTest-944587269 None] Flow 'volume_create_manager' (b543251e-a379-44b8-b19b-ce2b7efddae6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:29:24 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-e71a60f7-ce5e-489e-88b5-d59a18199a8e tempest-CinderUnicodeTest-944587269 None] Created volume successfully.
Jul 03 01:29:25 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e3376eff-b912-4313-abe0-cf9252eb5cab tempest-CreateVolumesFromImageTest-1460914073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-61e84693-88bb-4858-a643-05bf24da2f6c" returned: 0 in 0.840s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e3376eff-b912-4313-abe0-cf9252eb5cab tempest-CreateVolumesFromImageTest-1460914073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-61e84693-88bb-4858-a643-05bf24da2f6c {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:25 devstack sudo[106863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-61e84693-88bb-4858-a643-05bf24da2f6c
Jul 03 01:29:25 devstack sudo[106863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:25 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-eaa25d3c-028c-4319-8ffa-e5cf077d0727 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:29:25 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-eaa25d3c-028c-4319-8ffa-e5cf077d0727 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Flow 'volume_create_manager' (277a0271-241a-4727-8cb1-449e2e59e596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:29:25 devstack sudo[106858]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:25 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-eaa25d3c-028c-4319-8ffa-e5cf077d0727 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d385b42-9657-4ddc-9194-9ee516981e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-fcad2249-9880-4cb7-830b-ce6fe64ef150 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ce8f9a84-989f-4e2f-ad18-ad88c4731c8f 1073741824" returned: 0 in 1.002s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:25 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-eaa25d3c-028c-4319-8ffa-e5cf077d0727 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d385b42-9657-4ddc-9194-9ee516981e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:29:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2022541810',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89e84a6b-e2d8-4afe-a1eb-7cb1d26e1a20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7562a5d9f07246b5b75ad948296e0626',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:29:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:29:25Z,use_quota=True,user_id='dd43700199e94ef8abd57ba8f111fba6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:25 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-eaa25d3c-028c-4319-8ffa-e5cf077d0727 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a42e61b7-4cb1-455a-ae97-318822d62d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:25 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-eaa25d3c-028c-4319-8ffa-e5cf077d0727 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a42e61b7-4cb1-455a-ae97-318822d62d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:25 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-eaa25d3c-028c-4319-8ffa-e5cf077d0727 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f304989-40be-460b-a7b7-942f3992256b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:25 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-eaa25d3c-028c-4319-8ffa-e5cf077d0727 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f304989-40be-460b-a7b7-942f3992256b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89e84a6b-e2d8-4afe-a1eb-7cb1d26e1a20', 'volume_name': 'volume-89e84a6b-e2d8-4afe-a1eb-7cb1d26e1a20', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:25 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-eaa25d3c-028c-4319-8ffa-e5cf077d0727 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6a1842c-16b8-4ac6-8f74-3d441ba845dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:25 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-eaa25d3c-028c-4319-8ffa-e5cf077d0727 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6a1842c-16b8-4ac6-8f74-3d441ba845dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:25 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-eaa25d3c-028c-4319-8ffa-e5cf077d0727 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (738d43d1-66bb-4671-8ff6-b95d61d2cbe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:25 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-eaa25d3c-028c-4319-8ffa-e5cf077d0727 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Volume 89e84a6b-e2d8-4afe-a1eb-7cb1d26e1a20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89e84a6b-e2d8-4afe-a1eb-7cb1d26e1a20', 'volume_size': 1}
Jul 03 01:29:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-eaa25d3c-028c-4319-8ffa-e5cf077d0727 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:29:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-fcad2249-9880-4cb7-830b-ce6fe64ef150 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ce8f9a84-989f-4e2f-ad18-ad88c4731c8f {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:25 devstack sudo[106870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ce8f9a84-989f-4e2f-ad18-ad88c4731c8f
Jul 03 01:29:25 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-6ec5dffd-5506-42a7-8ead-94e8b8b5db70 tempest-CinderUnicodeTest-944587269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:29:25 devstack sudo[106863]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e3376eff-b912-4313-abe0-cf9252eb5cab tempest-CreateVolumesFromImageTest-1460914073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-61e84693-88bb-4858-a643-05bf24da2f6c" returned: 0 in 0.823s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:25 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e3376eff-b912-4313-abe0-cf9252eb5cab tempest-CreateVolumesFromImageTest-1460914073 None] Lock "cinder-quobyte-61e84693-88bb-4858-a643-05bf24da2f6c" released by "delete_volume" :: held 1.729s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:29:26 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-e3376eff-b912-4313-abe0-cf9252eb5cab tempest-CreateVolumesFromImageTest-1460914073 None] Created reservations ['db594e77-f966-468d-b06a-9108970673cb', '04a17c58-56fc-437d-b15f-b8bbb3e9c852', '2ee75f59-0e1d-4473-a7e7-e62226316d1d', '0fbd3f33-0c94-4679-adad-9a6133fbd51a'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:29:26 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e3376eff-b912-4313-abe0-cf9252eb5cab tempest-CreateVolumesFromImageTest-1460914073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:29:26 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e3376eff-b912-4313-abe0-cf9252eb5cab tempest-CreateVolumesFromImageTest-1460914073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:29:26 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-e3376eff-b912-4313-abe0-cf9252eb5cab tempest-CreateVolumesFromImageTest-1460914073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:29:26 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-e3376eff-b912-4313-abe0-cf9252eb5cab tempest-CreateVolumesFromImageTest-1460914073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:29:26 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e3376eff-b912-4313-abe0-cf9252eb5cab tempest-CreateVolumesFromImageTest-1460914073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:29:26 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e3376eff-b912-4313-abe0-cf9252eb5cab tempest-CreateVolumesFromImageTest-1460914073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:26 devstack sudo[106873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:29:26 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:26 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-eccc3570-5336-41e5-900a-e1d84e90ff2d tempest-CreateVolumesFromImageTest-1460914073 None] Acquiring lock "cinder-cb8c509a-fa8d-4f58-b7a5-92fda1fbb589-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:29:26 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:26 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-fcad2249-9880-4cb7-830b-ce6fe64ef150 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ce8f9a84-989f-4e2f-ad18-ad88c4731c8f" returned: 0 in 0.727s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:26 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-fcad2249-9880-4cb7-830b-ce6fe64ef150 tempest-ProjectMemberTests-1866302072 None] <== create_volume: return (1828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:29:26 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-fcad2249-9880-4cb7-830b-ce6fe64ef150 tempest-ProjectMemberTests-1866302072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.831s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:29:26 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-eaa25d3c-028c-4319-8ffa-e5cf077d0727 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.758s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:29:26 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-eaa25d3c-028c-4319-8ffa-e5cf077d0727 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:29:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2022541810',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89e84a6b-e2d8-4afe-a1eb-7cb1d26e1a20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7562a5d9f07246b5b75ad948296e0626',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:29:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:29:25Z,use_quota=True,user_id='dd43700199e94ef8abd57ba8f111fba6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:29:26 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-eaa25d3c-028c-4319-8ffa-e5cf077d0727 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Creating volume 89e84a6b-e2d8-4afe-a1eb-7cb1d26e1a20 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:29:26 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-eaa25d3c-028c-4319-8ffa-e5cf077d0727 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:29:26 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-eaa25d3c-028c-4319-8ffa-e5cf077d0727 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:29:26 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-eaa25d3c-028c-4319-8ffa-e5cf077d0727 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:29:26 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-eaa25d3c-028c-4319-8ffa-e5cf077d0727 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:29:26 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-eaa25d3c-028c-4319-8ffa-e5cf077d0727 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:29:26 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-eaa25d3c-028c-4319-8ffa-e5cf077d0727 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:29:26 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-eaa25d3c-028c-4319-8ffa-e5cf077d0727 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:29:26 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-eaa25d3c-028c-4319-8ffa-e5cf077d0727 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-89e84a6b-e2d8-4afe-a1eb-7cb1d26e1a20 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:26 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fcad2249-9880-4cb7-830b-ce6fe64ef150 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b9dc05b-5ca4-49fc-b8d6-3f5c09196409) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce8f9a84-989f-4e2f-ad18-ad88c4731c8f', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:26 devstack sudo[106876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-89e84a6b-e2d8-4afe-a1eb-7cb1d26e1a20 1073741824
Jul 03 01:29:26 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:26 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fcad2249-9880-4cb7-830b-ce6fe64ef150 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eefbba22-153e-437b-ab4e-68d851bf9230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:26 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-eccc3570-5336-41e5-900a-e1d84e90ff2d tempest-CreateVolumesFromImageTest-1460914073 None] Lock "cinder-cb8c509a-fa8d-4f58-b7a5-92fda1fbb589-delete_volume" acquired by "delete_volume" :: waited 0.098s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:29:26 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-fcad2249-9880-4cb7-830b-ce6fe64ef150 tempest-ProjectMemberTests-1866302072 None] Volume volume-ce8f9a84-989f-4e2f-ad18-ad88c4731c8f (ce8f9a84-989f-4e2f-ad18-ad88c4731c8f): created successfully
Jul 03 01:29:26 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fcad2249-9880-4cb7-830b-ce6fe64ef150 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eefbba22-153e-437b-ab4e-68d851bf9230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:26 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-fcad2249-9880-4cb7-830b-ce6fe64ef150 tempest-ProjectMemberTests-1866302072 None] Flow 'volume_create_manager' (a4159adc-99ff-4bb1-835a-b1f4ca0d998a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:29:26 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-fcad2249-9880-4cb7-830b-ce6fe64ef150 tempest-ProjectMemberTests-1866302072 None] Created volume successfully.
Jul 03 01:29:26 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-eccc3570-5336-41e5-900a-e1d84e90ff2d tempest-CreateVolumesFromImageTest-1460914073 None] Acquiring lock "cinder-quobyte-cb8c509a-fa8d-4f58-b7a5-92fda1fbb589" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:29:26 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-eccc3570-5336-41e5-900a-e1d84e90ff2d tempest-CreateVolumesFromImageTest-1460914073 None] Lock "cinder-quobyte-cb8c509a-fa8d-4f58-b7a5-92fda1fbb589" acquired by "delete_volume" :: waited 0.019s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:29:26 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[97317dc5-d8af-4b11-b10b-266be2d4e81f]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:29:26 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-eccc3570-5336-41e5-900a-e1d84e90ff2d tempest-CreateVolumesFromImageTest-1460914073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cb8c509a-fa8d-4f58-b7a5-92fda1fbb589 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:26 devstack sudo[106878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cb8c509a-fa8d-4f58-b7a5-92fda1fbb589
Jul 03 01:29:26 devstack sudo[106878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:26 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:26 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e3376eff-b912-4313-abe0-cf9252eb5cab tempest-CreateVolumesFromImageTest-1460914073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.760s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:26 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-e3376eff-b912-4313-abe0-cf9252eb5cab tempest-CreateVolumesFromImageTest-1460914073 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:29:26 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-e3376eff-b912-4313-abe0-cf9252eb5cab tempest-CreateVolumesFromImageTest-1460914073 None] Deleted volume successfully.
Jul 03 01:29:26 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e3376eff-b912-4313-abe0-cf9252eb5cab tempest-CreateVolumesFromImageTest-1460914073 None] Lock "cinder-61e84693-88bb-4858-a643-05bf24da2f6c-delete_volume" released by "delete_volume" :: held 2.715s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:29:27 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-eaa25d3c-028c-4319-8ffa-e5cf077d0727 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-89e84a6b-e2d8-4afe-a1eb-7cb1d26e1a20 1073741824" returned: 0 in 0.885s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-eaa25d3c-028c-4319-8ffa-e5cf077d0727 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-89e84a6b-e2d8-4afe-a1eb-7cb1d26e1a20 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:27 devstack sudo[106887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-89e84a6b-e2d8-4afe-a1eb-7cb1d26e1a20
Jul 03 01:29:27 devstack sudo[106887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:27 devstack sudo[106878]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-eccc3570-5336-41e5-900a-e1d84e90ff2d tempest-CreateVolumesFromImageTest-1460914073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cb8c509a-fa8d-4f58-b7a5-92fda1fbb589" returned: 0 in 0.839s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-eccc3570-5336-41e5-900a-e1d84e90ff2d tempest-CreateVolumesFromImageTest-1460914073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cb8c509a-fa8d-4f58-b7a5-92fda1fbb589 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:27 devstack sudo[106889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cb8c509a-fa8d-4f58-b7a5-92fda1fbb589
Jul 03 01:29:27 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-26515073-ac67-4f6b-821d-04a6ce1992b2 tempest-ProjectMemberTests-1866302072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:29:28 devstack sudo[106887]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:28 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-eaa25d3c-028c-4319-8ffa-e5cf077d0727 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-89e84a6b-e2d8-4afe-a1eb-7cb1d26e1a20" returned: 0 in 0.690s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:28 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-eaa25d3c-028c-4319-8ffa-e5cf077d0727 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] <== create_volume: return (1624ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:29:28 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-eaa25d3c-028c-4319-8ffa-e5cf077d0727 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.628s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:29:28 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-6ec5dffd-5506-42a7-8ead-94e8b8b5db70 tempest-CinderUnicodeTest-944587269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.282s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:29:28 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-6ec5dffd-5506-42a7-8ead-94e8b8b5db70 tempest-CinderUnicodeTest-944587269 None] Creating offline snapshot 49f171a2-3c11-4fa2-9147-453bd457d086 of volume 0b64656d-2ed7-4b42-afa1-9b19032b38eb {{(pid=86891) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 01:29:28 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-eaa25d3c-028c-4319-8ffa-e5cf077d0727 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (738d43d1-66bb-4671-8ff6-b95d61d2cbe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89e84a6b-e2d8-4afe-a1eb-7cb1d26e1a20', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:28 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-eaa25d3c-028c-4319-8ffa-e5cf077d0727 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7873029b-ee6e-410d-9c62-2dda9bd82658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:28 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9a858d-c75a-424b-a663-af6dab2f0a0f]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:29:28 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6ec5dffd-5506-42a7-8ead-94e8b8b5db70 tempest-CinderUnicodeTest-944587269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0b64656d-2ed7-4b42-afa1-9b19032b38eb {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:28 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-eaa25d3c-028c-4319-8ffa-e5cf077d0727 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Volume volume-89e84a6b-e2d8-4afe-a1eb-7cb1d26e1a20 (89e84a6b-e2d8-4afe-a1eb-7cb1d26e1a20): created successfully
Jul 03 01:29:28 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-eaa25d3c-028c-4319-8ffa-e5cf077d0727 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7873029b-ee6e-410d-9c62-2dda9bd82658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:28 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-eaa25d3c-028c-4319-8ffa-e5cf077d0727 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Flow 'volume_create_manager' (277a0271-241a-4727-8cb1-449e2e59e596) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:29:28 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-eaa25d3c-028c-4319-8ffa-e5cf077d0727 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Created volume successfully.
Jul 03 01:29:28 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:28 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-eccc3570-5336-41e5-900a-e1d84e90ff2d tempest-CreateVolumesFromImageTest-1460914073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-cb8c509a-fa8d-4f58-b7a5-92fda1fbb589" returned: 0 in 0.716s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:28 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-eccc3570-5336-41e5-900a-e1d84e90ff2d tempest-CreateVolumesFromImageTest-1460914073 None] Lock "cinder-quobyte-cb8c509a-fa8d-4f58-b7a5-92fda1fbb589" released by "delete_volume" :: held 1.609s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:29:28 devstack sudo[106893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0b64656d-2ed7-4b42-afa1-9b19032b38eb
Jul 03 01:29:28 devstack sudo[106893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:28 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-eccc3570-5336-41e5-900a-e1d84e90ff2d tempest-CreateVolumesFromImageTest-1460914073 None] Created reservations ['fd482230-22eb-43bb-8a13-57f36ab0954a', '366cbb1b-f0b9-4103-83c0-2836fd2f283e', '88c2c433-b1a8-440e-92ec-744a7ce949a1', '53c4444b-79aa-4293-998b-59fd938c0605'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:29:28 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-eccc3570-5336-41e5-900a-e1d84e90ff2d tempest-CreateVolumesFromImageTest-1460914073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:29:28 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-eccc3570-5336-41e5-900a-e1d84e90ff2d tempest-CreateVolumesFromImageTest-1460914073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:29:28 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-eccc3570-5336-41e5-900a-e1d84e90ff2d tempest-CreateVolumesFromImageTest-1460914073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:29:28 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-eccc3570-5336-41e5-900a-e1d84e90ff2d tempest-CreateVolumesFromImageTest-1460914073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:29:28 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-eccc3570-5336-41e5-900a-e1d84e90ff2d tempest-CreateVolumesFromImageTest-1460914073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:29:28 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-eccc3570-5336-41e5-900a-e1d84e90ff2d tempest-CreateVolumesFromImageTest-1460914073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:28 devstack sudo[106895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:29:28 devstack sudo[106895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:28 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-58522782-3a16-4f3e-9d36-04a0ef2f7dcb tempest-CreateVolumesFromImageTest-1460914073 None] Acquiring lock "cinder-0471779b-dd0b-4589-9550-26b7134d0b97-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:29:28 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-58522782-3a16-4f3e-9d36-04a0ef2f7dcb tempest-CreateVolumesFromImageTest-1460914073 None] Lock "cinder-0471779b-dd0b-4589-9550-26b7134d0b97-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:29:28 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-58522782-3a16-4f3e-9d36-04a0ef2f7dcb tempest-CreateVolumesFromImageTest-1460914073 None] Acquiring lock "cinder-quobyte-0471779b-dd0b-4589-9550-26b7134d0b97" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:29:28 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-58522782-3a16-4f3e-9d36-04a0ef2f7dcb tempest-CreateVolumesFromImageTest-1460914073 None] Lock "cinder-quobyte-0471779b-dd0b-4589-9550-26b7134d0b97" acquired by "delete_volume" :: waited 0.024s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:29:28 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a1dd08-deda-43c1-84d1-885714938dc1]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:29:28 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-58522782-3a16-4f3e-9d36-04a0ef2f7dcb tempest-CreateVolumesFromImageTest-1460914073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0471779b-dd0b-4589-9550-26b7134d0b97 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:29 devstack sudo[106893]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6ec5dffd-5506-42a7-8ead-94e8b8b5db70 tempest-CinderUnicodeTest-944587269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0b64656d-2ed7-4b42-afa1-9b19032b38eb" returned: 0 in 0.929s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6ec5dffd-5506-42a7-8ead-94e8b8b5db70 tempest-CinderUnicodeTest-944587269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0b64656d-2ed7-4b42-afa1-9b19032b38eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0b64656d-2ed7-4b42-afa1-9b19032b38eb.49f171a2-3c11-4fa2-9147-453bd457d086 1G {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:29 devstack sudo[106902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0471779b-dd0b-4589-9550-26b7134d0b97
Jul 03 01:29:29 devstack sudo[106902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:29 devstack sudo[106895]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-eccc3570-5336-41e5-900a-e1d84e90ff2d tempest-CreateVolumesFromImageTest-1460914073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.758s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:29 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-eccc3570-5336-41e5-900a-e1d84e90ff2d tempest-CreateVolumesFromImageTest-1460914073 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:29:29 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-eccc3570-5336-41e5-900a-e1d84e90ff2d tempest-CreateVolumesFromImageTest-1460914073 None] Deleted volume successfully.
Jul 03 01:29:29 devstack sudo[106905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0b64656d-2ed7-4b42-afa1-9b19032b38eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0b64656d-2ed7-4b42-afa1-9b19032b38eb.49f171a2-3c11-4fa2-9147-453bd457d086 1G
Jul 03 01:29:29 devstack sudo[106905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:29 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-eccc3570-5336-41e5-900a-e1d84e90ff2d tempest-CreateVolumesFromImageTest-1460914073 None] Lock "cinder-cb8c509a-fa8d-4f58-b7a5-92fda1fbb589-delete_volume" released by "delete_volume" :: held 2.604s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:29:29 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3ac39aa-2ac5-4751-a9c0-d62c96081799 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:29:29 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e3ac39aa-2ac5-4751-a9c0-d62c96081799 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Flow 'volume_create_manager' (ae8b195e-6f90-488e-8b6e-773b57fa95d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:29:29 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e3ac39aa-2ac5-4751-a9c0-d62c96081799 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0cb0368-26de-4971-bb0b-d382d50b1475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:29 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e3ac39aa-2ac5-4751-a9c0-d62c96081799 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0cb0368-26de-4971-bb0b-d382d50b1475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:29:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-960122033',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19a337b0-6359-40aa-97a2-6dc2985702e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7562a5d9f07246b5b75ad948296e0626',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:29:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:29:29Z,use_quota=True,user_id='dd43700199e94ef8abd57ba8f111fba6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:29 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e3ac39aa-2ac5-4751-a9c0-d62c96081799 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a6b71a5-181f-4970-931a-b307907bdb6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:29 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e3ac39aa-2ac5-4751-a9c0-d62c96081799 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a6b71a5-181f-4970-931a-b307907bdb6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:29 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e3ac39aa-2ac5-4751-a9c0-d62c96081799 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (690c9068-95e0-45ed-a550-56e2c82509e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:29 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e3ac39aa-2ac5-4751-a9c0-d62c96081799 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (690c9068-95e0-45ed-a550-56e2c82509e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19a337b0-6359-40aa-97a2-6dc2985702e0', 'volume_name': 'volume-19a337b0-6359-40aa-97a2-6dc2985702e0', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:29 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e3ac39aa-2ac5-4751-a9c0-d62c96081799 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81b46c2f-91ed-42b8-ae03-1839179e7cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:29 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e3ac39aa-2ac5-4751-a9c0-d62c96081799 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81b46c2f-91ed-42b8-ae03-1839179e7cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:29 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e3ac39aa-2ac5-4751-a9c0-d62c96081799 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8537c0c9-c7a6-4fe4-8085-5c13f1f1461f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:29 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-e3ac39aa-2ac5-4751-a9c0-d62c96081799 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Volume 19a337b0-6359-40aa-97a2-6dc2985702e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19a337b0-6359-40aa-97a2-6dc2985702e0', 'volume_size': 1}
Jul 03 01:29:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e3ac39aa-2ac5-4751-a9c0-d62c96081799 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:29:29 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d2d697b-1d67-4cca-b3e3-23960f3fbfb1 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:29:29 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-4d2d697b-1d67-4cca-b3e3-23960f3fbfb1 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Flow 'volume_create_manager' (1e339fa5-264f-4b51-8eb5-48f48afa0563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:29:29 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-4d2d697b-1d67-4cca-b3e3-23960f3fbfb1 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b585d276-9406-41cb-8e91-7916d52f86f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:29 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-4d2d697b-1d67-4cca-b3e3-23960f3fbfb1 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b585d276-9406-41cb-8e91-7916d52f86f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:29:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1748003999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57bcf82c-b865-4e5c-af57-9893c97541f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7562a5d9f07246b5b75ad948296e0626',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:29:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:29:30Z,use_quota=True,user_id='dd43700199e94ef8abd57ba8f111fba6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:29 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-4d2d697b-1d67-4cca-b3e3-23960f3fbfb1 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eeaa148-38cb-4600-b226-cb609ac132cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:29 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-4d2d697b-1d67-4cca-b3e3-23960f3fbfb1 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eeaa148-38cb-4600-b226-cb609ac132cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:29 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-4d2d697b-1d67-4cca-b3e3-23960f3fbfb1 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df35b4ee-668a-48b4-a589-6603887576e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:29 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-4d2d697b-1d67-4cca-b3e3-23960f3fbfb1 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df35b4ee-668a-48b4-a589-6603887576e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57bcf82c-b865-4e5c-af57-9893c97541f9', 'volume_name': 'volume-57bcf82c-b865-4e5c-af57-9893c97541f9', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:29 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-4d2d697b-1d67-4cca-b3e3-23960f3fbfb1 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c57a830c-8885-4818-9ae4-d9b353e4d95d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:29 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-4d2d697b-1d67-4cca-b3e3-23960f3fbfb1 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c57a830c-8885-4818-9ae4-d9b353e4d95d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:29 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-4d2d697b-1d67-4cca-b3e3-23960f3fbfb1 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b0ff995-7314-46db-bcd8-e17700ac2bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:29 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-4d2d697b-1d67-4cca-b3e3-23960f3fbfb1 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Volume 57bcf82c-b865-4e5c-af57-9893c97541f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57bcf82c-b865-4e5c-af57-9893c97541f9', 'volume_size': 1}
Jul 03 01:29:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-4d2d697b-1d67-4cca-b3e3-23960f3fbfb1 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:29:29 devstack sudo[106902]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-58522782-3a16-4f3e-9d36-04a0ef2f7dcb tempest-CreateVolumesFromImageTest-1460914073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0471779b-dd0b-4589-9550-26b7134d0b97" returned: 0 in 1.032s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-58522782-3a16-4f3e-9d36-04a0ef2f7dcb tempest-CreateVolumesFromImageTest-1460914073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0471779b-dd0b-4589-9550-26b7134d0b97 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:29 devstack sudo[106914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0471779b-dd0b-4589-9550-26b7134d0b97
Jul 03 01:29:29 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:30 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cfcc05b-fd16-4b3b-a66c-6af5b127b37b tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:29:30 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-9cfcc05b-fd16-4b3b-a66c-6af5b127b37b tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Flow 'volume_create_manager' (8b99f197-9013-485a-abcf-7139dcdf451b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:29:30 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-9cfcc05b-fd16-4b3b-a66c-6af5b127b37b tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18400dce-bd46-4ca5-bf7d-472ed7a5fc14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:30 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-9cfcc05b-fd16-4b3b-a66c-6af5b127b37b tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18400dce-bd46-4ca5-bf7d-472ed7a5fc14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:29:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1002498726',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96891ab7-8b12-46cc-87ae-fd4eeb8149cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7562a5d9f07246b5b75ad948296e0626',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:29:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:29:30Z,use_quota=True,user_id='dd43700199e94ef8abd57ba8f111fba6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:30 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-9cfcc05b-fd16-4b3b-a66c-6af5b127b37b tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6668a2e-7dda-47e6-9592-08aac63492df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:30 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-9cfcc05b-fd16-4b3b-a66c-6af5b127b37b tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6668a2e-7dda-47e6-9592-08aac63492df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:30 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-9cfcc05b-fd16-4b3b-a66c-6af5b127b37b tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3da78b18-c243-4910-ae8b-6c3c2038bf8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:30 devstack sudo[106905]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:30 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-9cfcc05b-fd16-4b3b-a66c-6af5b127b37b tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3da78b18-c243-4910-ae8b-6c3c2038bf8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96891ab7-8b12-46cc-87ae-fd4eeb8149cb', 'volume_name': 'volume-96891ab7-8b12-46cc-87ae-fd4eeb8149cb', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:30 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-9cfcc05b-fd16-4b3b-a66c-6af5b127b37b tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07c4af99-a059-4698-90d9-df85f89e9bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:30 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-9cfcc05b-fd16-4b3b-a66c-6af5b127b37b tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07c4af99-a059-4698-90d9-df85f89e9bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:30 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-9cfcc05b-fd16-4b3b-a66c-6af5b127b37b tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54bac5d5-c7b3-4a39-a559-604a4e214444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:30 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-9cfcc05b-fd16-4b3b-a66c-6af5b127b37b tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Volume 96891ab7-8b12-46cc-87ae-fd4eeb8149cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96891ab7-8b12-46cc-87ae-fd4eeb8149cb', 'volume_size': 1}
Jul 03 01:29:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-9cfcc05b-fd16-4b3b-a66c-6af5b127b37b tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:29:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6ec5dffd-5506-42a7-8ead-94e8b8b5db70 tempest-CinderUnicodeTest-944587269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0b64656d-2ed7-4b42-afa1-9b19032b38eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0b64656d-2ed7-4b42-afa1-9b19032b38eb.49f171a2-3c11-4fa2-9147-453bd457d086 1G" returned: 0 in 1.219s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6ec5dffd-5506-42a7-8ead-94e8b8b5db70 tempest-CinderUnicodeTest-944587269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b64656d-2ed7-4b42-afa1-9b19032b38eb -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0b64656d-2ed7-4b42-afa1-9b19032b38eb.49f171a2-3c11-4fa2-9147-453bd457d086 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:30 devstack sudo[106916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b64656d-2ed7-4b42-afa1-9b19032b38eb -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0b64656d-2ed7-4b42-afa1-9b19032b38eb.49f171a2-3c11-4fa2-9147-453bd457d086
Jul 03 01:29:30 devstack sudo[106916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:30 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-228d95f3-2178-444e-b69b-68b947bb6520 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:29:30 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-228d95f3-2178-444e-b69b-68b947bb6520 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Flow 'volume_create_manager' (751597eb-e2c7-4f6d-873f-e9bc17e4ef52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:29:30 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-228d95f3-2178-444e-b69b-68b947bb6520 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2773aac3-8062-4877-92a4-a2643f5a5d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:30 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-228d95f3-2178-444e-b69b-68b947bb6520 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2773aac3-8062-4877-92a4-a2643f5a5d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:29:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1010335512',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cf22ef5-4584-4c34-ae50-86fc77cc2a9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7562a5d9f07246b5b75ad948296e0626',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:29:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:29:31Z,use_quota=True,user_id='dd43700199e94ef8abd57ba8f111fba6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:30 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-228d95f3-2178-444e-b69b-68b947bb6520 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7e61a00-c49c-42bf-b793-2a9833c81b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:30 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-228d95f3-2178-444e-b69b-68b947bb6520 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7e61a00-c49c-42bf-b793-2a9833c81b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:30 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-228d95f3-2178-444e-b69b-68b947bb6520 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8541b6ef-a469-43ef-ac16-9e741e34490a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:30 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:30 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-228d95f3-2178-444e-b69b-68b947bb6520 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8541b6ef-a469-43ef-ac16-9e741e34490a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cf22ef5-4584-4c34-ae50-86fc77cc2a9b', 'volume_name': 'volume-2cf22ef5-4584-4c34-ae50-86fc77cc2a9b', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:30 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-228d95f3-2178-444e-b69b-68b947bb6520 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (534e185d-c624-45b5-a7ae-ec0c53d5acef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:30 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-228d95f3-2178-444e-b69b-68b947bb6520 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (534e185d-c624-45b5-a7ae-ec0c53d5acef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:30 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-228d95f3-2178-444e-b69b-68b947bb6520 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38915cf6-8862-430c-9335-10527b9825a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:30 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-228d95f3-2178-444e-b69b-68b947bb6520 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Volume 2cf22ef5-4584-4c34-ae50-86fc77cc2a9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cf22ef5-4584-4c34-ae50-86fc77cc2a9b', 'volume_size': 1}
Jul 03 01:29:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-228d95f3-2178-444e-b69b-68b947bb6520 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:29:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-58522782-3a16-4f3e-9d36-04a0ef2f7dcb tempest-CreateVolumesFromImageTest-1460914073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0471779b-dd0b-4589-9550-26b7134d0b97" returned: 0 in 0.848s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:30 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-58522782-3a16-4f3e-9d36-04a0ef2f7dcb tempest-CreateVolumesFromImageTest-1460914073 None] Lock "cinder-quobyte-0471779b-dd0b-4589-9550-26b7134d0b97" released by "delete_volume" :: held 1.934s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:29:30 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-58522782-3a16-4f3e-9d36-04a0ef2f7dcb tempest-CreateVolumesFromImageTest-1460914073 None] Created reservations ['fc4c14f9-4a4d-454c-90aa-e18c1d636084', '6db3a156-3cd9-4904-bd8a-7fb8ce35413d', 'd418ae17-2cb5-45e3-8f01-abe111f237d9', '870e6f68-c347-48c6-a956-08f056e78e21'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:29:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-58522782-3a16-4f3e-9d36-04a0ef2f7dcb tempest-CreateVolumesFromImageTest-1460914073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:29:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-58522782-3a16-4f3e-9d36-04a0ef2f7dcb tempest-CreateVolumesFromImageTest-1460914073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:29:30 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-58522782-3a16-4f3e-9d36-04a0ef2f7dcb tempest-CreateVolumesFromImageTest-1460914073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:29:30 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-58522782-3a16-4f3e-9d36-04a0ef2f7dcb tempest-CreateVolumesFromImageTest-1460914073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:29:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-58522782-3a16-4f3e-9d36-04a0ef2f7dcb tempest-CreateVolumesFromImageTest-1460914073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:29:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-58522782-3a16-4f3e-9d36-04a0ef2f7dcb tempest-CreateVolumesFromImageTest-1460914073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:30 devstack sudo[106919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:29:30 devstack sudo[106919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:30 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-1906b826-5f1a-44ee-a5c5-2c13c526bbc6 tempest-CreateVolumesFromImageTest-1460914073 None] Acquiring lock "cinder-ba9f672d-3115-4a5b-a736-65a9cd19b007-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:29:31 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-1906b826-5f1a-44ee-a5c5-2c13c526bbc6 tempest-CreateVolumesFromImageTest-1460914073 None] Lock "cinder-ba9f672d-3115-4a5b-a736-65a9cd19b007-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:29:31 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff993042-f847-45db-a537-777a7372e797 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:29:31 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ff993042-f847-45db-a537-777a7372e797 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Flow 'volume_create_manager' (731d23e0-d09b-40d4-b77a-78678edc01a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:29:31 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ff993042-f847-45db-a537-777a7372e797 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6df43db0-0a16-42f9-9f95-d25aadb8b9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:31 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-1906b826-5f1a-44ee-a5c5-2c13c526bbc6 tempest-CreateVolumesFromImageTest-1460914073 None] Acquiring lock "cinder-quobyte-ba9f672d-3115-4a5b-a736-65a9cd19b007" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:29:31 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ff993042-f847-45db-a537-777a7372e797 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6df43db0-0a16-42f9-9f95-d25aadb8b9b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:29:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1390365674',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39a02328-ef2c-4764-899c-d52bc7aacb47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7562a5d9f07246b5b75ad948296e0626',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:29:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:29:31Z,use_quota=True,user_id='dd43700199e94ef8abd57ba8f111fba6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:31 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ff993042-f847-45db-a537-777a7372e797 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94b33b5b-db14-4436-9f9b-08d95984a5d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:31 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ff993042-f847-45db-a537-777a7372e797 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94b33b5b-db14-4436-9f9b-08d95984a5d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:31 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ff993042-f847-45db-a537-777a7372e797 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78ab27bc-df1b-4b61-90ea-ccb4c19aa83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:31 devstack sudo[106916]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:31 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ff993042-f847-45db-a537-777a7372e797 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78ab27bc-df1b-4b61-90ea-ccb4c19aa83a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39a02328-ef2c-4764-899c-d52bc7aacb47', 'volume_name': 'volume-39a02328-ef2c-4764-899c-d52bc7aacb47', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:31 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ff993042-f847-45db-a537-777a7372e797 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7783b091-936b-4dc9-98d2-4ce674fc711a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:31 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ff993042-f847-45db-a537-777a7372e797 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7783b091-936b-4dc9-98d2-4ce674fc711a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:31 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ff993042-f847-45db-a537-777a7372e797 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c040ea2-ec85-44bb-9861-1cf70235741e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:31 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-ff993042-f847-45db-a537-777a7372e797 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Volume 39a02328-ef2c-4764-899c-d52bc7aacb47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39a02328-ef2c-4764-899c-d52bc7aacb47', 'volume_size': 1}
Jul 03 01:29:31 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-ff993042-f847-45db-a537-777a7372e797 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:29:31 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6ec5dffd-5506-42a7-8ead-94e8b8b5db70 tempest-CinderUnicodeTest-944587269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b64656d-2ed7-4b42-afa1-9b19032b38eb -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0b64656d-2ed7-4b42-afa1-9b19032b38eb.49f171a2-3c11-4fa2-9147-453bd457d086" returned: 0 in 0.932s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:31 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-6ec5dffd-5506-42a7-8ead-94e8b8b5db70 tempest-CinderUnicodeTest-944587269 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0b64656d-2ed7-4b42-afa1-9b19032b38eb.49f171a2-3c11-4fa2-9147-453bd457d086 is being set with open permissions: ugo+rw
Jul 03 01:29:31 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6ec5dffd-5506-42a7-8ead-94e8b8b5db70 tempest-CinderUnicodeTest-944587269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0b64656d-2ed7-4b42-afa1-9b19032b38eb.49f171a2-3c11-4fa2-9147-453bd457d086 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:31 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-1906b826-5f1a-44ee-a5c5-2c13c526bbc6 tempest-CreateVolumesFromImageTest-1460914073 None] Lock "cinder-quobyte-ba9f672d-3115-4a5b-a736-65a9cd19b007" acquired by "delete_volume" :: waited 0.074s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:29:31 devstack sudo[106924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0b64656d-2ed7-4b42-afa1-9b19032b38eb.49f171a2-3c11-4fa2-9147-453bd457d086
Jul 03 01:29:31 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:31 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e0ab722-51f7-40a4-b79a-40a381dc81cb]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:29:31 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1906b826-5f1a-44ee-a5c5-2c13c526bbc6 tempest-CreateVolumesFromImageTest-1460914073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ba9f672d-3115-4a5b-a736-65a9cd19b007 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:31 devstack sudo[106926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ba9f672d-3115-4a5b-a736-65a9cd19b007
Jul 03 01:29:31 devstack sudo[106926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:31 devstack sudo[106919]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:31 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-58522782-3a16-4f3e-9d36-04a0ef2f7dcb tempest-CreateVolumesFromImageTest-1460914073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.774s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:31 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-58522782-3a16-4f3e-9d36-04a0ef2f7dcb tempest-CreateVolumesFromImageTest-1460914073 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:29:31 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-58522782-3a16-4f3e-9d36-04a0ef2f7dcb tempest-CreateVolumesFromImageTest-1460914073 None] Deleted volume successfully.
Jul 03 01:29:31 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-58522782-3a16-4f3e-9d36-04a0ef2f7dcb tempest-CreateVolumesFromImageTest-1460914073 None] Lock "cinder-0471779b-dd0b-4589-9550-26b7134d0b97-delete_volume" released by "delete_volume" :: held 2.977s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:29:31 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:31 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6ec5dffd-5506-42a7-8ead-94e8b8b5db70 tempest-CinderUnicodeTest-944587269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0b64656d-2ed7-4b42-afa1-9b19032b38eb.49f171a2-3c11-4fa2-9147-453bd457d086" returned: 0 in 0.692s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:31 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6ec5dffd-5506-42a7-8ead-94e8b8b5db70 tempest-CinderUnicodeTest-944587269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0b64656d-2ed7-4b42-afa1-9b19032b38eb.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:31 devstack sudo[106933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0b64656d-2ed7-4b42-afa1-9b19032b38eb.info
Jul 03 01:29:31 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:32 devstack sudo[106926]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1906b826-5f1a-44ee-a5c5-2c13c526bbc6 tempest-CreateVolumesFromImageTest-1460914073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ba9f672d-3115-4a5b-a736-65a9cd19b007" returned: 0 in 0.798s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1906b826-5f1a-44ee-a5c5-2c13c526bbc6 tempest-CreateVolumesFromImageTest-1460914073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ba9f672d-3115-4a5b-a736-65a9cd19b007 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:32 devstack sudo[106935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ba9f672d-3115-4a5b-a736-65a9cd19b007
Jul 03 01:29:32 devstack sudo[106935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:32 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6ec5dffd-5506-42a7-8ead-94e8b8b5db70 tempest-CinderUnicodeTest-944587269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0b64656d-2ed7-4b42-afa1-9b19032b38eb.info" returned: 0 in 0.697s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:32 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-6ec5dffd-5506-42a7-8ead-94e8b8b5db70 tempest-CinderUnicodeTest-944587269 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0b64656d-2ed7-4b42-afa1-9b19032b38eb.info is being set with open permissions: ugo+rw
Jul 03 01:29:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6ec5dffd-5506-42a7-8ead-94e8b8b5db70 tempest-CinderUnicodeTest-944587269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0b64656d-2ed7-4b42-afa1-9b19032b38eb.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:32 devstack sudo[106939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0b64656d-2ed7-4b42-afa1-9b19032b38eb.info
Jul 03 01:29:32 devstack sudo[106939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:32 devstack sudo[106935]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1906b826-5f1a-44ee-a5c5-2c13c526bbc6 tempest-CreateVolumesFromImageTest-1460914073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ba9f672d-3115-4a5b-a736-65a9cd19b007" returned: 0 in 0.676s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:32 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-1906b826-5f1a-44ee-a5c5-2c13c526bbc6 tempest-CreateVolumesFromImageTest-1460914073 None] Lock "cinder-quobyte-ba9f672d-3115-4a5b-a736-65a9cd19b007" released by "delete_volume" :: held 1.535s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:29:32 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-1906b826-5f1a-44ee-a5c5-2c13c526bbc6 tempest-CreateVolumesFromImageTest-1460914073 None] Created reservations ['6871fe74-db95-412f-9d85-a2d4d6427f8f', 'b22529ec-79c7-4761-934f-860b3582d56c', 'a8603b9f-8a02-4888-9bcf-ad1457eab685', '8bb5b578-96c0-4ee8-91a2-4df2f8574b46'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:29:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1906b826-5f1a-44ee-a5c5-2c13c526bbc6 tempest-CreateVolumesFromImageTest-1460914073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:29:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1906b826-5f1a-44ee-a5c5-2c13c526bbc6 tempest-CreateVolumesFromImageTest-1460914073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:29:32 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-1906b826-5f1a-44ee-a5c5-2c13c526bbc6 tempest-CreateVolumesFromImageTest-1460914073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:29:32 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-1906b826-5f1a-44ee-a5c5-2c13c526bbc6 tempest-CreateVolumesFromImageTest-1460914073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:29:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1906b826-5f1a-44ee-a5c5-2c13c526bbc6 tempest-CreateVolumesFromImageTest-1460914073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:29:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1906b826-5f1a-44ee-a5c5-2c13c526bbc6 tempest-CreateVolumesFromImageTest-1460914073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:32 devstack sudo[106941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:29:32 devstack sudo[106941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:33 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-dced8090-9d27-4e94-99cd-bad5614e3c7f tempest-CreateVolumesFromImageTest-1460914073 None] Acquiring lock "cinder-d39a9240-821b-4f22-b7e6-600b1aeac104-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:29:33 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-dced8090-9d27-4e94-99cd-bad5614e3c7f tempest-CreateVolumesFromImageTest-1460914073 None] Lock "cinder-d39a9240-821b-4f22-b7e6-600b1aeac104-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:29:33 devstack sudo[106939]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6ec5dffd-5506-42a7-8ead-94e8b8b5db70 tempest-CinderUnicodeTest-944587269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0b64656d-2ed7-4b42-afa1-9b19032b38eb.info" returned: 0 in 0.700s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-6ec5dffd-5506-42a7-8ead-94e8b8b5db70 tempest-CinderUnicodeTest-944587269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.267s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:29:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-26515073-ac67-4f6b-821d-04a6ce1992b2 tempest-ProjectMemberTests-1866302072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.457s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:29:33 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-dced8090-9d27-4e94-99cd-bad5614e3c7f tempest-CreateVolumesFromImageTest-1460914073 None] Acquiring lock "cinder-quobyte-d39a9240-821b-4f22-b7e6-600b1aeac104" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:29:33 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-dced8090-9d27-4e94-99cd-bad5614e3c7f tempest-CreateVolumesFromImageTest-1460914073 None] Lock "cinder-quobyte-d39a9240-821b-4f22-b7e6-600b1aeac104" acquired by "delete_volume" :: waited 0.028s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:29:33 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-26515073-ac67-4f6b-821d-04a6ce1992b2 tempest-ProjectMemberTests-1866302072 None] Creating offline snapshot 6405c4c0-0984-4b96-8fb1-0cd785d63fc3 of volume ce8f9a84-989f-4e2f-ad18-ad88c4731c8f {{(pid=86891) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 01:29:33 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ba0426-6bbb-4bc0-a318-2bbf370b0205]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:29:33 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-6ec5dffd-5506-42a7-8ead-94e8b8b5db70 tempest-CinderUnicodeTest-944587269 None] Create snapshot completed successfully
Jul 03 01:29:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-dced8090-9d27-4e94-99cd-bad5614e3c7f tempest-CreateVolumesFromImageTest-1460914073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d39a9240-821b-4f22-b7e6-600b1aeac104 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:33 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[454706e4-9558-44c5-9648-14f5e433aafa]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:29:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-26515073-ac67-4f6b-821d-04a6ce1992b2 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ce8f9a84-989f-4e2f-ad18-ad88c4731c8f {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:33 devstack sudo[106941]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1906b826-5f1a-44ee-a5c5-2c13c526bbc6 tempest-CreateVolumesFromImageTest-1460914073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.691s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:33 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-1906b826-5f1a-44ee-a5c5-2c13c526bbc6 tempest-CreateVolumesFromImageTest-1460914073 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:29:33 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-1906b826-5f1a-44ee-a5c5-2c13c526bbc6 tempest-CreateVolumesFromImageTest-1460914073 None] Deleted volume successfully.
Jul 03 01:29:33 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-1906b826-5f1a-44ee-a5c5-2c13c526bbc6 tempest-CreateVolumesFromImageTest-1460914073 None] Lock "cinder-ba9f672d-3115-4a5b-a736-65a9cd19b007-delete_volume" released by "delete_volume" :: held 2.524s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:29:33 devstack sudo[106945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d39a9240-821b-4f22-b7e6-600b1aeac104
Jul 03 01:29:33 devstack sudo[106945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:33 devstack sudo[106946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ce8f9a84-989f-4e2f-ad18-ad88c4731c8f
Jul 03 01:29:33 devstack sudo[106946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:34 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-fcb3e41b-e32c-4eb7-8df6-df2640fd1437 tempest-CinderUnicodeTest-944587269 None] Acquiring lock "cinder-49f171a2-3c11-4fa2-9147-453bd457d086-delete_snapshot" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:29:34 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-fcb3e41b-e32c-4eb7-8df6-df2640fd1437 tempest-CinderUnicodeTest-944587269 None] Lock "cinder-49f171a2-3c11-4fa2-9147-453bd457d086-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:29:34 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-fcb3e41b-e32c-4eb7-8df6-df2640fd1437 tempest-CinderUnicodeTest-944587269 None] Acquiring lock "cinder-quobyte-0b64656d-2ed7-4b42-afa1-9b19032b38eb" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:29:34 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-fcb3e41b-e32c-4eb7-8df6-df2640fd1437 tempest-CinderUnicodeTest-944587269 None] Lock "cinder-quobyte-0b64656d-2ed7-4b42-afa1-9b19032b38eb" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:29:34 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-fcb3e41b-e32c-4eb7-8df6-df2640fd1437 tempest-CinderUnicodeTest-944587269 None] Acquiring lock "cinder-quobyte-49f171a2-3c11-4fa2-9147-453bd457d086" by "_delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:29:34 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-fcb3e41b-e32c-4eb7-8df6-df2640fd1437 tempest-CinderUnicodeTest-944587269 None] Lock "cinder-quobyte-49f171a2-3c11-4fa2-9147-453bd457d086" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:29:34 devstack sudo[106945]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:34 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-fcb3e41b-e32c-4eb7-8df6-df2640fd1437 tempest-CinderUnicodeTest-944587269 None] Deleting offline snapshot 49f171a2-3c11-4fa2-9147-453bd457d086 of volume 0b64656d-2ed7-4b42-afa1-9b19032b38eb {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 01:29:34 devstack sudo[106946]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:34 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-fcb3e41b-e32c-4eb7-8df6-df2640fd1437 tempest-CinderUnicodeTest-944587269 None] snapshot_file for this snap is: volume-0b64656d-2ed7-4b42-afa1-9b19032b38eb.49f171a2-3c11-4fa2-9147-453bd457d086 {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 01:29:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-26515073-ac67-4f6b-821d-04a6ce1992b2 tempest-ProjectMemberTests-1866302072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ce8f9a84-989f-4e2f-ad18-ad88c4731c8f" returned: 0 in 0.839s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-dced8090-9d27-4e94-99cd-bad5614e3c7f tempest-CreateVolumesFromImageTest-1460914073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d39a9240-821b-4f22-b7e6-600b1aeac104" returned: 0 in 0.858s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-26515073-ac67-4f6b-821d-04a6ce1992b2 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ce8f9a84-989f-4e2f-ad18-ad88c4731c8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ce8f9a84-989f-4e2f-ad18-ad88c4731c8f.6405c4c0-0984-4b96-8fb1-0cd785d63fc3 1G {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-dced8090-9d27-4e94-99cd-bad5614e3c7f tempest-CreateVolumesFromImageTest-1460914073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d39a9240-821b-4f22-b7e6-600b1aeac104 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:34 devstack sudo[106955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ce8f9a84-989f-4e2f-ad18-ad88c4731c8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ce8f9a84-989f-4e2f-ad18-ad88c4731c8f.6405c4c0-0984-4b96-8fb1-0cd785d63fc3 1G
Jul 03 01:29:34 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ee0914-e6d4-47cb-aa1b-03d84afc274c]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:29:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-fcb3e41b-e32c-4eb7-8df6-df2640fd1437 tempest-CinderUnicodeTest-944587269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0b64656d-2ed7-4b42-afa1-9b19032b38eb.49f171a2-3c11-4fa2-9147-453bd457d086 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:34 devstack sudo[106955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:34 devstack sudo[106956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d39a9240-821b-4f22-b7e6-600b1aeac104
Jul 03 01:29:34 devstack sudo[106956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:34 devstack sudo[106958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0b64656d-2ed7-4b42-afa1-9b19032b38eb.49f171a2-3c11-4fa2-9147-453bd457d086
Jul 03 01:29:34 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:35 devstack sudo[106956]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-dced8090-9d27-4e94-99cd-bad5614e3c7f tempest-CreateVolumesFromImageTest-1460914073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d39a9240-821b-4f22-b7e6-600b1aeac104" returned: 0 in 0.784s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:35 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-dced8090-9d27-4e94-99cd-bad5614e3c7f tempest-CreateVolumesFromImageTest-1460914073 None] Lock "cinder-quobyte-d39a9240-821b-4f22-b7e6-600b1aeac104" released by "delete_volume" :: held 1.700s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:29:35 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-fcb3e41b-e32c-4eb7-8df6-df2640fd1437 tempest-CinderUnicodeTest-944587269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0b64656d-2ed7-4b42-afa1-9b19032b38eb.49f171a2-3c11-4fa2-9147-453bd457d086" returned: 0 in 0.823s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:35 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-fcb3e41b-e32c-4eb7-8df6-df2640fd1437 tempest-CinderUnicodeTest-944587269 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b64656d-2ed7-4b42-afa1-9b19032b38eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:29:35 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-dced8090-9d27-4e94-99cd-bad5614e3c7f tempest-CreateVolumesFromImageTest-1460914073 None] Created reservations ['30f5b64f-1665-4ec8-abd1-0af8c88e009b', '2ab5b80e-6e09-4007-a8ad-392a884fb251', 'a2bc8332-1e8d-4f53-b53b-971f075bd726', '2c65773c-72c6-4af5-8da4-3de15d5180e2'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:29:35 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba1d76b-74ab-48f1-8a36-86719573b33c]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:29:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-fcb3e41b-e32c-4eb7-8df6-df2640fd1437 tempest-CinderUnicodeTest-944587269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0b64656d-2ed7-4b42-afa1-9b19032b38eb {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:35 devstack sudo[106955]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-26515073-ac67-4f6b-821d-04a6ce1992b2 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ce8f9a84-989f-4e2f-ad18-ad88c4731c8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ce8f9a84-989f-4e2f-ad18-ad88c4731c8f.6405c4c0-0984-4b96-8fb1-0cd785d63fc3 1G" returned: 0 in 0.941s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-26515073-ac67-4f6b-821d-04a6ce1992b2 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce8f9a84-989f-4e2f-ad18-ad88c4731c8f -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ce8f9a84-989f-4e2f-ad18-ad88c4731c8f.6405c4c0-0984-4b96-8fb1-0cd785d63fc3 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:35 devstack sudo[107006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce8f9a84-989f-4e2f-ad18-ad88c4731c8f -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ce8f9a84-989f-4e2f-ad18-ad88c4731c8f.6405c4c0-0984-4b96-8fb1-0cd785d63fc3
Jul 03 01:29:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-dced8090-9d27-4e94-99cd-bad5614e3c7f tempest-CreateVolumesFromImageTest-1460914073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:29:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-dced8090-9d27-4e94-99cd-bad5614e3c7f tempest-CreateVolumesFromImageTest-1460914073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:29:35 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-dced8090-9d27-4e94-99cd-bad5614e3c7f tempest-CreateVolumesFromImageTest-1460914073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:29:35 devstack sudo[107006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:35 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-dced8090-9d27-4e94-99cd-bad5614e3c7f tempest-CreateVolumesFromImageTest-1460914073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:29:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-dced8090-9d27-4e94-99cd-bad5614e3c7f tempest-CreateVolumesFromImageTest-1460914073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:29:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-dced8090-9d27-4e94-99cd-bad5614e3c7f tempest-CreateVolumesFromImageTest-1460914073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:35 devstack sudo[107008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:29:35 devstack sudo[107008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:35 devstack sudo[107005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0b64656d-2ed7-4b42-afa1-9b19032b38eb
Jul 03 01:29:35 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:35 devstack sudo[107008]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-dced8090-9d27-4e94-99cd-bad5614e3c7f tempest-CreateVolumesFromImageTest-1460914073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.679s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:35 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-dced8090-9d27-4e94-99cd-bad5614e3c7f tempest-CreateVolumesFromImageTest-1460914073 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:29:35 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-dced8090-9d27-4e94-99cd-bad5614e3c7f tempest-CreateVolumesFromImageTest-1460914073 None] Deleted volume successfully.
Jul 03 01:29:36 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-dced8090-9d27-4e94-99cd-bad5614e3c7f tempest-CreateVolumesFromImageTest-1460914073 None] Lock "cinder-d39a9240-821b-4f22-b7e6-600b1aeac104-delete_volume" released by "delete_volume" :: held 2.760s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:29:36 devstack sudo[107006]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-26515073-ac67-4f6b-821d-04a6ce1992b2 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce8f9a84-989f-4e2f-ad18-ad88c4731c8f -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ce8f9a84-989f-4e2f-ad18-ad88c4731c8f.6405c4c0-0984-4b96-8fb1-0cd785d63fc3" returned: 0 in 0.815s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:36 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-26515073-ac67-4f6b-821d-04a6ce1992b2 tempest-ProjectMemberTests-1866302072 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ce8f9a84-989f-4e2f-ad18-ad88c4731c8f.6405c4c0-0984-4b96-8fb1-0cd785d63fc3 is being set with open permissions: ugo+rw
Jul 03 01:29:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-26515073-ac67-4f6b-821d-04a6ce1992b2 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ce8f9a84-989f-4e2f-ad18-ad88c4731c8f.6405c4c0-0984-4b96-8fb1-0cd785d63fc3 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:36 devstack sudo[107021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ce8f9a84-989f-4e2f-ad18-ad88c4731c8f.6405c4c0-0984-4b96-8fb1-0cd785d63fc3
Jul 03 01:29:36 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:36 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-fcb3e41b-e32c-4eb7-8df6-df2640fd1437 tempest-CinderUnicodeTest-944587269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0b64656d-2ed7-4b42-afa1-9b19032b38eb" returned: 0 in 0.910s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-fcb3e41b-e32c-4eb7-8df6-df2640fd1437 tempest-CinderUnicodeTest-944587269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0b64656d-2ed7-4b42-afa1-9b19032b38eb.49f171a2-3c11-4fa2-9147-453bd457d086 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:36 devstack sudo[107023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0b64656d-2ed7-4b42-afa1-9b19032b38eb.49f171a2-3c11-4fa2-9147-453bd457d086
Jul 03 01:29:36 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:36 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-26515073-ac67-4f6b-821d-04a6ce1992b2 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ce8f9a84-989f-4e2f-ad18-ad88c4731c8f.6405c4c0-0984-4b96-8fb1-0cd785d63fc3" returned: 0 in 0.833s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:36 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:SELECT=160,cinder:UPDATE=205,cinder:INSERT=50,cinder:DELETE=20 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:29:36 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:SELECT=162,cinder:UPDATE=208,cinder:INSERT=64,cinder:DELETE=18 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:29:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-26515073-ac67-4f6b-821d-04a6ce1992b2 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ce8f9a84-989f-4e2f-ad18-ad88c4731c8f.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:36 devstack sudo[107029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ce8f9a84-989f-4e2f-ad18-ad88c4731c8f.info
Jul 03 01:29:36 devstack sudo[107029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:37 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-fcb3e41b-e32c-4eb7-8df6-df2640fd1437 tempest-CinderUnicodeTest-944587269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0b64656d-2ed7-4b42-afa1-9b19032b38eb.49f171a2-3c11-4fa2-9147-453bd457d086" returned: 0 in 0.896s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-fcb3e41b-e32c-4eb7-8df6-df2640fd1437 tempest-CinderUnicodeTest-944587269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0b64656d-2ed7-4b42-afa1-9b19032b38eb.49f171a2-3c11-4fa2-9147-453bd457d086 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:37 devstack sudo[107031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0b64656d-2ed7-4b42-afa1-9b19032b38eb.49f171a2-3c11-4fa2-9147-453bd457d086
Jul 03 01:29:37 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:37 devstack sudo[107029]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-26515073-ac67-4f6b-821d-04a6ce1992b2 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ce8f9a84-989f-4e2f-ad18-ad88c4731c8f.info" returned: 0 in 0.763s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:37 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-26515073-ac67-4f6b-821d-04a6ce1992b2 tempest-ProjectMemberTests-1866302072 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ce8f9a84-989f-4e2f-ad18-ad88c4731c8f.info is being set with open permissions: ugo+rw
Jul 03 01:29:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-26515073-ac67-4f6b-821d-04a6ce1992b2 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ce8f9a84-989f-4e2f-ad18-ad88c4731c8f.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:37 devstack sudo[107035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ce8f9a84-989f-4e2f-ad18-ad88c4731c8f.info
Jul 03 01:29:37 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:37 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-fcb3e41b-e32c-4eb7-8df6-df2640fd1437 tempest-CinderUnicodeTest-944587269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0b64656d-2ed7-4b42-afa1-9b19032b38eb.49f171a2-3c11-4fa2-9147-453bd457d086" returned: 0 in 0.733s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:37 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-fcb3e41b-e32c-4eb7-8df6-df2640fd1437 tempest-CinderUnicodeTest-944587269 None] Lock "cinder-quobyte-49f171a2-3c11-4fa2-9147-453bd457d086" released by "_delete_snapshot" :: held 3.510s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:29:37 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-fcb3e41b-e32c-4eb7-8df6-df2640fd1437 tempest-CinderUnicodeTest-944587269 None] Lock "cinder-quobyte-0b64656d-2ed7-4b42-afa1-9b19032b38eb" released by "delete_snapshot" :: held 3.534s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:29:37 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-fcb3e41b-e32c-4eb7-8df6-df2640fd1437 tempest-CinderUnicodeTest-944587269 None] Created reservations ['ed6ca4e9-4b13-42b6-acc6-336c996a421d', '31005e31-1731-4abe-8d76-73e9a13a5ba3', 'e6a8c2ee-0896-4035-88a7-a51fa2cf62f2', '2f0b165f-e8b8-48b6-95ec-d3c4d63c9732'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:29:37 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-fcb3e41b-e32c-4eb7-8df6-df2640fd1437 tempest-CinderUnicodeTest-944587269 None] Delete snapshot completed successfully.
Jul 03 01:29:37 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-fcb3e41b-e32c-4eb7-8df6-df2640fd1437 tempest-CinderUnicodeTest-944587269 None] Lock "cinder-49f171a2-3c11-4fa2-9147-453bd457d086-delete_snapshot" released by "delete_snapshot" :: held 3.699s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:29:38 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-26515073-ac67-4f6b-821d-04a6ce1992b2 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ce8f9a84-989f-4e2f-ad18-ad88c4731c8f.info" returned: 0 in 0.704s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-26515073-ac67-4f6b-821d-04a6ce1992b2 tempest-ProjectMemberTests-1866302072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.091s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:29:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e3ac39aa-2ac5-4751-a9c0-d62c96081799 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.011s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:29:38 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-e3ac39aa-2ac5-4751-a9c0-d62c96081799 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:29:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-960122033',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19a337b0-6359-40aa-97a2-6dc2985702e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7562a5d9f07246b5b75ad948296e0626',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:29:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:29:29Z,use_quota=True,user_id='dd43700199e94ef8abd57ba8f111fba6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:29:38 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-e3ac39aa-2ac5-4751-a9c0-d62c96081799 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Creating volume 19a337b0-6359-40aa-97a2-6dc2985702e0 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:29:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e3ac39aa-2ac5-4751-a9c0-d62c96081799 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:29:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e3ac39aa-2ac5-4751-a9c0-d62c96081799 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:29:38 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-e3ac39aa-2ac5-4751-a9c0-d62c96081799 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:29:38 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-e3ac39aa-2ac5-4751-a9c0-d62c96081799 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:29:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e3ac39aa-2ac5-4751-a9c0-d62c96081799 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:29:38 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-e3ac39aa-2ac5-4751-a9c0-d62c96081799 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:29:38 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-e3ac39aa-2ac5-4751-a9c0-d62c96081799 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:29:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e3ac39aa-2ac5-4751-a9c0-d62c96081799 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-19a337b0-6359-40aa-97a2-6dc2985702e0 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:38 devstack sudo[107038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-19a337b0-6359-40aa-97a2-6dc2985702e0 1073741824
Jul 03 01:29:38 devstack sudo[107038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:38 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-26515073-ac67-4f6b-821d-04a6ce1992b2 tempest-ProjectMemberTests-1866302072 None] Create snapshot completed successfully
Jul 03 01:29:38 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e757b9c4-afbf-4b36-9024-7f8e66e02fd6 tempest-CinderUnicodeTest-944587269 None] Acquiring lock "cinder-0b64656d-2ed7-4b42-afa1-9b19032b38eb-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:29:38 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e757b9c4-afbf-4b36-9024-7f8e66e02fd6 tempest-CinderUnicodeTest-944587269 None] Lock "cinder-0b64656d-2ed7-4b42-afa1-9b19032b38eb-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:29:38 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e757b9c4-afbf-4b36-9024-7f8e66e02fd6 tempest-CinderUnicodeTest-944587269 None] Acquiring lock "cinder-quobyte-0b64656d-2ed7-4b42-afa1-9b19032b38eb" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:29:38 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e757b9c4-afbf-4b36-9024-7f8e66e02fd6 tempest-CinderUnicodeTest-944587269 None] Lock "cinder-quobyte-0b64656d-2ed7-4b42-afa1-9b19032b38eb" acquired by "delete_volume" :: waited 0.016s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:29:38 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce43bb8-011c-4881-8215-11739f80d2a7]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:29:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e757b9c4-afbf-4b36-9024-7f8e66e02fd6 tempest-CinderUnicodeTest-944587269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0b64656d-2ed7-4b42-afa1-9b19032b38eb {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:38 devstack sudo[107040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0b64656d-2ed7-4b42-afa1-9b19032b38eb
Jul 03 01:29:38 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:38 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-249a5ac2-6d4c-40e3-b527-c20de0a36239 tempest-VolumeDependencyTests-341232480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:29:38 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-249a5ac2-6d4c-40e3-b527-c20de0a36239 tempest-VolumeDependencyTests-341232480 None] Flow 'volume_create_manager' (e930258e-20e7-4a3d-ad7d-257b3580473f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:29:38 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-249a5ac2-6d4c-40e3-b527-c20de0a36239 tempest-VolumeDependencyTests-341232480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9cd467f-87f2-40cc-b030-9e916506793e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:38 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-249a5ac2-6d4c-40e3-b527-c20de0a36239 tempest-VolumeDependencyTests-341232480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9cd467f-87f2-40cc-b030-9e916506793e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-52317419',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b160888-756d-4574-b870-30149de01b6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c37b4b8c4ec44481924a7fee411ecc39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:29:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:29:39Z,use_quota=True,user_id='f68cb093039944b88d385ffca1179656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:38 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-249a5ac2-6d4c-40e3-b527-c20de0a36239 tempest-VolumeDependencyTests-341232480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a426f5d5-d267-4594-98e3-088556043c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:38 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-249a5ac2-6d4c-40e3-b527-c20de0a36239 tempest-VolumeDependencyTests-341232480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a426f5d5-d267-4594-98e3-088556043c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:38 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-249a5ac2-6d4c-40e3-b527-c20de0a36239 tempest-VolumeDependencyTests-341232480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38b953f2-f7b6-4adf-83ec-4c8ea0a6134b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:38 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-249a5ac2-6d4c-40e3-b527-c20de0a36239 tempest-VolumeDependencyTests-341232480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38b953f2-f7b6-4adf-83ec-4c8ea0a6134b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b160888-756d-4574-b870-30149de01b6a', 'volume_name': 'volume-8b160888-756d-4574-b870-30149de01b6a', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:38 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-249a5ac2-6d4c-40e3-b527-c20de0a36239 tempest-VolumeDependencyTests-341232480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05f52070-38fb-47b1-ac89-91f69aec3592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:38 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-249a5ac2-6d4c-40e3-b527-c20de0a36239 tempest-VolumeDependencyTests-341232480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05f52070-38fb-47b1-ac89-91f69aec3592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:38 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-249a5ac2-6d4c-40e3-b527-c20de0a36239 tempest-VolumeDependencyTests-341232480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1df9ed6-90a0-47c0-b016-aefa95e3b909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:38 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-249a5ac2-6d4c-40e3-b527-c20de0a36239 tempest-VolumeDependencyTests-341232480 None] Volume 8b160888-756d-4574-b870-30149de01b6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b160888-756d-4574-b870-30149de01b6a', 'volume_size': 1}
Jul 03 01:29:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-249a5ac2-6d4c-40e3-b527-c20de0a36239 tempest-VolumeDependencyTests-341232480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:29:39 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-701e0284-7cb5-4828-ac16-d4d8c0a74fd7 tempest-ProjectMemberTests-1866302072 None] Acquiring lock "cinder-6405c4c0-0984-4b96-8fb1-0cd785d63fc3-delete_snapshot" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:29:39 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-701e0284-7cb5-4828-ac16-d4d8c0a74fd7 tempest-ProjectMemberTests-1866302072 None] Lock "cinder-6405c4c0-0984-4b96-8fb1-0cd785d63fc3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:29:39 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-701e0284-7cb5-4828-ac16-d4d8c0a74fd7 tempest-ProjectMemberTests-1866302072 None] Acquiring lock "cinder-quobyte-ce8f9a84-989f-4e2f-ad18-ad88c4731c8f" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:29:39 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-701e0284-7cb5-4828-ac16-d4d8c0a74fd7 tempest-ProjectMemberTests-1866302072 None] Lock "cinder-quobyte-ce8f9a84-989f-4e2f-ad18-ad88c4731c8f" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:29:39 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-701e0284-7cb5-4828-ac16-d4d8c0a74fd7 tempest-ProjectMemberTests-1866302072 None] Acquiring lock "cinder-quobyte-6405c4c0-0984-4b96-8fb1-0cd785d63fc3" by "_delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:29:39 devstack sudo[107038]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e3ac39aa-2ac5-4751-a9c0-d62c96081799 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-19a337b0-6359-40aa-97a2-6dc2985702e0 1073741824" returned: 0 in 0.977s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:39 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-701e0284-7cb5-4828-ac16-d4d8c0a74fd7 tempest-ProjectMemberTests-1866302072 None] Lock "cinder-quobyte-6405c4c0-0984-4b96-8fb1-0cd785d63fc3" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:29:39 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-701e0284-7cb5-4828-ac16-d4d8c0a74fd7 tempest-ProjectMemberTests-1866302072 None] Deleting offline snapshot 6405c4c0-0984-4b96-8fb1-0cd785d63fc3 of volume ce8f9a84-989f-4e2f-ad18-ad88c4731c8f {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 01:29:39 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-701e0284-7cb5-4828-ac16-d4d8c0a74fd7 tempest-ProjectMemberTests-1866302072 None] snapshot_file for this snap is: volume-ce8f9a84-989f-4e2f-ad18-ad88c4731c8f.6405c4c0-0984-4b96-8fb1-0cd785d63fc3 {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 01:29:39 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad09ad31-4d63-4eff-935f-f320010ed001]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:29:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-701e0284-7cb5-4828-ac16-d4d8c0a74fd7 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ce8f9a84-989f-4e2f-ad18-ad88c4731c8f.6405c4c0-0984-4b96-8fb1-0cd785d63fc3 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:39 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e757b9c4-afbf-4b36-9024-7f8e66e02fd6 tempest-CinderUnicodeTest-944587269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0b64656d-2ed7-4b42-afa1-9b19032b38eb" returned: 0 in 0.814s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e757b9c4-afbf-4b36-9024-7f8e66e02fd6 tempest-CinderUnicodeTest-944587269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0b64656d-2ed7-4b42-afa1-9b19032b38eb {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e3ac39aa-2ac5-4751-a9c0-d62c96081799 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-19a337b0-6359-40aa-97a2-6dc2985702e0 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:39 devstack sudo[107051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0b64656d-2ed7-4b42-afa1-9b19032b38eb
Jul 03 01:29:39 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:39 devstack sudo[107053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-19a337b0-6359-40aa-97a2-6dc2985702e0
Jul 03 01:29:39 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:39 devstack sudo[107050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ce8f9a84-989f-4e2f-ad18-ad88c4731c8f.6405c4c0-0984-4b96-8fb1-0cd785d63fc3
Jul 03 01:29:39 devstack sudo[107050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:40 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e757b9c4-afbf-4b36-9024-7f8e66e02fd6 tempest-CinderUnicodeTest-944587269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0b64656d-2ed7-4b42-afa1-9b19032b38eb" returned: 0 in 0.657s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:40 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e757b9c4-afbf-4b36-9024-7f8e66e02fd6 tempest-CinderUnicodeTest-944587269 None] Lock "cinder-quobyte-0b64656d-2ed7-4b42-afa1-9b19032b38eb" released by "delete_volume" :: held 1.540s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:29:40 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-e757b9c4-afbf-4b36-9024-7f8e66e02fd6 tempest-CinderUnicodeTest-944587269 None] Created reservations ['bb78c9ab-f7f7-4cc9-afe0-e16cf7ce1deb', 'd79e238c-4773-4e4d-9fed-f46b8dea0f3b', 'af94e14e-bd8a-4051-9b20-3528a6f9934d', 'b2869f89-0e5a-4e6a-8165-f3b324ff3e76'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:29:40 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e3ac39aa-2ac5-4751-a9c0-d62c96081799 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-19a337b0-6359-40aa-97a2-6dc2985702e0" returned: 0 in 0.739s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:40 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-e3ac39aa-2ac5-4751-a9c0-d62c96081799 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] <== create_volume: return (1811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:29:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e3ac39aa-2ac5-4751-a9c0-d62c96081799 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.816s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:29:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-4d2d697b-1d67-4cca-b3e3-23960f3fbfb1 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.458s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:29:40 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-4d2d697b-1d67-4cca-b3e3-23960f3fbfb1 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:29:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1748003999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57bcf82c-b865-4e5c-af57-9893c97541f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7562a5d9f07246b5b75ad948296e0626',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:29:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:29:30Z,use_quota=True,user_id='dd43700199e94ef8abd57ba8f111fba6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:29:40 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-4d2d697b-1d67-4cca-b3e3-23960f3fbfb1 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Creating volume 57bcf82c-b865-4e5c-af57-9893c97541f9 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:29:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-4d2d697b-1d67-4cca-b3e3-23960f3fbfb1 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:29:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-4d2d697b-1d67-4cca-b3e3-23960f3fbfb1 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:29:40 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-4d2d697b-1d67-4cca-b3e3-23960f3fbfb1 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:29:40 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-4d2d697b-1d67-4cca-b3e3-23960f3fbfb1 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:29:40 devstack sudo[107050]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-4d2d697b-1d67-4cca-b3e3-23960f3fbfb1 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:29:40 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-4d2d697b-1d67-4cca-b3e3-23960f3fbfb1 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:29:40 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-4d2d697b-1d67-4cca-b3e3-23960f3fbfb1 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:29:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-4d2d697b-1d67-4cca-b3e3-23960f3fbfb1 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-57bcf82c-b865-4e5c-af57-9893c97541f9 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-701e0284-7cb5-4828-ac16-d4d8c0a74fd7 tempest-ProjectMemberTests-1866302072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ce8f9a84-989f-4e2f-ad18-ad88c4731c8f.6405c4c0-0984-4b96-8fb1-0cd785d63fc3" returned: 0 in 0.824s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:40 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-701e0284-7cb5-4828-ac16-d4d8c0a74fd7 tempest-ProjectMemberTests-1866302072 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce8f9a84-989f-4e2f-ad18-ad88c4731c8f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:29:40 devstack sudo[107061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-57bcf82c-b865-4e5c-af57-9893c97541f9 1073741824
Jul 03 01:29:40 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:40 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e3ac39aa-2ac5-4751-a9c0-d62c96081799 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8537c0c9-c7a6-4fe4-8085-5c13f1f1461f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19a337b0-6359-40aa-97a2-6dc2985702e0', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:40 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e3ac39aa-2ac5-4751-a9c0-d62c96081799 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0acbe62-c838-4113-b461-3246cff4e7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:40 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[af90d194-6c75-472c-8191-7b82471b927e]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:29:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-701e0284-7cb5-4828-ac16-d4d8c0a74fd7 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ce8f9a84-989f-4e2f-ad18-ad88c4731c8f {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:40 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-e3ac39aa-2ac5-4751-a9c0-d62c96081799 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Volume volume-19a337b0-6359-40aa-97a2-6dc2985702e0 (19a337b0-6359-40aa-97a2-6dc2985702e0): created successfully
Jul 03 01:29:40 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e3ac39aa-2ac5-4751-a9c0-d62c96081799 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0acbe62-c838-4113-b461-3246cff4e7c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:40 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e3ac39aa-2ac5-4751-a9c0-d62c96081799 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Flow 'volume_create_manager' (ae8b195e-6f90-488e-8b6e-773b57fa95d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:29:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e757b9c4-afbf-4b36-9024-7f8e66e02fd6 tempest-CinderUnicodeTest-944587269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:29:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e757b9c4-afbf-4b36-9024-7f8e66e02fd6 tempest-CinderUnicodeTest-944587269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:29:40 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-e757b9c4-afbf-4b36-9024-7f8e66e02fd6 tempest-CinderUnicodeTest-944587269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:29:40 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-e757b9c4-afbf-4b36-9024-7f8e66e02fd6 tempest-CinderUnicodeTest-944587269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:29:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e757b9c4-afbf-4b36-9024-7f8e66e02fd6 tempest-CinderUnicodeTest-944587269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:29:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e757b9c4-afbf-4b36-9024-7f8e66e02fd6 tempest-CinderUnicodeTest-944587269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:40 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-e3ac39aa-2ac5-4751-a9c0-d62c96081799 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Created volume successfully.
Jul 03 01:29:40 devstack sudo[107064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:29:40 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:40 devstack sudo[107063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ce8f9a84-989f-4e2f-ad18-ad88c4731c8f
Jul 03 01:29:40 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:40 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-dc92d195-199c-47f2-8872-9e8b8d42f4f9 tempest-CinderUnicodeTest-944587269 None] Acquiring lock "cinder-3bf18f36-2368-44de-a105-fdce6a2aed3d-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:29:40 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-dc92d195-199c-47f2-8872-9e8b8d42f4f9 tempest-CinderUnicodeTest-944587269 None] Lock "cinder-3bf18f36-2368-44de-a105-fdce6a2aed3d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:29:40 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-dc92d195-199c-47f2-8872-9e8b8d42f4f9 tempest-CinderUnicodeTest-944587269 None] Acquiring lock "cinder-quobyte-3bf18f36-2368-44de-a105-fdce6a2aed3d" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:29:40 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-dc92d195-199c-47f2-8872-9e8b8d42f4f9 tempest-CinderUnicodeTest-944587269 None] Lock "cinder-quobyte-3bf18f36-2368-44de-a105-fdce6a2aed3d" acquired by "delete_volume" :: waited 0.018s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:29:41 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[693135be-94ba-46a8-983d-c8921cab590f]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:29:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-dc92d195-199c-47f2-8872-9e8b8d42f4f9 tempest-CinderUnicodeTest-944587269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3bf18f36-2368-44de-a105-fdce6a2aed3d {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:41 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e757b9c4-afbf-4b36-9024-7f8e66e02fd6 tempest-CinderUnicodeTest-944587269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.723s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:41 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-e757b9c4-afbf-4b36-9024-7f8e66e02fd6 tempest-CinderUnicodeTest-944587269 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:29:41 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-e757b9c4-afbf-4b36-9024-7f8e66e02fd6 tempest-CinderUnicodeTest-944587269 None] Deleted volume successfully.
Jul 03 01:29:41 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e757b9c4-afbf-4b36-9024-7f8e66e02fd6 tempest-CinderUnicodeTest-944587269 None] Lock "cinder-0b64656d-2ed7-4b42-afa1-9b19032b38eb-delete_volume" released by "delete_volume" :: held 2.597s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:29:41 devstack sudo[107074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3bf18f36-2368-44de-a105-fdce6a2aed3d
Jul 03 01:29:41 devstack sudo[107074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:41 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-701e0284-7cb5-4828-ac16-d4d8c0a74fd7 tempest-ProjectMemberTests-1866302072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ce8f9a84-989f-4e2f-ad18-ad88c4731c8f" returned: 0 in 0.874s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-701e0284-7cb5-4828-ac16-d4d8c0a74fd7 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ce8f9a84-989f-4e2f-ad18-ad88c4731c8f.6405c4c0-0984-4b96-8fb1-0cd785d63fc3 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:41 devstack sudo[107083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ce8f9a84-989f-4e2f-ad18-ad88c4731c8f.6405c4c0-0984-4b96-8fb1-0cd785d63fc3
Jul 03 01:29:41 devstack sudo[107083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:41 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-4d2d697b-1d67-4cca-b3e3-23960f3fbfb1 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-57bcf82c-b865-4e5c-af57-9893c97541f9 1073741824" returned: 0 in 0.976s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-4d2d697b-1d67-4cca-b3e3-23960f3fbfb1 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-57bcf82c-b865-4e5c-af57-9893c97541f9 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:41 devstack sudo[107086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-57bcf82c-b865-4e5c-af57-9893c97541f9
Jul 03 01:29:41 devstack sudo[107086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:41 devstack sudo[107074]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-dc92d195-199c-47f2-8872-9e8b8d42f4f9 tempest-CinderUnicodeTest-944587269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3bf18f36-2368-44de-a105-fdce6a2aed3d" returned: 0 in 0.873s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-dc92d195-199c-47f2-8872-9e8b8d42f4f9 tempest-CinderUnicodeTest-944587269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3bf18f36-2368-44de-a105-fdce6a2aed3d {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:41 devstack sudo[107096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3bf18f36-2368-44de-a105-fdce6a2aed3d
Jul 03 01:29:41 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:41 devstack sudo[107086]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-4d2d697b-1d67-4cca-b3e3-23960f3fbfb1 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-57bcf82c-b865-4e5c-af57-9893c97541f9" returned: 0 in 0.694s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:41 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-4d2d697b-1d67-4cca-b3e3-23960f3fbfb1 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] <== create_volume: return (1712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:29:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-4d2d697b-1d67-4cca-b3e3-23960f3fbfb1 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.718s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:29:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-9cfcc05b-fd16-4b3b-a66c-6af5b127b37b tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.736s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:29:41 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-9cfcc05b-fd16-4b3b-a66c-6af5b127b37b tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:29:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1002498726',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96891ab7-8b12-46cc-87ae-fd4eeb8149cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7562a5d9f07246b5b75ad948296e0626',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:29:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:29:30Z,use_quota=True,user_id='dd43700199e94ef8abd57ba8f111fba6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:29:41 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-9cfcc05b-fd16-4b3b-a66c-6af5b127b37b tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Creating volume 96891ab7-8b12-46cc-87ae-fd4eeb8149cb {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:29:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-9cfcc05b-fd16-4b3b-a66c-6af5b127b37b tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:29:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-9cfcc05b-fd16-4b3b-a66c-6af5b127b37b tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:29:41 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-9cfcc05b-fd16-4b3b-a66c-6af5b127b37b tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:29:41 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-9cfcc05b-fd16-4b3b-a66c-6af5b127b37b tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:29:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-9cfcc05b-fd16-4b3b-a66c-6af5b127b37b tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:29:41 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-9cfcc05b-fd16-4b3b-a66c-6af5b127b37b tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:29:41 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-9cfcc05b-fd16-4b3b-a66c-6af5b127b37b tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:29:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9cfcc05b-fd16-4b3b-a66c-6af5b127b37b tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-96891ab7-8b12-46cc-87ae-fd4eeb8149cb 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:42 devstack sudo[107098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-96891ab7-8b12-46cc-87ae-fd4eeb8149cb 1073741824
Jul 03 01:29:42 devstack sudo[107098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:42 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-4d2d697b-1d67-4cca-b3e3-23960f3fbfb1 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b0ff995-7314-46db-bcd8-e17700ac2bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57bcf82c-b865-4e5c-af57-9893c97541f9', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:42 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-4d2d697b-1d67-4cca-b3e3-23960f3fbfb1 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0019c71-bed7-4f4f-b185-82309917453c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:42 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-4d2d697b-1d67-4cca-b3e3-23960f3fbfb1 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Volume volume-57bcf82c-b865-4e5c-af57-9893c97541f9 (57bcf82c-b865-4e5c-af57-9893c97541f9): created successfully
Jul 03 01:29:42 devstack sudo[107083]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:42 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-4d2d697b-1d67-4cca-b3e3-23960f3fbfb1 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0019c71-bed7-4f4f-b185-82309917453c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:42 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-4d2d697b-1d67-4cca-b3e3-23960f3fbfb1 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Flow 'volume_create_manager' (1e339fa5-264f-4b51-8eb5-48f48afa0563) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:29:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-701e0284-7cb5-4828-ac16-d4d8c0a74fd7 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ce8f9a84-989f-4e2f-ad18-ad88c4731c8f.6405c4c0-0984-4b96-8fb1-0cd785d63fc3" returned: 0 in 0.886s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-701e0284-7cb5-4828-ac16-d4d8c0a74fd7 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ce8f9a84-989f-4e2f-ad18-ad88c4731c8f.6405c4c0-0984-4b96-8fb1-0cd785d63fc3 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:42 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-4d2d697b-1d67-4cca-b3e3-23960f3fbfb1 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Created volume successfully.
Jul 03 01:29:42 devstack sudo[107100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ce8f9a84-989f-4e2f-ad18-ad88c4731c8f.6405c4c0-0984-4b96-8fb1-0cd785d63fc3
Jul 03 01:29:42 devstack sudo[107100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:42 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-dc92d195-199c-47f2-8872-9e8b8d42f4f9 tempest-CinderUnicodeTest-944587269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3bf18f36-2368-44de-a105-fdce6a2aed3d" returned: 0 in 0.688s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:42 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-dc92d195-199c-47f2-8872-9e8b8d42f4f9 tempest-CinderUnicodeTest-944587269 None] Lock "cinder-quobyte-3bf18f36-2368-44de-a105-fdce6a2aed3d" released by "delete_volume" :: held 1.613s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:29:42 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-dc92d195-199c-47f2-8872-9e8b8d42f4f9 tempest-CinderUnicodeTest-944587269 None] Created reservations ['399727c6-143c-4a4c-bc38-e31253bca005', '385b7381-4a30-416a-9096-3e24c5e603ee', 'd8836397-3d91-4cf9-ad28-f7f24e50e428', '6b89c3c3-3aed-4695-8f48-66e6b4a40ff9'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:29:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-dc92d195-199c-47f2-8872-9e8b8d42f4f9 tempest-CinderUnicodeTest-944587269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:29:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-dc92d195-199c-47f2-8872-9e8b8d42f4f9 tempest-CinderUnicodeTest-944587269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:29:42 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-dc92d195-199c-47f2-8872-9e8b8d42f4f9 tempest-CinderUnicodeTest-944587269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:29:42 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-dc92d195-199c-47f2-8872-9e8b8d42f4f9 tempest-CinderUnicodeTest-944587269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:29:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-dc92d195-199c-47f2-8872-9e8b8d42f4f9 tempest-CinderUnicodeTest-944587269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:29:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-dc92d195-199c-47f2-8872-9e8b8d42f4f9 tempest-CinderUnicodeTest-944587269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:42 devstack sudo[107111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:29:42 devstack sudo[107111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:42 devstack sudo[107100]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-701e0284-7cb5-4828-ac16-d4d8c0a74fd7 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ce8f9a84-989f-4e2f-ad18-ad88c4731c8f.6405c4c0-0984-4b96-8fb1-0cd785d63fc3" returned: 0 in 0.760s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:42 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-701e0284-7cb5-4828-ac16-d4d8c0a74fd7 tempest-ProjectMemberTests-1866302072 None] Lock "cinder-quobyte-6405c4c0-0984-4b96-8fb1-0cd785d63fc3" released by "_delete_snapshot" :: held 3.450s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:29:42 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-701e0284-7cb5-4828-ac16-d4d8c0a74fd7 tempest-ProjectMemberTests-1866302072 None] Lock "cinder-quobyte-ce8f9a84-989f-4e2f-ad18-ad88c4731c8f" released by "delete_snapshot" :: held 3.485s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:29:42 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-701e0284-7cb5-4828-ac16-d4d8c0a74fd7 tempest-ProjectMemberTests-1866302072 None] Created reservations ['43b0293d-02c1-4bf5-8648-623f9006657f', 'dca6a789-3418-4fe5-9985-75efa7bd4cf3', '8a1daa94-4b5c-4522-ab6f-17cd860bc611', '0cdff874-c53e-4c85-92e4-4fbb5e7093d3'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:29:43 devstack sudo[107098]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9cfcc05b-fd16-4b3b-a66c-6af5b127b37b tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-96891ab7-8b12-46cc-87ae-fd4eeb8149cb 1073741824" returned: 0 in 1.025s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:43 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-701e0284-7cb5-4828-ac16-d4d8c0a74fd7 tempest-ProjectMemberTests-1866302072 None] Delete snapshot completed successfully.
Jul 03 01:29:43 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-701e0284-7cb5-4828-ac16-d4d8c0a74fd7 tempest-ProjectMemberTests-1866302072 None] Lock "cinder-6405c4c0-0984-4b96-8fb1-0cd785d63fc3-delete_snapshot" released by "delete_snapshot" :: held 3.677s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:29:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9cfcc05b-fd16-4b3b-a66c-6af5b127b37b tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-96891ab7-8b12-46cc-87ae-fd4eeb8149cb {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:43 devstack sudo[107113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-96891ab7-8b12-46cc-87ae-fd4eeb8149cb
Jul 03 01:29:43 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:43 devstack sudo[107111]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-dc92d195-199c-47f2-8872-9e8b8d42f4f9 tempest-CinderUnicodeTest-944587269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.723s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:43 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-dc92d195-199c-47f2-8872-9e8b8d42f4f9 tempest-CinderUnicodeTest-944587269 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:29:43 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-dc92d195-199c-47f2-8872-9e8b8d42f4f9 tempest-CinderUnicodeTest-944587269 None] Deleted volume successfully.
Jul 03 01:29:43 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-dc92d195-199c-47f2-8872-9e8b8d42f4f9 tempest-CinderUnicodeTest-944587269 None] Lock "cinder-3bf18f36-2368-44de-a105-fdce6a2aed3d-delete_volume" released by "delete_volume" :: held 2.665s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:29:43 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-6bd6acf8-5a98-4329-bc91-06edc93f9831 tempest-ProjectMemberTests-1866302072 None] Acquiring lock "cinder-ce8f9a84-989f-4e2f-ad18-ad88c4731c8f-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:29:43 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-6bd6acf8-5a98-4329-bc91-06edc93f9831 tempest-ProjectMemberTests-1866302072 None] Lock "cinder-ce8f9a84-989f-4e2f-ad18-ad88c4731c8f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:29:43 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-6bd6acf8-5a98-4329-bc91-06edc93f9831 tempest-ProjectMemberTests-1866302072 None] Acquiring lock "cinder-quobyte-ce8f9a84-989f-4e2f-ad18-ad88c4731c8f" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:29:43 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-6bd6acf8-5a98-4329-bc91-06edc93f9831 tempest-ProjectMemberTests-1866302072 None] Lock "cinder-quobyte-ce8f9a84-989f-4e2f-ad18-ad88c4731c8f" acquired by "delete_volume" :: waited 0.024s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:29:43 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39b5181-c233-4c7b-8b3a-476874c6a0fa]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:29:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6bd6acf8-5a98-4329-bc91-06edc93f9831 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ce8f9a84-989f-4e2f-ad18-ad88c4731c8f {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:43 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9cfcc05b-fd16-4b3b-a66c-6af5b127b37b tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-96891ab7-8b12-46cc-87ae-fd4eeb8149cb" returned: 0 in 0.734s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:43 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-9cfcc05b-fd16-4b3b-a66c-6af5b127b37b tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] <== create_volume: return (1825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:29:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-9cfcc05b-fd16-4b3b-a66c-6af5b127b37b tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.830s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:29:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-228d95f3-2178-444e-b69b-68b947bb6520 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.098s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:29:43 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-228d95f3-2178-444e-b69b-68b947bb6520 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:29:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1010335512',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cf22ef5-4584-4c34-ae50-86fc77cc2a9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7562a5d9f07246b5b75ad948296e0626',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:29:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:29:31Z,use_quota=True,user_id='dd43700199e94ef8abd57ba8f111fba6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:29:43 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-228d95f3-2178-444e-b69b-68b947bb6520 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Creating volume 2cf22ef5-4584-4c34-ae50-86fc77cc2a9b {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:29:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-228d95f3-2178-444e-b69b-68b947bb6520 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:29:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-228d95f3-2178-444e-b69b-68b947bb6520 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:29:43 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-228d95f3-2178-444e-b69b-68b947bb6520 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:29:43 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-228d95f3-2178-444e-b69b-68b947bb6520 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:29:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-228d95f3-2178-444e-b69b-68b947bb6520 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:29:43 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-228d95f3-2178-444e-b69b-68b947bb6520 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:29:43 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-228d95f3-2178-444e-b69b-68b947bb6520 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:29:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-228d95f3-2178-444e-b69b-68b947bb6520 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2cf22ef5-4584-4c34-ae50-86fc77cc2a9b 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:43 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-9cfcc05b-fd16-4b3b-a66c-6af5b127b37b tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54bac5d5-c7b3-4a39-a559-604a4e214444) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96891ab7-8b12-46cc-87ae-fd4eeb8149cb', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:43 devstack sudo[107118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2cf22ef5-4584-4c34-ae50-86fc77cc2a9b 1073741824
Jul 03 01:29:43 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-9cfcc05b-fd16-4b3b-a66c-6af5b127b37b tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d7f8c6b-72f3-4f39-817f-2356cc82d9c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:43 devstack sudo[107118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:43 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-9cfcc05b-fd16-4b3b-a66c-6af5b127b37b tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Volume volume-96891ab7-8b12-46cc-87ae-fd4eeb8149cb (96891ab7-8b12-46cc-87ae-fd4eeb8149cb): created successfully
Jul 03 01:29:43 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-9cfcc05b-fd16-4b3b-a66c-6af5b127b37b tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d7f8c6b-72f3-4f39-817f-2356cc82d9c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:43 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-9cfcc05b-fd16-4b3b-a66c-6af5b127b37b tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Flow 'volume_create_manager' (8b99f197-9013-485a-abcf-7139dcdf451b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:29:43 devstack sudo[107117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ce8f9a84-989f-4e2f-ad18-ad88c4731c8f
Jul 03 01:29:43 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-9cfcc05b-fd16-4b3b-a66c-6af5b127b37b tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Created volume successfully.
Jul 03 01:29:43 devstack sudo[107117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:44 devstack sudo[107117]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6bd6acf8-5a98-4329-bc91-06edc93f9831 tempest-ProjectMemberTests-1866302072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ce8f9a84-989f-4e2f-ad18-ad88c4731c8f" returned: 0 in 0.893s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6bd6acf8-5a98-4329-bc91-06edc93f9831 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ce8f9a84-989f-4e2f-ad18-ad88c4731c8f {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:44 devstack sudo[107128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ce8f9a84-989f-4e2f-ad18-ad88c4731c8f
Jul 03 01:29:44 devstack sudo[107128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:44 devstack sudo[107118]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-228d95f3-2178-444e-b69b-68b947bb6520 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2cf22ef5-4584-4c34-ae50-86fc77cc2a9b 1073741824" returned: 0 in 1.092s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-228d95f3-2178-444e-b69b-68b947bb6520 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2cf22ef5-4584-4c34-ae50-86fc77cc2a9b {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:44 devstack sudo[107130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2cf22ef5-4584-4c34-ae50-86fc77cc2a9b
Jul 03 01:29:44 devstack sudo[107130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:45 devstack sudo[107128]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6bd6acf8-5a98-4329-bc91-06edc93f9831 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ce8f9a84-989f-4e2f-ad18-ad88c4731c8f" returned: 0 in 0.742s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:45 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-6bd6acf8-5a98-4329-bc91-06edc93f9831 tempest-ProjectMemberTests-1866302072 None] Lock "cinder-quobyte-ce8f9a84-989f-4e2f-ad18-ad88c4731c8f" released by "delete_volume" :: held 1.698s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:29:45 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-6bd6acf8-5a98-4329-bc91-06edc93f9831 tempest-ProjectMemberTests-1866302072 None] Created reservations ['45e57cee-c596-41c7-8016-f0eadd71d4ed', 'a708ea02-a138-416b-bfe9-1b24761afda6', 'e7d10bd1-f16b-440e-8cea-db89e311e023', 'da9b1a7b-ed76-4f8e-a4b5-783293ce2430'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:29:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-6bd6acf8-5a98-4329-bc91-06edc93f9831 tempest-ProjectMemberTests-1866302072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:29:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-6bd6acf8-5a98-4329-bc91-06edc93f9831 tempest-ProjectMemberTests-1866302072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:29:45 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-6bd6acf8-5a98-4329-bc91-06edc93f9831 tempest-ProjectMemberTests-1866302072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:29:45 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-6bd6acf8-5a98-4329-bc91-06edc93f9831 tempest-ProjectMemberTests-1866302072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:29:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-6bd6acf8-5a98-4329-bc91-06edc93f9831 tempest-ProjectMemberTests-1866302072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:29:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6bd6acf8-5a98-4329-bc91-06edc93f9831 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:45 devstack sudo[107134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:29:45 devstack sudo[107134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:45 devstack sudo[107130]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-228d95f3-2178-444e-b69b-68b947bb6520 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2cf22ef5-4584-4c34-ae50-86fc77cc2a9b" returned: 0 in 0.698s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:45 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-228d95f3-2178-444e-b69b-68b947bb6520 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] <== create_volume: return (1845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:29:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-228d95f3-2178-444e-b69b-68b947bb6520 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.849s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:29:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-ff993042-f847-45db-a537-777a7372e797 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.497s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:29:45 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-ff993042-f847-45db-a537-777a7372e797 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:29:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1390365674',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39a02328-ef2c-4764-899c-d52bc7aacb47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7562a5d9f07246b5b75ad948296e0626',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:29:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:29:31Z,use_quota=True,user_id='dd43700199e94ef8abd57ba8f111fba6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:29:45 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-ff993042-f847-45db-a537-777a7372e797 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Creating volume 39a02328-ef2c-4764-899c-d52bc7aacb47 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:29:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-ff993042-f847-45db-a537-777a7372e797 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:29:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-ff993042-f847-45db-a537-777a7372e797 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:29:45 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-ff993042-f847-45db-a537-777a7372e797 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:29:45 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-ff993042-f847-45db-a537-777a7372e797 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:29:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-ff993042-f847-45db-a537-777a7372e797 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:29:45 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-ff993042-f847-45db-a537-777a7372e797 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:29:45 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-ff993042-f847-45db-a537-777a7372e797 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:29:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-ff993042-f847-45db-a537-777a7372e797 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-39a02328-ef2c-4764-899c-d52bc7aacb47 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:45 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-228d95f3-2178-444e-b69b-68b947bb6520 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38915cf6-8862-430c-9335-10527b9825a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cf22ef5-4584-4c34-ae50-86fc77cc2a9b', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:45 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-228d95f3-2178-444e-b69b-68b947bb6520 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (868b586d-e47b-48e8-905a-bf5cd6fd1bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:45 devstack sudo[107136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-39a02328-ef2c-4764-899c-d52bc7aacb47 1073741824
Jul 03 01:29:45 devstack sudo[107136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:45 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-228d95f3-2178-444e-b69b-68b947bb6520 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Volume volume-2cf22ef5-4584-4c34-ae50-86fc77cc2a9b (2cf22ef5-4584-4c34-ae50-86fc77cc2a9b): created successfully
Jul 03 01:29:45 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-228d95f3-2178-444e-b69b-68b947bb6520 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (868b586d-e47b-48e8-905a-bf5cd6fd1bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:45 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-228d95f3-2178-444e-b69b-68b947bb6520 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Flow 'volume_create_manager' (751597eb-e2c7-4f6d-873f-e9bc17e4ef52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:29:45 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-228d95f3-2178-444e-b69b-68b947bb6520 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Created volume successfully.
Jul 03 01:29:46 devstack sudo[107134]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6bd6acf8-5a98-4329-bc91-06edc93f9831 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.848s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:46 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-6bd6acf8-5a98-4329-bc91-06edc93f9831 tempest-ProjectMemberTests-1866302072 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:29:46 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-6bd6acf8-5a98-4329-bc91-06edc93f9831 tempest-ProjectMemberTests-1866302072 None] Deleted volume successfully.
Jul 03 01:29:46 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-6bd6acf8-5a98-4329-bc91-06edc93f9831 tempest-ProjectMemberTests-1866302072 None] Lock "cinder-ce8f9a84-989f-4e2f-ad18-ad88c4731c8f-delete_volume" released by "delete_volume" :: held 2.781s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:29:46 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-39e1afdd-00b4-4fca-978d-a37dca870cdc tempest-ProjectMemberTests-1866302072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:29:46 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-39e1afdd-00b4-4fca-978d-a37dca870cdc tempest-ProjectMemberTests-1866302072 None] Flow 'volume_create_manager' (e7e7e01f-ef78-47c6-8edd-c1caa59f3c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:29:46 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-39e1afdd-00b4-4fca-978d-a37dca870cdc tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69465b05-c153-48ff-8eda-dbf3174ffa0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:46 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-39e1afdd-00b4-4fca-978d-a37dca870cdc tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69465b05-c153-48ff-8eda-dbf3174ffa0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:29:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1322505815',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82f5ac00-9bb6-46ef-abb1-c8eb55547597,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16429f2745354b0591f4044f3a99b9fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:29:46Z,use_quota=True,user_id='31dd51f2dcdd4724a4c6b78cb80e6d8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:46 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-39e1afdd-00b4-4fca-978d-a37dca870cdc tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bbb78b8-805f-4821-8a65-cc25944c87ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:46 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-39e1afdd-00b4-4fca-978d-a37dca870cdc tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bbb78b8-805f-4821-8a65-cc25944c87ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:46 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-39e1afdd-00b4-4fca-978d-a37dca870cdc tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be44b931-90f6-45d7-99ca-205235622efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:46 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-39e1afdd-00b4-4fca-978d-a37dca870cdc tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be44b931-90f6-45d7-99ca-205235622efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82f5ac00-9bb6-46ef-abb1-c8eb55547597', 'volume_name': 'volume-82f5ac00-9bb6-46ef-abb1-c8eb55547597', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:46 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-39e1afdd-00b4-4fca-978d-a37dca870cdc tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04a1bc2d-ecb0-4707-9dab-4c326de4477a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:46 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-39e1afdd-00b4-4fca-978d-a37dca870cdc tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04a1bc2d-ecb0-4707-9dab-4c326de4477a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:46 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-39e1afdd-00b4-4fca-978d-a37dca870cdc tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad560888-6f96-404d-8e84-e89b69c7b0f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:46 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-39e1afdd-00b4-4fca-978d-a37dca870cdc tempest-ProjectMemberTests-1866302072 None] Volume 82f5ac00-9bb6-46ef-abb1-c8eb55547597: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82f5ac00-9bb6-46ef-abb1-c8eb55547597', 'volume_size': 1}
Jul 03 01:29:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-39e1afdd-00b4-4fca-978d-a37dca870cdc tempest-ProjectMemberTests-1866302072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:29:46 devstack sudo[107136]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-ff993042-f847-45db-a537-777a7372e797 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-39a02328-ef2c-4764-899c-d52bc7aacb47 1073741824" returned: 0 in 1.064s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-ff993042-f847-45db-a537-777a7372e797 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-39a02328-ef2c-4764-899c-d52bc7aacb47 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:46 devstack sudo[107143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-39a02328-ef2c-4764-899c-d52bc7aacb47
Jul 03 01:29:46 devstack sudo[107143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:47 devstack sudo[107143]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-ff993042-f847-45db-a537-777a7372e797 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-39a02328-ef2c-4764-899c-d52bc7aacb47" returned: 0 in 0.657s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:47 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-ff993042-f847-45db-a537-777a7372e797 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] <== create_volume: return (1762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:29:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-ff993042-f847-45db-a537-777a7372e797 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.765s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:29:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-249a5ac2-6d4c-40e3-b527-c20de0a36239 tempest-VolumeDependencyTests-341232480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.547s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:29:47 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-249a5ac2-6d4c-40e3-b527-c20de0a36239 tempest-VolumeDependencyTests-341232480 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-52317419',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b160888-756d-4574-b870-30149de01b6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c37b4b8c4ec44481924a7fee411ecc39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:29:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:29:39Z,use_quota=True,user_id='f68cb093039944b88d385ffca1179656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:29:47 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-249a5ac2-6d4c-40e3-b527-c20de0a36239 tempest-VolumeDependencyTests-341232480 None] Creating volume 8b160888-756d-4574-b870-30149de01b6a {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:29:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-249a5ac2-6d4c-40e3-b527-c20de0a36239 tempest-VolumeDependencyTests-341232480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:29:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-249a5ac2-6d4c-40e3-b527-c20de0a36239 tempest-VolumeDependencyTests-341232480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:29:47 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-249a5ac2-6d4c-40e3-b527-c20de0a36239 tempest-VolumeDependencyTests-341232480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:29:47 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-249a5ac2-6d4c-40e3-b527-c20de0a36239 tempest-VolumeDependencyTests-341232480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:29:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-249a5ac2-6d4c-40e3-b527-c20de0a36239 tempest-VolumeDependencyTests-341232480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:29:47 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-249a5ac2-6d4c-40e3-b527-c20de0a36239 tempest-VolumeDependencyTests-341232480 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:29:47 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-249a5ac2-6d4c-40e3-b527-c20de0a36239 tempest-VolumeDependencyTests-341232480 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:29:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-249a5ac2-6d4c-40e3-b527-c20de0a36239 tempest-VolumeDependencyTests-341232480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b160888-756d-4574-b870-30149de01b6a 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ff993042-f847-45db-a537-777a7372e797 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c040ea2-ec85-44bb-9861-1cf70235741e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39a02328-ef2c-4764-899c-d52bc7aacb47', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ff993042-f847-45db-a537-777a7372e797 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eac026ca-2270-43f3-91be-2c6e88fb464a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:47 devstack sudo[107146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b160888-756d-4574-b870-30149de01b6a 1073741824
Jul 03 01:29:47 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:47 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-ff993042-f847-45db-a537-777a7372e797 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Volume volume-39a02328-ef2c-4764-899c-d52bc7aacb47 (39a02328-ef2c-4764-899c-d52bc7aacb47): created successfully
Jul 03 01:29:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ff993042-f847-45db-a537-777a7372e797 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eac026ca-2270-43f3-91be-2c6e88fb464a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:47 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-ff993042-f847-45db-a537-777a7372e797 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Flow 'volume_create_manager' (731d23e0-d09b-40d4-b77a-78678edc01a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:29:47 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-ff993042-f847-45db-a537-777a7372e797 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Created volume successfully.
Jul 03 01:29:48 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-249a5ac2-6d4c-40e3-b527-c20de0a36239 tempest-VolumeDependencyTests-341232480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b160888-756d-4574-b870-30149de01b6a 1073741824" returned: 0 in 0.838s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-249a5ac2-6d4c-40e3-b527-c20de0a36239 tempest-VolumeDependencyTests-341232480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b160888-756d-4574-b870-30149de01b6a {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:48 devstack sudo[107151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b160888-756d-4574-b870-30149de01b6a
Jul 03 01:29:48 devstack sudo[107151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:48 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-526ecf94-c693-4ba4-a185-5f6be0933385 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Acquiring lock "cinder-39a02328-ef2c-4764-899c-d52bc7aacb47-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:29:48 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-526ecf94-c693-4ba4-a185-5f6be0933385 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Lock "cinder-39a02328-ef2c-4764-899c-d52bc7aacb47-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:29:48 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-526ecf94-c693-4ba4-a185-5f6be0933385 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Acquiring lock "cinder-quobyte-39a02328-ef2c-4764-899c-d52bc7aacb47" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:29:48 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-526ecf94-c693-4ba4-a185-5f6be0933385 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Lock "cinder-quobyte-39a02328-ef2c-4764-899c-d52bc7aacb47" acquired by "delete_volume" :: waited 0.025s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:29:48 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac99c74-7ddb-4696-9129-998e99a2c156]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:29:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-526ecf94-c693-4ba4-a185-5f6be0933385 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-39a02328-ef2c-4764-899c-d52bc7aacb47 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:48 devstack sudo[107153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-39a02328-ef2c-4764-899c-d52bc7aacb47
Jul 03 01:29:48 devstack sudo[107153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:49 devstack sudo[107151]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-249a5ac2-6d4c-40e3-b527-c20de0a36239 tempest-VolumeDependencyTests-341232480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b160888-756d-4574-b870-30149de01b6a" returned: 0 in 0.817s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:49 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-249a5ac2-6d4c-40e3-b527-c20de0a36239 tempest-VolumeDependencyTests-341232480 None] <== create_volume: return (1706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:29:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-249a5ac2-6d4c-40e3-b527-c20de0a36239 tempest-VolumeDependencyTests-341232480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.709s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:29:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-39e1afdd-00b4-4fca-978d-a37dca870cdc tempest-ProjectMemberTests-1866302072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.538s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:29:49 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-39e1afdd-00b4-4fca-978d-a37dca870cdc tempest-ProjectMemberTests-1866302072 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:29:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1322505815',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82f5ac00-9bb6-46ef-abb1-c8eb55547597,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16429f2745354b0591f4044f3a99b9fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:29:46Z,use_quota=True,user_id='31dd51f2dcdd4724a4c6b78cb80e6d8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:29:49 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-39e1afdd-00b4-4fca-978d-a37dca870cdc tempest-ProjectMemberTests-1866302072 None] Creating volume 82f5ac00-9bb6-46ef-abb1-c8eb55547597 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:29:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-39e1afdd-00b4-4fca-978d-a37dca870cdc tempest-ProjectMemberTests-1866302072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:29:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-39e1afdd-00b4-4fca-978d-a37dca870cdc tempest-ProjectMemberTests-1866302072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:29:49 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-39e1afdd-00b4-4fca-978d-a37dca870cdc tempest-ProjectMemberTests-1866302072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:29:49 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-39e1afdd-00b4-4fca-978d-a37dca870cdc tempest-ProjectMemberTests-1866302072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:29:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-39e1afdd-00b4-4fca-978d-a37dca870cdc tempest-ProjectMemberTests-1866302072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:29:49 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-39e1afdd-00b4-4fca-978d-a37dca870cdc tempest-ProjectMemberTests-1866302072 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:29:49 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-39e1afdd-00b4-4fca-978d-a37dca870cdc tempest-ProjectMemberTests-1866302072 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:29:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-39e1afdd-00b4-4fca-978d-a37dca870cdc tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-82f5ac00-9bb6-46ef-abb1-c8eb55547597 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:49 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-249a5ac2-6d4c-40e3-b527-c20de0a36239 tempest-VolumeDependencyTests-341232480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1df9ed6-90a0-47c0-b016-aefa95e3b909) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b160888-756d-4574-b870-30149de01b6a', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:49 devstack sudo[107157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-82f5ac00-9bb6-46ef-abb1-c8eb55547597 1073741824
Jul 03 01:29:49 devstack sudo[107157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:49 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-249a5ac2-6d4c-40e3-b527-c20de0a36239 tempest-VolumeDependencyTests-341232480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb7bd2fa-4da8-4247-9138-db3f31dc2aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:49 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-249a5ac2-6d4c-40e3-b527-c20de0a36239 tempest-VolumeDependencyTests-341232480 None] Volume volume-8b160888-756d-4574-b870-30149de01b6a (8b160888-756d-4574-b870-30149de01b6a): created successfully
Jul 03 01:29:49 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-249a5ac2-6d4c-40e3-b527-c20de0a36239 tempest-VolumeDependencyTests-341232480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb7bd2fa-4da8-4247-9138-db3f31dc2aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:49 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-249a5ac2-6d4c-40e3-b527-c20de0a36239 tempest-VolumeDependencyTests-341232480 None] Flow 'volume_create_manager' (e930258e-20e7-4a3d-ad7d-257b3580473f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:29:49 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-249a5ac2-6d4c-40e3-b527-c20de0a36239 tempest-VolumeDependencyTests-341232480 None] Created volume successfully.
Jul 03 01:29:49 devstack sudo[107153]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-526ecf94-c693-4ba4-a185-5f6be0933385 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-39a02328-ef2c-4764-899c-d52bc7aacb47" returned: 0 in 0.834s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-526ecf94-c693-4ba4-a185-5f6be0933385 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-39a02328-ef2c-4764-899c-d52bc7aacb47 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:49 devstack sudo[107162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-39a02328-ef2c-4764-899c-d52bc7aacb47
Jul 03 01:29:49 devstack sudo[107162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e7a1b074-e91d-4470-bac9-ab9a64e2a6ec tempest-VolumeDependencyTests-341232480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:29:50 devstack sudo[107162]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-526ecf94-c693-4ba4-a185-5f6be0933385 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-39a02328-ef2c-4764-899c-d52bc7aacb47" returned: 0 in 0.822s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:50 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-526ecf94-c693-4ba4-a185-5f6be0933385 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Lock "cinder-quobyte-39a02328-ef2c-4764-899c-d52bc7aacb47" released by "delete_volume" :: held 1.726s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:29:50 devstack sudo[107157]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-39e1afdd-00b4-4fca-978d-a37dca870cdc tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-82f5ac00-9bb6-46ef-abb1-c8eb55547597 1073741824" returned: 0 in 1.067s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-39e1afdd-00b4-4fca-978d-a37dca870cdc tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-82f5ac00-9bb6-46ef-abb1-c8eb55547597 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:50 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-526ecf94-c693-4ba4-a185-5f6be0933385 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Created reservations ['977d5a3e-2335-4e70-911b-86cd55950286', '299bc6ee-4aa1-48a3-89bf-d5834452e63c', 'fc204f36-6def-4cbb-acbb-1efe58b388fa', 'bc3f6a86-f5e3-4779-bf5e-1568c2885019'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:29:50 devstack sudo[107169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-82f5ac00-9bb6-46ef-abb1-c8eb55547597
Jul 03 01:29:50 devstack sudo[107169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-526ecf94-c693-4ba4-a185-5f6be0933385 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:29:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-526ecf94-c693-4ba4-a185-5f6be0933385 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:29:50 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-526ecf94-c693-4ba4-a185-5f6be0933385 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:29:50 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-526ecf94-c693-4ba4-a185-5f6be0933385 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:29:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-526ecf94-c693-4ba4-a185-5f6be0933385 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:29:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-526ecf94-c693-4ba4-a185-5f6be0933385 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:50 devstack sudo[107171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:29:50 devstack sudo[107171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:50 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d54a5bba-8067-423a-828e-dc6a4707d060 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Acquiring lock "cinder-2cf22ef5-4584-4c34-ae50-86fc77cc2a9b-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:29:50 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d54a5bba-8067-423a-828e-dc6a4707d060 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Lock "cinder-2cf22ef5-4584-4c34-ae50-86fc77cc2a9b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:29:50 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d54a5bba-8067-423a-828e-dc6a4707d060 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Acquiring lock "cinder-quobyte-2cf22ef5-4584-4c34-ae50-86fc77cc2a9b" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:29:50 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d54a5bba-8067-423a-828e-dc6a4707d060 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Lock "cinder-quobyte-2cf22ef5-4584-4c34-ae50-86fc77cc2a9b" acquired by "delete_volume" :: waited 0.019s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:29:50 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a3855e-dac2-4b81-950b-f359af2feaef]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:29:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d54a5bba-8067-423a-828e-dc6a4707d060 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2cf22ef5-4584-4c34-ae50-86fc77cc2a9b {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:50 devstack sudo[107173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2cf22ef5-4584-4c34-ae50-86fc77cc2a9b
Jul 03 01:29:50 devstack sudo[107173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:51 devstack sudo[107169]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:51 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-39e1afdd-00b4-4fca-978d-a37dca870cdc tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-82f5ac00-9bb6-46ef-abb1-c8eb55547597" returned: 0 in 0.778s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:51 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-39e1afdd-00b4-4fca-978d-a37dca870cdc tempest-ProjectMemberTests-1866302072 None] <== create_volume: return (1899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:29:51 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-39e1afdd-00b4-4fca-978d-a37dca870cdc tempest-ProjectMemberTests-1866302072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.905s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:29:51 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e7a1b074-e91d-4470-bac9-ab9a64e2a6ec tempest-VolumeDependencyTests-341232480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.183s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:29:51 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-39e1afdd-00b4-4fca-978d-a37dca870cdc tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad560888-6f96-404d-8e84-e89b69c7b0f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82f5ac00-9bb6-46ef-abb1-c8eb55547597', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:51 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-39e1afdd-00b4-4fca-978d-a37dca870cdc tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (167ee1e3-fe81-4598-8630-c37d6769eabe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:51 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-e7a1b074-e91d-4470-bac9-ab9a64e2a6ec tempest-VolumeDependencyTests-341232480 None] Creating offline snapshot f9586d46-c230-4c76-9bf5-9192155e46a7 of volume 8b160888-756d-4574-b870-30149de01b6a {{(pid=86891) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 01:29:51 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-39e1afdd-00b4-4fca-978d-a37dca870cdc tempest-ProjectMemberTests-1866302072 None] Volume volume-82f5ac00-9bb6-46ef-abb1-c8eb55547597 (82f5ac00-9bb6-46ef-abb1-c8eb55547597): created successfully
Jul 03 01:29:51 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-39e1afdd-00b4-4fca-978d-a37dca870cdc tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (167ee1e3-fe81-4598-8630-c37d6769eabe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:51 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-39e1afdd-00b4-4fca-978d-a37dca870cdc tempest-ProjectMemberTests-1866302072 None] Flow 'volume_create_manager' (e7e7e01f-ef78-47c6-8edd-c1caa59f3c03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:29:51 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[0887bf06-d813-43d6-bf63-b7e13dcb5cbe]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:29:51 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e7a1b074-e91d-4470-bac9-ab9a64e2a6ec tempest-VolumeDependencyTests-341232480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b160888-756d-4574-b870-30149de01b6a {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:51 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-39e1afdd-00b4-4fca-978d-a37dca870cdc tempest-ProjectMemberTests-1866302072 None] Created volume successfully.
Jul 03 01:29:51 devstack sudo[107177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b160888-756d-4574-b870-30149de01b6a
Jul 03 01:29:51 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:51 devstack sudo[107171]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:51 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-526ecf94-c693-4ba4-a185-5f6be0933385 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.886s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:51 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-526ecf94-c693-4ba4-a185-5f6be0933385 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:29:51 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-526ecf94-c693-4ba4-a185-5f6be0933385 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Deleted volume successfully.
Jul 03 01:29:51 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-526ecf94-c693-4ba4-a185-5f6be0933385 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Lock "cinder-39a02328-ef2c-4764-899c-d52bc7aacb47-delete_volume" released by "delete_volume" :: held 2.875s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:29:51 devstack sudo[107173]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:51 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d54a5bba-8067-423a-828e-dc6a4707d060 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2cf22ef5-4584-4c34-ae50-86fc77cc2a9b" returned: 0 in 0.911s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:51 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d54a5bba-8067-423a-828e-dc6a4707d060 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2cf22ef5-4584-4c34-ae50-86fc77cc2a9b {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:51 devstack sudo[107182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2cf22ef5-4584-4c34-ae50-86fc77cc2a9b
Jul 03 01:29:51 devstack sudo[107182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:51 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:51 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e7a1b074-e91d-4470-bac9-ab9a64e2a6ec tempest-VolumeDependencyTests-341232480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b160888-756d-4574-b870-30149de01b6a" returned: 0 in 0.851s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:51 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e7a1b074-e91d-4470-bac9-ab9a64e2a6ec tempest-VolumeDependencyTests-341232480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b160888-756d-4574-b870-30149de01b6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b160888-756d-4574-b870-30149de01b6a.f9586d46-c230-4c76-9bf5-9192155e46a7 1G {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:52 devstack sudo[107187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b160888-756d-4574-b870-30149de01b6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b160888-756d-4574-b870-30149de01b6a.f9586d46-c230-4c76-9bf5-9192155e46a7 1G
Jul 03 01:29:52 devstack sudo[107187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-0c4569d3-79d3-4ca6-ba90-dea010f11bf1 tempest-ProjectMemberTests-1866302072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:29:52 devstack sudo[107182]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d54a5bba-8067-423a-828e-dc6a4707d060 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-2cf22ef5-4584-4c34-ae50-86fc77cc2a9b" returned: 0 in 0.775s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:52 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d54a5bba-8067-423a-828e-dc6a4707d060 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Lock "cinder-quobyte-2cf22ef5-4584-4c34-ae50-86fc77cc2a9b" released by "delete_volume" :: held 1.751s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:29:52 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-d54a5bba-8067-423a-828e-dc6a4707d060 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Created reservations ['bc3ec571-f11a-4a07-a3fc-3ecfb7065dc0', '38a70925-2f12-4fe3-8dd9-12da2f7e0990', '4c3c8412-2644-4724-a856-9abf7d66b260', '7022f9aa-6c5f-4fa2-83c3-6ee79622d06e'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:29:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-d54a5bba-8067-423a-828e-dc6a4707d060 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:29:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-d54a5bba-8067-423a-828e-dc6a4707d060 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:29:52 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-d54a5bba-8067-423a-828e-dc6a4707d060 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:29:52 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-d54a5bba-8067-423a-828e-dc6a4707d060 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:29:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-d54a5bba-8067-423a-828e-dc6a4707d060 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:29:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d54a5bba-8067-423a-828e-dc6a4707d060 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:52 devstack sudo[107193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:29:52 devstack sudo[107193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:52 devstack sudo[107187]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e7a1b074-e91d-4470-bac9-ab9a64e2a6ec tempest-VolumeDependencyTests-341232480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b160888-756d-4574-b870-30149de01b6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b160888-756d-4574-b870-30149de01b6a.f9586d46-c230-4c76-9bf5-9192155e46a7 1G" returned: 0 in 0.886s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e7a1b074-e91d-4470-bac9-ab9a64e2a6ec tempest-VolumeDependencyTests-341232480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b160888-756d-4574-b870-30149de01b6a -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b160888-756d-4574-b870-30149de01b6a.f9586d46-c230-4c76-9bf5-9192155e46a7 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:52 devstack sudo[107195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b160888-756d-4574-b870-30149de01b6a -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b160888-756d-4574-b870-30149de01b6a.f9586d46-c230-4c76-9bf5-9192155e46a7
Jul 03 01:29:52 devstack sudo[107195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:53 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-a03d3139-a776-43cb-9431-c00bd56c0b5b tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Acquiring lock "cinder-96891ab7-8b12-46cc-87ae-fd4eeb8149cb-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:29:53 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-a03d3139-a776-43cb-9431-c00bd56c0b5b tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Lock "cinder-96891ab7-8b12-46cc-87ae-fd4eeb8149cb-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:29:53 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-a03d3139-a776-43cb-9431-c00bd56c0b5b tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Acquiring lock "cinder-quobyte-96891ab7-8b12-46cc-87ae-fd4eeb8149cb" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:29:53 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-a03d3139-a776-43cb-9431-c00bd56c0b5b tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Lock "cinder-quobyte-96891ab7-8b12-46cc-87ae-fd4eeb8149cb" acquired by "delete_volume" :: waited 0.019s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:29:53 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f7efe93-e98c-44c2-9786-1c8460e4b91d]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:29:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a03d3139-a776-43cb-9431-c00bd56c0b5b tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-96891ab7-8b12-46cc-87ae-fd4eeb8149cb {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:53 devstack sudo[107193]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d54a5bba-8067-423a-828e-dc6a4707d060 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.698s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:53 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-d54a5bba-8067-423a-828e-dc6a4707d060 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:29:53 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-d54a5bba-8067-423a-828e-dc6a4707d060 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Deleted volume successfully.
Jul 03 01:29:53 devstack sudo[107198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-96891ab7-8b12-46cc-87ae-fd4eeb8149cb
Jul 03 01:29:53 devstack sudo[107198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:53 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d54a5bba-8067-423a-828e-dc6a4707d060 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Lock "cinder-2cf22ef5-4584-4c34-ae50-86fc77cc2a9b-delete_volume" released by "delete_volume" :: held 2.673s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:29:53 devstack sudo[107195]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e7a1b074-e91d-4470-bac9-ab9a64e2a6ec tempest-VolumeDependencyTests-341232480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b160888-756d-4574-b870-30149de01b6a -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b160888-756d-4574-b870-30149de01b6a.f9586d46-c230-4c76-9bf5-9192155e46a7" returned: 0 in 0.787s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:53 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-e7a1b074-e91d-4470-bac9-ab9a64e2a6ec tempest-VolumeDependencyTests-341232480 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b160888-756d-4574-b870-30149de01b6a.f9586d46-c230-4c76-9bf5-9192155e46a7 is being set with open permissions: ugo+rw
Jul 03 01:29:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e7a1b074-e91d-4470-bac9-ab9a64e2a6ec tempest-VolumeDependencyTests-341232480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b160888-756d-4574-b870-30149de01b6a.f9586d46-c230-4c76-9bf5-9192155e46a7 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:53 devstack sudo[107203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b160888-756d-4574-b870-30149de01b6a.f9586d46-c230-4c76-9bf5-9192155e46a7
Jul 03 01:29:53 devstack sudo[107203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:54 devstack sudo[107198]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:54 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a03d3139-a776-43cb-9431-c00bd56c0b5b tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-96891ab7-8b12-46cc-87ae-fd4eeb8149cb" returned: 0 in 0.818s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:54 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a03d3139-a776-43cb-9431-c00bd56c0b5b tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-96891ab7-8b12-46cc-87ae-fd4eeb8149cb {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:54 devstack sudo[107208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-96891ab7-8b12-46cc-87ae-fd4eeb8149cb
Jul 03 01:29:54 devstack sudo[107208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:54 devstack sudo[107203]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:54 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e7a1b074-e91d-4470-bac9-ab9a64e2a6ec tempest-VolumeDependencyTests-341232480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b160888-756d-4574-b870-30149de01b6a.f9586d46-c230-4c76-9bf5-9192155e46a7" returned: 0 in 0.687s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:54 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e7a1b074-e91d-4470-bac9-ab9a64e2a6ec tempest-VolumeDependencyTests-341232480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b160888-756d-4574-b870-30149de01b6a.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:54 devstack sudo[107211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b160888-756d-4574-b870-30149de01b6a.info
Jul 03 01:29:54 devstack sudo[107211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:54 devstack sudo[107208]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:54 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a03d3139-a776-43cb-9431-c00bd56c0b5b tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-96891ab7-8b12-46cc-87ae-fd4eeb8149cb" returned: 0 in 0.737s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:54 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-a03d3139-a776-43cb-9431-c00bd56c0b5b tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Lock "cinder-quobyte-96891ab7-8b12-46cc-87ae-fd4eeb8149cb" released by "delete_volume" :: held 1.601s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:29:54 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-a03d3139-a776-43cb-9431-c00bd56c0b5b tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Created reservations ['a29cb2fb-8853-4088-89de-6e9eda33cf11', '808c17f8-5ca2-4efa-b8ff-6169e8bb6d8f', '37144bab-7cd9-4e04-957f-ce32410a50a6', '51fcde69-2ee1-4a40-91e6-d43d47b254a1'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:29:54 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a03d3139-a776-43cb-9431-c00bd56c0b5b tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:29:54 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a03d3139-a776-43cb-9431-c00bd56c0b5b tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:29:54 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-a03d3139-a776-43cb-9431-c00bd56c0b5b tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:29:54 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-a03d3139-a776-43cb-9431-c00bd56c0b5b tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:29:54 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a03d3139-a776-43cb-9431-c00bd56c0b5b tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:29:54 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a03d3139-a776-43cb-9431-c00bd56c0b5b tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:55 devstack sudo[107215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:29:55 devstack sudo[107215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:55 devstack sudo[107211]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e7a1b074-e91d-4470-bac9-ab9a64e2a6ec tempest-VolumeDependencyTests-341232480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b160888-756d-4574-b870-30149de01b6a.info" returned: 0 in 0.697s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:55 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-e7a1b074-e91d-4470-bac9-ab9a64e2a6ec tempest-VolumeDependencyTests-341232480 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b160888-756d-4574-b870-30149de01b6a.info is being set with open permissions: ugo+rw
Jul 03 01:29:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e7a1b074-e91d-4470-bac9-ab9a64e2a6ec tempest-VolumeDependencyTests-341232480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b160888-756d-4574-b870-30149de01b6a.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:55 devstack sudo[107217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b160888-756d-4574-b870-30149de01b6a.info
Jul 03 01:29:55 devstack sudo[107217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:55 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-a1e2a353-17e0-4d35-a64a-7e7057a7521a tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Acquiring lock "cinder-57bcf82c-b865-4e5c-af57-9893c97541f9-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:29:55 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-a1e2a353-17e0-4d35-a64a-7e7057a7521a tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Lock "cinder-57bcf82c-b865-4e5c-af57-9893c97541f9-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:29:55 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-a1e2a353-17e0-4d35-a64a-7e7057a7521a tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Acquiring lock "cinder-quobyte-57bcf82c-b865-4e5c-af57-9893c97541f9" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:29:55 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-a1e2a353-17e0-4d35-a64a-7e7057a7521a tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Lock "cinder-quobyte-57bcf82c-b865-4e5c-af57-9893c97541f9" acquired by "delete_volume" :: waited 0.027s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:29:55 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[97502c0e-9f23-4268-90bb-3a42b739f373]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:29:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a1e2a353-17e0-4d35-a64a-7e7057a7521a tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-57bcf82c-b865-4e5c-af57-9893c97541f9 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:55 devstack sudo[107215]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a03d3139-a776-43cb-9431-c00bd56c0b5b tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.721s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:55 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-a03d3139-a776-43cb-9431-c00bd56c0b5b tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:29:55 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-a03d3139-a776-43cb-9431-c00bd56c0b5b tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Deleted volume successfully.
Jul 03 01:29:55 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-a03d3139-a776-43cb-9431-c00bd56c0b5b tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Lock "cinder-96891ab7-8b12-46cc-87ae-fd4eeb8149cb-delete_volume" released by "delete_volume" :: held 2.546s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:29:55 devstack sudo[107220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-57bcf82c-b865-4e5c-af57-9893c97541f9
Jul 03 01:29:55 devstack sudo[107217]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:55 devstack sudo[107220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e7a1b074-e91d-4470-bac9-ab9a64e2a6ec tempest-VolumeDependencyTests-341232480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b160888-756d-4574-b870-30149de01b6a.info" returned: 0 in 0.721s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e7a1b074-e91d-4470-bac9-ab9a64e2a6ec tempest-VolumeDependencyTests-341232480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.764s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:29:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-0c4569d3-79d3-4ca6-ba90-dea010f11bf1 tempest-ProjectMemberTests-1866302072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.702s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:29:55 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-0c4569d3-79d3-4ca6-ba90-dea010f11bf1 tempest-ProjectMemberTests-1866302072 None] Creating offline snapshot 3e7bbfdc-b91a-40d8-9ec6-8f2f53a0cd14 of volume 82f5ac00-9bb6-46ef-abb1-c8eb55547597 {{(pid=86891) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 01:29:55 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-e7a1b074-e91d-4470-bac9-ab9a64e2a6ec tempest-VolumeDependencyTests-341232480 None] Create snapshot completed successfully
Jul 03 01:29:55 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3fcc9ca-118c-43a6-9142-18cdeedc97ae]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:29:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0c4569d3-79d3-4ca6-ba90-dea010f11bf1 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-82f5ac00-9bb6-46ef-abb1-c8eb55547597 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:56 devstack sudo[107223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-82f5ac00-9bb6-46ef-abb1-c8eb55547597
Jul 03 01:29:56 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:56 devstack sudo[107220]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a1e2a353-17e0-4d35-a64a-7e7057a7521a tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-57bcf82c-b865-4e5c-af57-9893c97541f9" returned: 0 in 0.882s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a1e2a353-17e0-4d35-a64a-7e7057a7521a tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-57bcf82c-b865-4e5c-af57-9893c97541f9 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:56 devstack sudo[107228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-57bcf82c-b865-4e5c-af57-9893c97541f9
Jul 03 01:29:56 devstack sudo[107228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:56 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0c4569d3-79d3-4ca6-ba90-dea010f11bf1 tempest-ProjectMemberTests-1866302072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-82f5ac00-9bb6-46ef-abb1-c8eb55547597" returned: 0 in 0.937s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0c4569d3-79d3-4ca6-ba90-dea010f11bf1 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-82f5ac00-9bb6-46ef-abb1-c8eb55547597,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-82f5ac00-9bb6-46ef-abb1-c8eb55547597.3e7bbfdc-b91a-40d8-9ec6-8f2f53a0cd14 1G {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:56 devstack sudo[107234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-82f5ac00-9bb6-46ef-abb1-c8eb55547597,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-82f5ac00-9bb6-46ef-abb1-c8eb55547597.3e7bbfdc-b91a-40d8-9ec6-8f2f53a0cd14 1G
Jul 03 01:29:56 devstack sudo[107234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:57 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-c438f4b5-5ec9-44d6-863d-386b84ae5a09 tempest-VolumeDependencyTests-341232480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:29:57 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c438f4b5-5ec9-44d6-863d-386b84ae5a09 tempest-VolumeDependencyTests-341232480 None] Flow 'volume_create_manager' (690bd6c8-dee9-41f8-92b8-ca56cbf119db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:29:57 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c438f4b5-5ec9-44d6-863d-386b84ae5a09 tempest-VolumeDependencyTests-341232480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b95cc40-e46e-4e15-bd8b-953135002ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:57 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c438f4b5-5ec9-44d6-863d-386b84ae5a09 tempest-VolumeDependencyTests-341232480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b95cc40-e46e-4e15-bd8b-953135002ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:29:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1949143051',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=250d92b3-d79d-479d-8804-848032171308,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c37b4b8c4ec44481924a7fee411ecc39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:29:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f9586d46-c230-4c76-9bf5-9192155e46a7,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:29:57Z,use_quota=True,user_id='f68cb093039944b88d385ffca1179656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:57 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c438f4b5-5ec9-44d6-863d-386b84ae5a09 tempest-VolumeDependencyTests-341232480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (142c94ca-0c64-4e3b-8a13-169b15535a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:57 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c438f4b5-5ec9-44d6-863d-386b84ae5a09 tempest-VolumeDependencyTests-341232480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (142c94ca-0c64-4e3b-8a13-169b15535a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:57 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c438f4b5-5ec9-44d6-863d-386b84ae5a09 tempest-VolumeDependencyTests-341232480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e02af8b-36f3-4137-819d-a208aed86d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:57 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c438f4b5-5ec9-44d6-863d-386b84ae5a09 tempest-VolumeDependencyTests-341232480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e02af8b-36f3-4137-819d-a208aed86d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '250d92b3-d79d-479d-8804-848032171308', 'volume_name': 'volume-250d92b3-d79d-479d-8804-848032171308', 'volume_size': 1, 'snapshot_id': 'f9586d46-c230-4c76-9bf5-9192155e46a7'}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:57 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c438f4b5-5ec9-44d6-863d-386b84ae5a09 tempest-VolumeDependencyTests-341232480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20f2bdbc-052f-42d3-b5d7-3c6288945ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:57 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c438f4b5-5ec9-44d6-863d-386b84ae5a09 tempest-VolumeDependencyTests-341232480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20f2bdbc-052f-42d3-b5d7-3c6288945ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:29:57 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c438f4b5-5ec9-44d6-863d-386b84ae5a09 tempest-VolumeDependencyTests-341232480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d487defa-3f50-4509-86e0-2d5fe9f7ddb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:29:57 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-c438f4b5-5ec9-44d6-863d-386b84ae5a09 tempest-VolumeDependencyTests-341232480 None] Volume 250d92b3-d79d-479d-8804-848032171308: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-250d92b3-d79d-479d-8804-848032171308', 'volume_size': 1, 'snapshot_id': 'f9586d46-c230-4c76-9bf5-9192155e46a7'}
Jul 03 01:29:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-c438f4b5-5ec9-44d6-863d-386b84ae5a09 tempest-VolumeDependencyTests-341232480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:29:57 devstack sudo[107228]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a1e2a353-17e0-4d35-a64a-7e7057a7521a tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-57bcf82c-b865-4e5c-af57-9893c97541f9" returned: 0 in 0.813s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:57 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-a1e2a353-17e0-4d35-a64a-7e7057a7521a tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Lock "cinder-quobyte-57bcf82c-b865-4e5c-af57-9893c97541f9" released by "delete_volume" :: held 1.751s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:29:57 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-a1e2a353-17e0-4d35-a64a-7e7057a7521a tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Created reservations ['fc523d88-b98e-4c2b-9a44-209c2994b81b', 'e4a1d50f-8b4a-483b-b3c0-1765b5ad88f1', '3b256891-0c74-4518-b33e-800ba7b9644a', '6539bd1f-346d-4263-a47d-96220daffe76'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:29:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a1e2a353-17e0-4d35-a64a-7e7057a7521a tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:29:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a1e2a353-17e0-4d35-a64a-7e7057a7521a tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:29:57 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-a1e2a353-17e0-4d35-a64a-7e7057a7521a tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:29:57 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-a1e2a353-17e0-4d35-a64a-7e7057a7521a tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:29:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a1e2a353-17e0-4d35-a64a-7e7057a7521a tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:29:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a1e2a353-17e0-4d35-a64a-7e7057a7521a tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:57 devstack sudo[107239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:29:57 devstack sudo[107239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:57 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-cbaba459-b276-45de-a863-21dd8005d2c9 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Acquiring lock "cinder-19a337b0-6359-40aa-97a2-6dc2985702e0-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:29:57 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-cbaba459-b276-45de-a863-21dd8005d2c9 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Lock "cinder-19a337b0-6359-40aa-97a2-6dc2985702e0-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:29:57 devstack sudo[107234]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0c4569d3-79d3-4ca6-ba90-dea010f11bf1 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-82f5ac00-9bb6-46ef-abb1-c8eb55547597,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-82f5ac00-9bb6-46ef-abb1-c8eb55547597.3e7bbfdc-b91a-40d8-9ec6-8f2f53a0cd14 1G" returned: 0 in 1.105s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0c4569d3-79d3-4ca6-ba90-dea010f11bf1 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82f5ac00-9bb6-46ef-abb1-c8eb55547597 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-82f5ac00-9bb6-46ef-abb1-c8eb55547597.3e7bbfdc-b91a-40d8-9ec6-8f2f53a0cd14 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:57 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-cbaba459-b276-45de-a863-21dd8005d2c9 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Acquiring lock "cinder-quobyte-19a337b0-6359-40aa-97a2-6dc2985702e0" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:29:57 devstack sudo[107243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82f5ac00-9bb6-46ef-abb1-c8eb55547597 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-82f5ac00-9bb6-46ef-abb1-c8eb55547597.3e7bbfdc-b91a-40d8-9ec6-8f2f53a0cd14
Jul 03 01:29:57 devstack sudo[107243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:57 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-cbaba459-b276-45de-a863-21dd8005d2c9 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Lock "cinder-quobyte-19a337b0-6359-40aa-97a2-6dc2985702e0" acquired by "delete_volume" :: waited 0.026s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:29:58 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[db43fbdf-9038-4402-95f7-3ed4744adb50]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:29:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-cbaba459-b276-45de-a863-21dd8005d2c9 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-19a337b0-6359-40aa-97a2-6dc2985702e0 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:58 devstack sudo[107245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-19a337b0-6359-40aa-97a2-6dc2985702e0
Jul 03 01:29:58 devstack sudo[107245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:58 devstack sudo[107239]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a1e2a353-17e0-4d35-a64a-7e7057a7521a tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.778s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:58 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-a1e2a353-17e0-4d35-a64a-7e7057a7521a tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:29:58 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-a1e2a353-17e0-4d35-a64a-7e7057a7521a tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Deleted volume successfully.
Jul 03 01:29:58 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-a1e2a353-17e0-4d35-a64a-7e7057a7521a tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Lock "cinder-57bcf82c-b865-4e5c-af57-9893c97541f9-delete_volume" released by "delete_volume" :: held 2.849s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:29:58 devstack sudo[107243]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0c4569d3-79d3-4ca6-ba90-dea010f11bf1 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82f5ac00-9bb6-46ef-abb1-c8eb55547597 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-82f5ac00-9bb6-46ef-abb1-c8eb55547597.3e7bbfdc-b91a-40d8-9ec6-8f2f53a0cd14" returned: 0 in 0.838s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:58 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-0c4569d3-79d3-4ca6-ba90-dea010f11bf1 tempest-ProjectMemberTests-1866302072 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-82f5ac00-9bb6-46ef-abb1-c8eb55547597.3e7bbfdc-b91a-40d8-9ec6-8f2f53a0cd14 is being set with open permissions: ugo+rw
Jul 03 01:29:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0c4569d3-79d3-4ca6-ba90-dea010f11bf1 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-82f5ac00-9bb6-46ef-abb1-c8eb55547597.3e7bbfdc-b91a-40d8-9ec6-8f2f53a0cd14 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:58 devstack sudo[107254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-82f5ac00-9bb6-46ef-abb1-c8eb55547597.3e7bbfdc-b91a-40d8-9ec6-8f2f53a0cd14
Jul 03 01:29:58 devstack sudo[107254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:58 devstack sudo[107245]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-cbaba459-b276-45de-a863-21dd8005d2c9 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-19a337b0-6359-40aa-97a2-6dc2985702e0" returned: 0 in 0.852s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-cbaba459-b276-45de-a863-21dd8005d2c9 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-19a337b0-6359-40aa-97a2-6dc2985702e0 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:58 devstack sudo[107257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-19a337b0-6359-40aa-97a2-6dc2985702e0
Jul 03 01:29:58 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:59 devstack sudo[107254]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0c4569d3-79d3-4ca6-ba90-dea010f11bf1 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-82f5ac00-9bb6-46ef-abb1-c8eb55547597.3e7bbfdc-b91a-40d8-9ec6-8f2f53a0cd14" returned: 0 in 0.691s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0c4569d3-79d3-4ca6-ba90-dea010f11bf1 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-82f5ac00-9bb6-46ef-abb1-c8eb55547597.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:59 devstack sudo[107261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-82f5ac00-9bb6-46ef-abb1-c8eb55547597.info
Jul 03 01:29:59 devstack sudo[107261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:29:59 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root
Jul 03 01:29:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-cbaba459-b276-45de-a863-21dd8005d2c9 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-19a337b0-6359-40aa-97a2-6dc2985702e0" returned: 0 in 0.723s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:29:59 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-cbaba459-b276-45de-a863-21dd8005d2c9 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Lock "cinder-quobyte-19a337b0-6359-40aa-97a2-6dc2985702e0" released by "delete_volume" :: held 1.651s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:29:59 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-cbaba459-b276-45de-a863-21dd8005d2c9 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Created reservations ['b991ee6a-550e-404a-9a99-3b3be7ca9b11', '8f546857-31dd-4ff9-ad5d-cab09e80c153', 'b058c492-0a9c-4309-9d5b-11ab55710322', '55e41783-75bc-4f09-8d07-c6aa78564ca0'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:29:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-cbaba459-b276-45de-a863-21dd8005d2c9 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:29:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-cbaba459-b276-45de-a863-21dd8005d2c9 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:29:59 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-cbaba459-b276-45de-a863-21dd8005d2c9 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:29:59 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-cbaba459-b276-45de-a863-21dd8005d2c9 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:29:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-cbaba459-b276-45de-a863-21dd8005d2c9 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:29:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-cbaba459-b276-45de-a863-21dd8005d2c9 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:29:59 devstack sudo[107263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:29:59 devstack sudo[107263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:00 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-6b367876-7d9b-412d-977b-3593150248bc tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Acquiring lock "cinder-89e84a6b-e2d8-4afe-a1eb-7cb1d26e1a20-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:30:00 devstack sudo[107261]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:00 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0c4569d3-79d3-4ca6-ba90-dea010f11bf1 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-82f5ac00-9bb6-46ef-abb1-c8eb55547597.info" returned: 0 in 0.716s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:00 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-0c4569d3-79d3-4ca6-ba90-dea010f11bf1 tempest-ProjectMemberTests-1866302072 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-82f5ac00-9bb6-46ef-abb1-c8eb55547597.info is being set with open permissions: ugo+rw
Jul 03 01:30:00 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0c4569d3-79d3-4ca6-ba90-dea010f11bf1 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-82f5ac00-9bb6-46ef-abb1-c8eb55547597.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:00 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-6b367876-7d9b-412d-977b-3593150248bc tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Lock "cinder-89e84a6b-e2d8-4afe-a1eb-7cb1d26e1a20-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:30:00 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e3584d9-1dd9-459b-9415-efe2c3bf0885 tempest-ProjectReaderTests-1804050025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:30:00 devstack sudo[107266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-82f5ac00-9bb6-46ef-abb1-c8eb55547597.info
Jul 03 01:30:00 devstack sudo[107266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:00 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-6e3584d9-1dd9-459b-9415-efe2c3bf0885 tempest-ProjectReaderTests-1804050025 None] Flow 'volume_create_manager' (1144a8d8-ffe2-44cc-96ae-4faea346eb64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:30:00 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-6e3584d9-1dd9-459b-9415-efe2c3bf0885 tempest-ProjectReaderTests-1804050025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81135ac8-6ac3-4953-8c8c-81ef614512e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:30:00 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-6e3584d9-1dd9-459b-9415-efe2c3bf0885 tempest-ProjectReaderTests-1804050025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81135ac8-6ac3-4953-8c8c-81ef614512e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:30:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-369045243',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c4dd852-c6d2-47a7-a1c7-c69f318dc463,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3c679f1635c4e2fa1010d8870605193',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:30:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:30:00Z,use_quota=True,user_id='9f1b37a81b5145a8ba88fac86273cb7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:30:00 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-6e3584d9-1dd9-459b-9415-efe2c3bf0885 tempest-ProjectReaderTests-1804050025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f875f3a-9c05-4d85-8335-337a1e264705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:30:00 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-6e3584d9-1dd9-459b-9415-efe2c3bf0885 tempest-ProjectReaderTests-1804050025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f875f3a-9c05-4d85-8335-337a1e264705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:30:00 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-6e3584d9-1dd9-459b-9415-efe2c3bf0885 tempest-ProjectReaderTests-1804050025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24b3210a-4996-4ac3-b692-b1b434374d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:30:00 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-6e3584d9-1dd9-459b-9415-efe2c3bf0885 tempest-ProjectReaderTests-1804050025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24b3210a-4996-4ac3-b692-b1b434374d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c4dd852-c6d2-47a7-a1c7-c69f318dc463', 'volume_name': 'volume-5c4dd852-c6d2-47a7-a1c7-c69f318dc463', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:30:00 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-6e3584d9-1dd9-459b-9415-efe2c3bf0885 tempest-ProjectReaderTests-1804050025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8de69989-a4e4-4507-8226-8ba7a7cca848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:30:00 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-6e3584d9-1dd9-459b-9415-efe2c3bf0885 tempest-ProjectReaderTests-1804050025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8de69989-a4e4-4507-8226-8ba7a7cca848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:30:00 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-6e3584d9-1dd9-459b-9415-efe2c3bf0885 tempest-ProjectReaderTests-1804050025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61c45c58-e947-4671-89be-ee79540e8554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:30:00 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-6e3584d9-1dd9-459b-9415-efe2c3bf0885 tempest-ProjectReaderTests-1804050025 None] Volume 5c4dd852-c6d2-47a7-a1c7-c69f318dc463: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c4dd852-c6d2-47a7-a1c7-c69f318dc463', 'volume_size': 1}
Jul 03 01:30:00 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-6e3584d9-1dd9-459b-9415-efe2c3bf0885 tempest-ProjectReaderTests-1804050025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:30:00 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-6b367876-7d9b-412d-977b-3593150248bc tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Acquiring lock "cinder-quobyte-89e84a6b-e2d8-4afe-a1eb-7cb1d26e1a20" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:30:00 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-6b367876-7d9b-412d-977b-3593150248bc tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Lock "cinder-quobyte-89e84a6b-e2d8-4afe-a1eb-7cb1d26e1a20" acquired by "delete_volume" :: waited 0.016s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:30:00 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b85fe1-3da2-4513-8db6-b8b2cfe7e8e9]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:30:00 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6b367876-7d9b-412d-977b-3593150248bc tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-89e84a6b-e2d8-4afe-a1eb-7cb1d26e1a20 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:00 devstack sudo[107263]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:00 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-cbaba459-b276-45de-a863-21dd8005d2c9 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.763s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:00 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-cbaba459-b276-45de-a863-21dd8005d2c9 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:30:00 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-cbaba459-b276-45de-a863-21dd8005d2c9 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Deleted volume successfully.
Jul 03 01:30:00 devstack sudo[107269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-89e84a6b-e2d8-4afe-a1eb-7cb1d26e1a20
Jul 03 01:30:00 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:00 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-cbaba459-b276-45de-a863-21dd8005d2c9 tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Lock "cinder-19a337b0-6359-40aa-97a2-6dc2985702e0-delete_volume" released by "delete_volume" :: held 2.645s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:30:00 devstack sudo[107266]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:00 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0c4569d3-79d3-4ca6-ba90-dea010f11bf1 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-82f5ac00-9bb6-46ef-abb1-c8eb55547597.info" returned: 0 in 0.701s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:00 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-0c4569d3-79d3-4ca6-ba90-dea010f11bf1 tempest-ProjectMemberTests-1866302072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.080s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:30:00 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-c438f4b5-5ec9-44d6-863d-386b84ae5a09 tempest-VolumeDependencyTests-341232480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.650s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:30:00 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-c438f4b5-5ec9-44d6-863d-386b84ae5a09 tempest-VolumeDependencyTests-341232480 None] Acquiring lock "cinder-quobyte-f9586d46-c230-4c76-9bf5-9192155e46a7-250d92b3-d79d-479d-8804-848032171308" by "_create_volume_from_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:30:00 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-c438f4b5-5ec9-44d6-863d-386b84ae5a09 tempest-VolumeDependencyTests-341232480 None] Lock "cinder-quobyte-f9586d46-c230-4c76-9bf5-9192155e46a7-250d92b3-d79d-479d-8804-848032171308" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:30:00 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-c438f4b5-5ec9-44d6-863d-386b84ae5a09 tempest-VolumeDependencyTests-341232480 None] Creating volume 250d92b3-d79d-479d-8804-848032171308 from snapshot f9586d46-c230-4c76-9bf5-9192155e46a7 {{(pid=86891) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 03 01:30:00 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-c438f4b5-5ec9-44d6-863d-386b84ae5a09 tempest-VolumeDependencyTests-341232480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:30:00 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-c438f4b5-5ec9-44d6-863d-386b84ae5a09 tempest-VolumeDependencyTests-341232480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:30:00 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-c438f4b5-5ec9-44d6-863d-386b84ae5a09 tempest-VolumeDependencyTests-341232480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:30:00 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-c438f4b5-5ec9-44d6-863d-386b84ae5a09 tempest-VolumeDependencyTests-341232480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:30:00 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-c438f4b5-5ec9-44d6-863d-386b84ae5a09 tempest-VolumeDependencyTests-341232480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:30:00 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-c438f4b5-5ec9-44d6-863d-386b84ae5a09 tempest-VolumeDependencyTests-341232480 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:30:00 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-c438f4b5-5ec9-44d6-863d-386b84ae5a09 tempest-VolumeDependencyTests-341232480 None] Acquiring lock "cinder-quobyte-250d92b3-d79d-479d-8804-848032171308" by "_copy_volume_from_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:30:00 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-0c4569d3-79d3-4ca6-ba90-dea010f11bf1 tempest-ProjectMemberTests-1866302072 None] Create snapshot completed successfully
Jul 03 01:30:00 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-c438f4b5-5ec9-44d6-863d-386b84ae5a09 tempest-VolumeDependencyTests-341232480 None] Lock "cinder-quobyte-250d92b3-d79d-479d-8804-848032171308" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:30:00 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-c438f4b5-5ec9-44d6-863d-386b84ae5a09 tempest-VolumeDependencyTests-341232480 None] snapshot: f9586d46-c230-4c76-9bf5-9192155e46a7, volume: 250d92b3-d79d-479d-8804-848032171308,  {{(pid=86891) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 03 01:30:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-c438f4b5-5ec9-44d6-863d-386b84ae5a09 tempest-VolumeDependencyTests-341232480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:30:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-c438f4b5-5ec9-44d6-863d-386b84ae5a09 tempest-VolumeDependencyTests-341232480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:30:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-c438f4b5-5ec9-44d6-863d-386b84ae5a09 tempest-VolumeDependencyTests-341232480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:30:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-c438f4b5-5ec9-44d6-863d-386b84ae5a09 tempest-VolumeDependencyTests-341232480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:30:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-c438f4b5-5ec9-44d6-863d-386b84ae5a09 tempest-VolumeDependencyTests-341232480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:30:01 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[033fa051-1576-4c2c-bd3d-6adc2c863d5d]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:30:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c438f4b5-5ec9-44d6-863d-386b84ae5a09 tempest-VolumeDependencyTests-341232480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b160888-756d-4574-b870-30149de01b6a.f9586d46-c230-4c76-9bf5-9192155e46a7 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:01 devstack sudo[107274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b160888-756d-4574-b870-30149de01b6a.f9586d46-c230-4c76-9bf5-9192155e46a7
Jul 03 01:30:01 devstack sudo[107274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:01 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6b367876-7d9b-412d-977b-3593150248bc tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-89e84a6b-e2d8-4afe-a1eb-7cb1d26e1a20" returned: 0 in 0.787s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6b367876-7d9b-412d-977b-3593150248bc tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-89e84a6b-e2d8-4afe-a1eb-7cb1d26e1a20 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:01 devstack sudo[107277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-89e84a6b-e2d8-4afe-a1eb-7cb1d26e1a20
Jul 03 01:30:01 devstack sudo[107277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:01 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-1fec3a98-e226-407d-8c1f-bc1c4e900ab7 tempest-ProjectMemberTests-1866302072 None] Acquiring lock "cinder-3e7bbfdc-b91a-40d8-9ec6-8f2f53a0cd14-delete_snapshot" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:30:01 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-1fec3a98-e226-407d-8c1f-bc1c4e900ab7 tempest-ProjectMemberTests-1866302072 None] Lock "cinder-3e7bbfdc-b91a-40d8-9ec6-8f2f53a0cd14-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:30:01 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-1fec3a98-e226-407d-8c1f-bc1c4e900ab7 tempest-ProjectMemberTests-1866302072 None] Acquiring lock "cinder-quobyte-82f5ac00-9bb6-46ef-abb1-c8eb55547597" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:30:01 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-1fec3a98-e226-407d-8c1f-bc1c4e900ab7 tempest-ProjectMemberTests-1866302072 None] Lock "cinder-quobyte-82f5ac00-9bb6-46ef-abb1-c8eb55547597" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:30:01 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-1fec3a98-e226-407d-8c1f-bc1c4e900ab7 tempest-ProjectMemberTests-1866302072 None] Acquiring lock "cinder-quobyte-3e7bbfdc-b91a-40d8-9ec6-8f2f53a0cd14" by "_delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:30:01 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-1fec3a98-e226-407d-8c1f-bc1c4e900ab7 tempest-ProjectMemberTests-1866302072 None] Lock "cinder-quobyte-3e7bbfdc-b91a-40d8-9ec6-8f2f53a0cd14" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:30:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-1fec3a98-e226-407d-8c1f-bc1c4e900ab7 tempest-ProjectMemberTests-1866302072 None] Deleting offline snapshot 3e7bbfdc-b91a-40d8-9ec6-8f2f53a0cd14 of volume 82f5ac00-9bb6-46ef-abb1-c8eb55547597 {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 01:30:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-1fec3a98-e226-407d-8c1f-bc1c4e900ab7 tempest-ProjectMemberTests-1866302072 None] snapshot_file for this snap is: volume-82f5ac00-9bb6-46ef-abb1-c8eb55547597.3e7bbfdc-b91a-40d8-9ec6-8f2f53a0cd14 {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 01:30:01 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7deff2-9d55-48af-b9c2-3b6434725ad6]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:30:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1fec3a98-e226-407d-8c1f-bc1c4e900ab7 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-82f5ac00-9bb6-46ef-abb1-c8eb55547597.3e7bbfdc-b91a-40d8-9ec6-8f2f53a0cd14 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:01 devstack sudo[107281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-82f5ac00-9bb6-46ef-abb1-c8eb55547597.3e7bbfdc-b91a-40d8-9ec6-8f2f53a0cd14
Jul 03 01:30:01 devstack sudo[107281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:01 devstack sudo[107277]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6b367876-7d9b-412d-977b-3593150248bc tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-89e84a6b-e2d8-4afe-a1eb-7cb1d26e1a20" returned: 0 in 0.677s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:01 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-6b367876-7d9b-412d-977b-3593150248bc tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Lock "cinder-quobyte-89e84a6b-e2d8-4afe-a1eb-7cb1d26e1a20" released by "delete_volume" :: held 1.525s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:30:01 devstack sudo[107274]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c438f4b5-5ec9-44d6-863d-386b84ae5a09 tempest-VolumeDependencyTests-341232480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b160888-756d-4574-b870-30149de01b6a.f9586d46-c230-4c76-9bf5-9192155e46a7" returned: 0 in 0.854s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-c438f4b5-5ec9-44d6-863d-386b84ae5a09 tempest-VolumeDependencyTests-341232480 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b160888-756d-4574-b870-30149de01b6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:30:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-c438f4b5-5ec9-44d6-863d-386b84ae5a09 tempest-VolumeDependencyTests-341232480 None] will copy from snapshot at /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b160888-756d-4574-b870-30149de01b6a {{(pid=86891) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 03 01:30:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-c438f4b5-5ec9-44d6-863d-386b84ae5a09 tempest-VolumeDependencyTests-341232480 None] Creating direct copy from snapshot {{(pid=86891) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 03 01:30:01 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b473814-6a0c-48d2-97c0-d31067ce45cc]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:30:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c438f4b5-5ec9-44d6-863d-386b84ae5a09 tempest-VolumeDependencyTests-341232480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b160888-756d-4574-b870-30149de01b6a {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:01 devstack cinder-volume[86891]: DEBUG oslo_service.periodic_task [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86891) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 01:30:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:30:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:30:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:30:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:30:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:30:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:01 devstack sudo[107288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:30:01 devstack sudo[107288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:02 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-6b367876-7d9b-412d-977b-3593150248bc tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Created reservations ['a2eded9e-1a47-45df-ab96-8b5db0526d3b', '9a50b99c-455c-49cf-a798-39c17b908181', '68552c62-5d8c-4fca-89cc-7513e02399ce', '63522f07-ff06-4398-9808-f074f4ecd21d'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:30:02 devstack sudo[107287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b160888-756d-4574-b870-30149de01b6a
Jul 03 01:30:02 devstack sudo[107287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-6b367876-7d9b-412d-977b-3593150248bc tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:30:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-6b367876-7d9b-412d-977b-3593150248bc tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:30:02 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-6b367876-7d9b-412d-977b-3593150248bc tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:30:02 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-6b367876-7d9b-412d-977b-3593150248bc tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:30:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-6b367876-7d9b-412d-977b-3593150248bc tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:30:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6b367876-7d9b-412d-977b-3593150248bc tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:02 devstack sudo[107291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:30:02 devstack sudo[107291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:02 devstack sudo[107281]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1fec3a98-e226-407d-8c1f-bc1c4e900ab7 tempest-ProjectMemberTests-1866302072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-82f5ac00-9bb6-46ef-abb1-c8eb55547597.3e7bbfdc-b91a-40d8-9ec6-8f2f53a0cd14" returned: 0 in 0.994s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:02 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-1fec3a98-e226-407d-8c1f-bc1c4e900ab7 tempest-ProjectMemberTests-1866302072 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82f5ac00-9bb6-46ef-abb1-c8eb55547597(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:30:02 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[7450e4b0-6627-4c7a-adb7-3a2463f949b4]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:30:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1fec3a98-e226-407d-8c1f-bc1c4e900ab7 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-82f5ac00-9bb6-46ef-abb1-c8eb55547597 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:02 devstack sudo[107288]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.844s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:02 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:30:02 devstack cinder-volume[86891]: DEBUG oslo_service.periodic_task [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running periodic task VolumeManager._thread_info {{(pid=86891) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 01:30:02 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] thread count: 28 {{(pid=86891) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 01:30:02 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] thread info: [<_MainThread(MainThread, started 136731296534656)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136731184953280)>, <Thread(Thread-3 (stat_writer), started daemon 136731184058816)>, <Thread(Rabbit-heartbeat, started daemon 136731184846080)>, <Thread(Thread-5 (_runner), started daemon 136731182936576)>, <Thread(Thread-7 (_runner), started daemon 136731182954944)>, <Thread(fd_logger, started daemon 136731181916416)>, <Thread(privsep_reader, started daemon 136731180942208)>, <Thread(tpool_thread_0, started daemon 136731172161216)>, <Thread(tpool_thread_1, started daemon 136731163768512)>, <Thread(tpool_thread_2, started daemon 136731155375808)>, <Thread(tpool_thread_3, started daemon 136731146983104)>, <Thread(tpool_thread_4, started daemon 136731138590400)>, <Thread(tpool_thread_5, started daemon 136731130197696)>, <Thread(tpool_thread_6, started daemon 136731121804992)>, <Thread(tpool_thread_7, started daemon 136731113412288)>, <Thread(tpool_thread_8, started daemon 136731105003200)>, <Thread(tpool_thread_9, started daemon 136731096594112)>, <Thread(tpool_thread_10, started daemon 136731088185024)>, <Thread(tpool_thread_11, started daemon 136731079775936)>, <Thread(tpool_thread_12, started daemon 136731071366848)>, <Thread(tpool_thread_13, started daemon 136731062957760)>, <Thread(tpool_thread_14, started daemon 136731054548672)>, <Thread(tpool_thread_15, started daemon 136731046139584)>, <Thread(tpool_thread_16, started daemon 136731037730496)>, <Thread(tpool_thread_17, started daemon 136731029321408)>, <Thread(tpool_thread_18, started daemon 136731020912320)>, <Thread(tpool_thread_19, started daemon 136731012503232)>] {{(pid=86891) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 01:30:02 devstack sudo[107302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-82f5ac00-9bb6-46ef-abb1-c8eb55547597
Jul 03 01:30:02 devstack sudo[107302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:02 devstack sudo[107287]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c438f4b5-5ec9-44d6-863d-386b84ae5a09 tempest-VolumeDependencyTests-341232480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b160888-756d-4574-b870-30149de01b6a" returned: 0 in 0.960s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:02 devstack cinder-volume[86891]: DEBUG cinder.utils [None req-c438f4b5-5ec9-44d6-863d-386b84ae5a09 tempest-VolumeDependencyTests-341232480 None] Path /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-250d92b3-d79d-479d-8804-848032171308 not found in is_blk_device check {{(pid=86891) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 03 01:30:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c438f4b5-5ec9-44d6-863d-386b84ae5a09 tempest-VolumeDependencyTests-341232480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b160888-756d-4574-b870-30149de01b6a /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-250d92b3-d79d-479d-8804-848032171308 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:02 devstack sudo[107306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b160888-756d-4574-b870-30149de01b6a /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-250d92b3-d79d-479d-8804-848032171308
Jul 03 01:30:02 devstack sudo[107306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:02 devstack sudo[107291]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6b367876-7d9b-412d-977b-3593150248bc tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.847s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:02 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-6b367876-7d9b-412d-977b-3593150248bc tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:30:02 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-6b367876-7d9b-412d-977b-3593150248bc tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Deleted volume successfully.
Jul 03 01:30:03 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-6b367876-7d9b-412d-977b-3593150248bc tempest-CreateVolumesFromSourceVolumeTest-1990325313 None] Lock "cinder-89e84a6b-e2d8-4afe-a1eb-7cb1d26e1a20-delete_volume" released by "delete_volume" :: held 2.785s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:30:03 devstack sudo[107302]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1fec3a98-e226-407d-8c1f-bc1c4e900ab7 tempest-ProjectMemberTests-1866302072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-82f5ac00-9bb6-46ef-abb1-c8eb55547597" returned: 0 in 0.876s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1fec3a98-e226-407d-8c1f-bc1c4e900ab7 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-82f5ac00-9bb6-46ef-abb1-c8eb55547597.3e7bbfdc-b91a-40d8-9ec6-8f2f53a0cd14 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:03 devstack sudo[107314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-82f5ac00-9bb6-46ef-abb1-c8eb55547597.3e7bbfdc-b91a-40d8-9ec6-8f2f53a0cd14
Jul 03 01:30:03 devstack sudo[107314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:04 devstack sudo[107314]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1fec3a98-e226-407d-8c1f-bc1c4e900ab7 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-82f5ac00-9bb6-46ef-abb1-c8eb55547597.3e7bbfdc-b91a-40d8-9ec6-8f2f53a0cd14" returned: 0 in 1.344s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1fec3a98-e226-407d-8c1f-bc1c4e900ab7 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-82f5ac00-9bb6-46ef-abb1-c8eb55547597.3e7bbfdc-b91a-40d8-9ec6-8f2f53a0cd14 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:05 devstack sudo[107326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-82f5ac00-9bb6-46ef-abb1-c8eb55547597.3e7bbfdc-b91a-40d8-9ec6-8f2f53a0cd14
Jul 03 01:30:05 devstack sudo[107326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:06 devstack sudo[107326]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1fec3a98-e226-407d-8c1f-bc1c4e900ab7 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-82f5ac00-9bb6-46ef-abb1-c8eb55547597.3e7bbfdc-b91a-40d8-9ec6-8f2f53a0cd14" returned: 0 in 1.425s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:06 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-1fec3a98-e226-407d-8c1f-bc1c4e900ab7 tempest-ProjectMemberTests-1866302072 None] Lock "cinder-quobyte-3e7bbfdc-b91a-40d8-9ec6-8f2f53a0cd14" released by "_delete_snapshot" :: held 4.829s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:30:06 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-1fec3a98-e226-407d-8c1f-bc1c4e900ab7 tempest-ProjectMemberTests-1866302072 None] Lock "cinder-quobyte-82f5ac00-9bb6-46ef-abb1-c8eb55547597" released by "delete_snapshot" :: held 4.864s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:30:06 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-1fec3a98-e226-407d-8c1f-bc1c4e900ab7 tempest-ProjectMemberTests-1866302072 None] Created reservations ['92be5290-f5c7-4b07-ba7e-809bab621bb7', 'f4d39440-fa44-4ada-b664-03729122d44f', '41f3190e-fa1e-4605-b6af-2516a01df9bc', '04ecf627-b584-4bb0-aeab-f5db174e62bd'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:30:06 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-1fec3a98-e226-407d-8c1f-bc1c4e900ab7 tempest-ProjectMemberTests-1866302072 None] Delete snapshot completed successfully.
Jul 03 01:30:06 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-1fec3a98-e226-407d-8c1f-bc1c4e900ab7 tempest-ProjectMemberTests-1866302072 None] Lock "cinder-3e7bbfdc-b91a-40d8-9ec6-8f2f53a0cd14-delete_snapshot" released by "delete_snapshot" :: held 5.195s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:30:07 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-45538de5-1afd-496e-9a5d-995b40e8dbe1 tempest-ProjectMemberTests-1866302072 None] Acquiring lock "cinder-82f5ac00-9bb6-46ef-abb1-c8eb55547597-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:30:07 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-45538de5-1afd-496e-9a5d-995b40e8dbe1 tempest-ProjectMemberTests-1866302072 None] Lock "cinder-82f5ac00-9bb6-46ef-abb1-c8eb55547597-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:30:07 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-45538de5-1afd-496e-9a5d-995b40e8dbe1 tempest-ProjectMemberTests-1866302072 None] Acquiring lock "cinder-quobyte-82f5ac00-9bb6-46ef-abb1-c8eb55547597" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:30:07 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-45538de5-1afd-496e-9a5d-995b40e8dbe1 tempest-ProjectMemberTests-1866302072 None] Lock "cinder-quobyte-82f5ac00-9bb6-46ef-abb1-c8eb55547597" acquired by "delete_volume" :: waited 0.030s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:30:07 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e55eb2-f446-401d-ac1a-78cb16b5200f]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:30:07 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-45538de5-1afd-496e-9a5d-995b40e8dbe1 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-82f5ac00-9bb6-46ef-abb1-c8eb55547597 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:07 devstack sudo[107330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-82f5ac00-9bb6-46ef-abb1-c8eb55547597
Jul 03 01:30:07 devstack sudo[107330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:08 devstack sudo[107306]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:08 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c438f4b5-5ec9-44d6-863d-386b84ae5a09 tempest-VolumeDependencyTests-341232480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b160888-756d-4574-b870-30149de01b6a /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-250d92b3-d79d-479d-8804-848032171308" returned: 0 in 6.013s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:08 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a577f3-6b54-49a2-ae00-c1a9436b84de]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:30:08 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c438f4b5-5ec9-44d6-863d-386b84ae5a09 tempest-VolumeDependencyTests-341232480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b160888-756d-4574-b870-30149de01b6a {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:08 devstack sudo[107330]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:08 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-45538de5-1afd-496e-9a5d-995b40e8dbe1 tempest-ProjectMemberTests-1866302072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-82f5ac00-9bb6-46ef-abb1-c8eb55547597" returned: 0 in 1.546s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:08 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-45538de5-1afd-496e-9a5d-995b40e8dbe1 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-82f5ac00-9bb6-46ef-abb1-c8eb55547597 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:08 devstack sudo[107337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-82f5ac00-9bb6-46ef-abb1-c8eb55547597
Jul 03 01:30:08 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:09 devstack sudo[107336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b160888-756d-4574-b870-30149de01b6a
Jul 03 01:30:09 devstack sudo[107336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:09 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-bf92a08a-bb9c-4713-b361-237fe1a27e78 tempest-ProjectAdminTests-267975519 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.75777053833, 'free_capacity_gb': 1775.75777053833, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86891) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jul 03 01:30:09 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-45538de5-1afd-496e-9a5d-995b40e8dbe1 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-82f5ac00-9bb6-46ef-abb1-c8eb55547597" returned: 0 in 0.652s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:09 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-45538de5-1afd-496e-9a5d-995b40e8dbe1 tempest-ProjectMemberTests-1866302072 None] Lock "cinder-quobyte-82f5ac00-9bb6-46ef-abb1-c8eb55547597" released by "delete_volume" :: held 2.318s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:30:09 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-45538de5-1afd-496e-9a5d-995b40e8dbe1 tempest-ProjectMemberTests-1866302072 None] Created reservations ['f5a4a16f-628b-4d04-b11f-85b6b5b3a2c4', '89ad8de7-b764-4923-ae1c-5a00a4756343', '6f4fdae5-7061-4336-af8e-f75d11979ad6', 'b274994b-f9db-4ceb-a19f-cb64fd45f7cc'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:30:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-45538de5-1afd-496e-9a5d-995b40e8dbe1 tempest-ProjectMemberTests-1866302072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:30:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-45538de5-1afd-496e-9a5d-995b40e8dbe1 tempest-ProjectMemberTests-1866302072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:30:09 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-45538de5-1afd-496e-9a5d-995b40e8dbe1 tempest-ProjectMemberTests-1866302072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:30:09 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-45538de5-1afd-496e-9a5d-995b40e8dbe1 tempest-ProjectMemberTests-1866302072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:30:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-45538de5-1afd-496e-9a5d-995b40e8dbe1 tempest-ProjectMemberTests-1866302072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:30:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-45538de5-1afd-496e-9a5d-995b40e8dbe1 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:09 devstack sudo[107343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:30:09 devstack sudo[107343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:09 devstack sudo[107336]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c438f4b5-5ec9-44d6-863d-386b84ae5a09 tempest-VolumeDependencyTests-341232480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b160888-756d-4574-b870-30149de01b6a" returned: 0 in 0.945s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:09 devstack cinder-volume[86891]: DEBUG cinder.image.image_utils [None req-c438f4b5-5ec9-44d6-863d-386b84ae5a09 tempest-VolumeDependencyTests-341232480 None] Image conversion details: src /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b160888-756d-4574-b870-30149de01b6a, size 1024.00 MB, duration 6.01 sec, destination /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-250d92b3-d79d-479d-8804-848032171308 {{(pid=86891) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 03 01:30:09 devstack cinder-volume[86891]: INFO cinder.image.image_utils [None req-c438f4b5-5ec9-44d6-863d-386b84ae5a09 tempest-VolumeDependencyTests-341232480 None] Converted 1024.00 MB image at 170.27 MB/s
Jul 03 01:30:09 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-c438f4b5-5ec9-44d6-863d-386b84ae5a09 tempest-VolumeDependencyTests-341232480 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-250d92b3-d79d-479d-8804-848032171308 is being set with open permissions: ugo+rw
Jul 03 01:30:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c438f4b5-5ec9-44d6-863d-386b84ae5a09 tempest-VolumeDependencyTests-341232480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-250d92b3-d79d-479d-8804-848032171308 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:09 devstack sudo[107346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-250d92b3-d79d-479d-8804-848032171308
Jul 03 01:30:09 devstack sudo[107346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:10 devstack sudo[107343]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:10 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-45538de5-1afd-496e-9a5d-995b40e8dbe1 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.651s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:10 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-45538de5-1afd-496e-9a5d-995b40e8dbe1 tempest-ProjectMemberTests-1866302072 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:30:10 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-45538de5-1afd-496e-9a5d-995b40e8dbe1 tempest-ProjectMemberTests-1866302072 None] Deleted volume successfully.
Jul 03 01:30:10 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-45538de5-1afd-496e-9a5d-995b40e8dbe1 tempest-ProjectMemberTests-1866302072 None] Lock "cinder-82f5ac00-9bb6-46ef-abb1-c8eb55547597-delete_volume" released by "delete_volume" :: held 3.244s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:30:10 devstack sudo[107346]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:10 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c438f4b5-5ec9-44d6-863d-386b84ae5a09 tempest-VolumeDependencyTests-341232480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-250d92b3-d79d-479d-8804-848032171308" returned: 0 in 0.663s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:10 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-c438f4b5-5ec9-44d6-863d-386b84ae5a09 tempest-VolumeDependencyTests-341232480 None] Lock "cinder-quobyte-250d92b3-d79d-479d-8804-848032171308" released by "_copy_volume_from_snapshot" :: held 9.558s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:30:10 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-c438f4b5-5ec9-44d6-863d-386b84ae5a09 tempest-VolumeDependencyTests-341232480 None] Lock "cinder-quobyte-f9586d46-c230-4c76-9bf5-9192155e46a7-250d92b3-d79d-479d-8804-848032171308" released by "_create_volume_from_snapshot" :: held 9.601s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:30:10 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-c438f4b5-5ec9-44d6-863d-386b84ae5a09 tempest-VolumeDependencyTests-341232480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.627s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:30:10 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-6e3584d9-1dd9-459b-9415-efe2c3bf0885 tempest-ProjectReaderTests-1804050025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.213s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:30:10 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-6e3584d9-1dd9-459b-9415-efe2c3bf0885 tempest-ProjectReaderTests-1804050025 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:30:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-369045243',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c4dd852-c6d2-47a7-a1c7-c69f318dc463,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3c679f1635c4e2fa1010d8870605193',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:30:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:30:00Z,use_quota=True,user_id='9f1b37a81b5145a8ba88fac86273cb7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:30:10 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-6e3584d9-1dd9-459b-9415-efe2c3bf0885 tempest-ProjectReaderTests-1804050025 None] Creating volume 5c4dd852-c6d2-47a7-a1c7-c69f318dc463 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:30:10 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-6e3584d9-1dd9-459b-9415-efe2c3bf0885 tempest-ProjectReaderTests-1804050025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:30:10 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-6e3584d9-1dd9-459b-9415-efe2c3bf0885 tempest-ProjectReaderTests-1804050025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:30:10 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-6e3584d9-1dd9-459b-9415-efe2c3bf0885 tempest-ProjectReaderTests-1804050025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:30:10 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-6e3584d9-1dd9-459b-9415-efe2c3bf0885 tempest-ProjectReaderTests-1804050025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:30:10 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-6e3584d9-1dd9-459b-9415-efe2c3bf0885 tempest-ProjectReaderTests-1804050025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:30:10 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-6e3584d9-1dd9-459b-9415-efe2c3bf0885 tempest-ProjectReaderTests-1804050025 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:30:10 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-6e3584d9-1dd9-459b-9415-efe2c3bf0885 tempest-ProjectReaderTests-1804050025 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:30:10 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6e3584d9-1dd9-459b-9415-efe2c3bf0885 tempest-ProjectReaderTests-1804050025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-5c4dd852-c6d2-47a7-a1c7-c69f318dc463 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:10 devstack sudo[107350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-5c4dd852-c6d2-47a7-a1c7-c69f318dc463 1073741824
Jul 03 01:30:10 devstack sudo[107350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:10 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c438f4b5-5ec9-44d6-863d-386b84ae5a09 tempest-VolumeDependencyTests-341232480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d487defa-3f50-4509-86e0-2d5fe9f7ddb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-250d92b3-d79d-479d-8804-848032171308', 'volume_size': 1, 'snapshot_id': 'f9586d46-c230-4c76-9bf5-9192155e46a7'}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:30:10 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c438f4b5-5ec9-44d6-863d-386b84ae5a09 tempest-VolumeDependencyTests-341232480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dfeae78-77cf-471a-9cfd-5747324f8f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:30:10 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-c438f4b5-5ec9-44d6-863d-386b84ae5a09 tempest-VolumeDependencyTests-341232480 None] Volume volume-250d92b3-d79d-479d-8804-848032171308 (250d92b3-d79d-479d-8804-848032171308): created successfully
Jul 03 01:30:10 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c438f4b5-5ec9-44d6-863d-386b84ae5a09 tempest-VolumeDependencyTests-341232480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dfeae78-77cf-471a-9cfd-5747324f8f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:30:10 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c438f4b5-5ec9-44d6-863d-386b84ae5a09 tempest-VolumeDependencyTests-341232480 None] Flow 'volume_create_manager' (690bd6c8-dee9-41f8-92b8-ca56cbf119db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:30:10 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-c438f4b5-5ec9-44d6-863d-386b84ae5a09 tempest-VolumeDependencyTests-341232480 None] Created volume successfully.
Jul 03 01:30:11 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-c666e17a-7fd5-459d-857f-c9b9580fd656 tempest-ProjectMemberTests-1866302072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:30:11 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c666e17a-7fd5-459d-857f-c9b9580fd656 tempest-ProjectMemberTests-1866302072 None] Flow 'volume_create_manager' (3a83faa9-c4c7-434e-9325-fbc4c17ce004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:30:11 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c666e17a-7fd5-459d-857f-c9b9580fd656 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a70fd4a-5b56-4264-b082-3fea04fcefee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:30:11 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c666e17a-7fd5-459d-857f-c9b9580fd656 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a70fd4a-5b56-4264-b082-3fea04fcefee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:30:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-377116601',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b4f63a1-eda7-467f-aef3-a78ba65b9bd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16429f2745354b0591f4044f3a99b9fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:30:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:30:11Z,use_quota=True,user_id='31dd51f2dcdd4724a4c6b78cb80e6d8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:30:11 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c666e17a-7fd5-459d-857f-c9b9580fd656 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80a975c0-df66-4f27-9982-f9831c3ea2ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:30:11 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c666e17a-7fd5-459d-857f-c9b9580fd656 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80a975c0-df66-4f27-9982-f9831c3ea2ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:30:11 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c666e17a-7fd5-459d-857f-c9b9580fd656 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1de615c7-9540-4d04-a9b7-aeccec149081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:30:11 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c666e17a-7fd5-459d-857f-c9b9580fd656 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1de615c7-9540-4d04-a9b7-aeccec149081) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b4f63a1-eda7-467f-aef3-a78ba65b9bd1', 'volume_name': 'volume-3b4f63a1-eda7-467f-aef3-a78ba65b9bd1', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:30:11 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c666e17a-7fd5-459d-857f-c9b9580fd656 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9db5520c-0209-44ae-8ed2-9b6cd9a2efc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:30:11 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c666e17a-7fd5-459d-857f-c9b9580fd656 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9db5520c-0209-44ae-8ed2-9b6cd9a2efc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:30:11 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c666e17a-7fd5-459d-857f-c9b9580fd656 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1fe73da-3265-42d7-ab07-98b4d45bc26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:30:11 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-c666e17a-7fd5-459d-857f-c9b9580fd656 tempest-ProjectMemberTests-1866302072 None] Volume 3b4f63a1-eda7-467f-aef3-a78ba65b9bd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b4f63a1-eda7-467f-aef3-a78ba65b9bd1', 'volume_size': 1}
Jul 03 01:30:11 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-c666e17a-7fd5-459d-857f-c9b9580fd656 tempest-ProjectMemberTests-1866302072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:30:11 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5628b0c0-cb18-4abd-80f1-34a8f2bf49b1 tempest-VolumeDependencyTests-341232480 None] Acquiring lock "cinder-f9586d46-c230-4c76-9bf5-9192155e46a7-delete_snapshot" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:30:11 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5628b0c0-cb18-4abd-80f1-34a8f2bf49b1 tempest-VolumeDependencyTests-341232480 None] Lock "cinder-f9586d46-c230-4c76-9bf5-9192155e46a7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:30:11 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5628b0c0-cb18-4abd-80f1-34a8f2bf49b1 tempest-VolumeDependencyTests-341232480 None] Acquiring lock "cinder-quobyte-8b160888-756d-4574-b870-30149de01b6a" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:30:11 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5628b0c0-cb18-4abd-80f1-34a8f2bf49b1 tempest-VolumeDependencyTests-341232480 None] Lock "cinder-quobyte-8b160888-756d-4574-b870-30149de01b6a" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:30:11 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5628b0c0-cb18-4abd-80f1-34a8f2bf49b1 tempest-VolumeDependencyTests-341232480 None] Acquiring lock "cinder-quobyte-f9586d46-c230-4c76-9bf5-9192155e46a7" by "_delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:30:11 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5628b0c0-cb18-4abd-80f1-34a8f2bf49b1 tempest-VolumeDependencyTests-341232480 None] Lock "cinder-quobyte-f9586d46-c230-4c76-9bf5-9192155e46a7" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:30:11 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-5628b0c0-cb18-4abd-80f1-34a8f2bf49b1 tempest-VolumeDependencyTests-341232480 None] Deleting offline snapshot f9586d46-c230-4c76-9bf5-9192155e46a7 of volume 8b160888-756d-4574-b870-30149de01b6a {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 01:30:11 devstack sudo[107350]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:11 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-5628b0c0-cb18-4abd-80f1-34a8f2bf49b1 tempest-VolumeDependencyTests-341232480 None] snapshot_file for this snap is: volume-8b160888-756d-4574-b870-30149de01b6a.f9586d46-c230-4c76-9bf5-9192155e46a7 {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 01:30:11 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6e3584d9-1dd9-459b-9415-efe2c3bf0885 tempest-ProjectReaderTests-1804050025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-5c4dd852-c6d2-47a7-a1c7-c69f318dc463 1073741824" returned: 0 in 1.074s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:11 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a2bdad-cf16-4f25-94e9-e2c118e0a2b3]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:30:11 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5628b0c0-cb18-4abd-80f1-34a8f2bf49b1 tempest-VolumeDependencyTests-341232480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b160888-756d-4574-b870-30149de01b6a.f9586d46-c230-4c76-9bf5-9192155e46a7 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:11 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6e3584d9-1dd9-459b-9415-efe2c3bf0885 tempest-ProjectReaderTests-1804050025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-5c4dd852-c6d2-47a7-a1c7-c69f318dc463 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:11 devstack sudo[107358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-5c4dd852-c6d2-47a7-a1c7-c69f318dc463
Jul 03 01:30:11 devstack sudo[107358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:11 devstack sudo[107357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b160888-756d-4574-b870-30149de01b6a.f9586d46-c230-4c76-9bf5-9192155e46a7
Jul 03 01:30:11 devstack sudo[107357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:12 devstack sudo[107358]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6e3584d9-1dd9-459b-9415-efe2c3bf0885 tempest-ProjectReaderTests-1804050025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-5c4dd852-c6d2-47a7-a1c7-c69f318dc463" returned: 0 in 0.687s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:12 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-6e3584d9-1dd9-459b-9415-efe2c3bf0885 tempest-ProjectReaderTests-1804050025 None] <== create_volume: return (1820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:30:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-6e3584d9-1dd9-459b-9415-efe2c3bf0885 tempest-ProjectReaderTests-1804050025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.824s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:30:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-c666e17a-7fd5-459d-857f-c9b9580fd656 tempest-ProjectMemberTests-1866302072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.161s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:30:12 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-c666e17a-7fd5-459d-857f-c9b9580fd656 tempest-ProjectMemberTests-1866302072 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:30:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-377116601',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b4f63a1-eda7-467f-aef3-a78ba65b9bd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16429f2745354b0591f4044f3a99b9fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:30:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:30:11Z,use_quota=True,user_id='31dd51f2dcdd4724a4c6b78cb80e6d8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:30:12 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-c666e17a-7fd5-459d-857f-c9b9580fd656 tempest-ProjectMemberTests-1866302072 None] Creating volume 3b4f63a1-eda7-467f-aef3-a78ba65b9bd1 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:30:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-c666e17a-7fd5-459d-857f-c9b9580fd656 tempest-ProjectMemberTests-1866302072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:30:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-c666e17a-7fd5-459d-857f-c9b9580fd656 tempest-ProjectMemberTests-1866302072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:30:12 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-c666e17a-7fd5-459d-857f-c9b9580fd656 tempest-ProjectMemberTests-1866302072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:30:12 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-c666e17a-7fd5-459d-857f-c9b9580fd656 tempest-ProjectMemberTests-1866302072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:30:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-c666e17a-7fd5-459d-857f-c9b9580fd656 tempest-ProjectMemberTests-1866302072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:30:12 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-c666e17a-7fd5-459d-857f-c9b9580fd656 tempest-ProjectMemberTests-1866302072 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:30:12 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-c666e17a-7fd5-459d-857f-c9b9580fd656 tempest-ProjectMemberTests-1866302072 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:30:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c666e17a-7fd5-459d-857f-c9b9580fd656 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3b4f63a1-eda7-467f-aef3-a78ba65b9bd1 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:12 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-6e3584d9-1dd9-459b-9415-efe2c3bf0885 tempest-ProjectReaderTests-1804050025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61c45c58-e947-4671-89be-ee79540e8554) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c4dd852-c6d2-47a7-a1c7-c69f318dc463', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:30:12 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-6e3584d9-1dd9-459b-9415-efe2c3bf0885 tempest-ProjectReaderTests-1804050025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cb6cc8a-bca5-4ef8-8b16-9cb0dca577e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:30:12 devstack sudo[107365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3b4f63a1-eda7-467f-aef3-a78ba65b9bd1 1073741824
Jul 03 01:30:12 devstack sudo[107365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:12 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-6e3584d9-1dd9-459b-9415-efe2c3bf0885 tempest-ProjectReaderTests-1804050025 None] Volume volume-5c4dd852-c6d2-47a7-a1c7-c69f318dc463 (5c4dd852-c6d2-47a7-a1c7-c69f318dc463): created successfully
Jul 03 01:30:12 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-6e3584d9-1dd9-459b-9415-efe2c3bf0885 tempest-ProjectReaderTests-1804050025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cb6cc8a-bca5-4ef8-8b16-9cb0dca577e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:30:12 devstack sudo[107357]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:12 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-6e3584d9-1dd9-459b-9415-efe2c3bf0885 tempest-ProjectReaderTests-1804050025 None] Flow 'volume_create_manager' (1144a8d8-ffe2-44cc-96ae-4faea346eb64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:30:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5628b0c0-cb18-4abd-80f1-34a8f2bf49b1 tempest-VolumeDependencyTests-341232480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b160888-756d-4574-b870-30149de01b6a.f9586d46-c230-4c76-9bf5-9192155e46a7" returned: 0 in 0.809s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:12 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-5628b0c0-cb18-4abd-80f1-34a8f2bf49b1 tempest-VolumeDependencyTests-341232480 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b160888-756d-4574-b870-30149de01b6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:30:12 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-6e3584d9-1dd9-459b-9415-efe2c3bf0885 tempest-ProjectReaderTests-1804050025 None] Created volume successfully.
Jul 03 01:30:12 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[81cecb70-b2c4-454f-8a82-8217c22be421]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:30:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5628b0c0-cb18-4abd-80f1-34a8f2bf49b1 tempest-VolumeDependencyTests-341232480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b160888-756d-4574-b870-30149de01b6a {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:12 devstack sudo[107367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b160888-756d-4574-b870-30149de01b6a
Jul 03 01:30:12 devstack sudo[107367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:13 devstack sudo[107367]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:13 devstack sudo[107365]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5628b0c0-cb18-4abd-80f1-34a8f2bf49b1 tempest-VolumeDependencyTests-341232480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b160888-756d-4574-b870-30149de01b6a" returned: 0 in 0.881s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5628b0c0-cb18-4abd-80f1-34a8f2bf49b1 tempest-VolumeDependencyTests-341232480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b160888-756d-4574-b870-30149de01b6a.f9586d46-c230-4c76-9bf5-9192155e46a7 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c666e17a-7fd5-459d-857f-c9b9580fd656 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3b4f63a1-eda7-467f-aef3-a78ba65b9bd1 1073741824" returned: 0 in 1.003s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:13 devstack sudo[107376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b160888-756d-4574-b870-30149de01b6a.f9586d46-c230-4c76-9bf5-9192155e46a7
Jul 03 01:30:13 devstack sudo[107376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c666e17a-7fd5-459d-857f-c9b9580fd656 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3b4f63a1-eda7-467f-aef3-a78ba65b9bd1 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:13 devstack sudo[107378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3b4f63a1-eda7-467f-aef3-a78ba65b9bd1
Jul 03 01:30:13 devstack sudo[107378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:13 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e8198c2f-26c3-4b89-9f5a-978bb4901f86 tempest-ProjectReaderTests-1804050025 None] Acquiring lock "cinder-5c4dd852-c6d2-47a7-a1c7-c69f318dc463-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:30:13 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e8198c2f-26c3-4b89-9f5a-978bb4901f86 tempest-ProjectReaderTests-1804050025 None] Lock "cinder-5c4dd852-c6d2-47a7-a1c7-c69f318dc463-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:30:13 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e8198c2f-26c3-4b89-9f5a-978bb4901f86 tempest-ProjectReaderTests-1804050025 None] Acquiring lock "cinder-quobyte-5c4dd852-c6d2-47a7-a1c7-c69f318dc463" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:30:13 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e8198c2f-26c3-4b89-9f5a-978bb4901f86 tempest-ProjectReaderTests-1804050025 None] Lock "cinder-quobyte-5c4dd852-c6d2-47a7-a1c7-c69f318dc463" acquired by "delete_volume" :: waited 0.033s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:30:13 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[79946ed9-0d44-4292-9028-490b59ee4f03]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:30:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e8198c2f-26c3-4b89-9f5a-978bb4901f86 tempest-ProjectReaderTests-1804050025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-5c4dd852-c6d2-47a7-a1c7-c69f318dc463 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:14 devstack sudo[107380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-5c4dd852-c6d2-47a7-a1c7-c69f318dc463
Jul 03 01:30:14 devstack sudo[107380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:14 devstack sudo[107378]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c666e17a-7fd5-459d-857f-c9b9580fd656 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3b4f63a1-eda7-467f-aef3-a78ba65b9bd1" returned: 0 in 0.792s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:14 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-c666e17a-7fd5-459d-857f-c9b9580fd656 tempest-ProjectMemberTests-1866302072 None] <== create_volume: return (1851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:30:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-c666e17a-7fd5-459d-857f-c9b9580fd656 tempest-ProjectMemberTests-1866302072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.854s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:30:14 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c666e17a-7fd5-459d-857f-c9b9580fd656 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1fe73da-3265-42d7-ab07-98b4d45bc26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b4f63a1-eda7-467f-aef3-a78ba65b9bd1', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:30:14 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c666e17a-7fd5-459d-857f-c9b9580fd656 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd0bf083-3b91-454a-96f4-c8a258745794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:30:14 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-c666e17a-7fd5-459d-857f-c9b9580fd656 tempest-ProjectMemberTests-1866302072 None] Volume volume-3b4f63a1-eda7-467f-aef3-a78ba65b9bd1 (3b4f63a1-eda7-467f-aef3-a78ba65b9bd1): created successfully
Jul 03 01:30:14 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c666e17a-7fd5-459d-857f-c9b9580fd656 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd0bf083-3b91-454a-96f4-c8a258745794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:30:14 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c666e17a-7fd5-459d-857f-c9b9580fd656 tempest-ProjectMemberTests-1866302072 None] Flow 'volume_create_manager' (3a83faa9-c4c7-434e-9325-fbc4c17ce004) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:30:14 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-c666e17a-7fd5-459d-857f-c9b9580fd656 tempest-ProjectMemberTests-1866302072 None] Created volume successfully.
Jul 03 01:30:14 devstack sudo[107376]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5628b0c0-cb18-4abd-80f1-34a8f2bf49b1 tempest-VolumeDependencyTests-341232480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b160888-756d-4574-b870-30149de01b6a.f9586d46-c230-4c76-9bf5-9192155e46a7" returned: 0 in 0.974s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5628b0c0-cb18-4abd-80f1-34a8f2bf49b1 tempest-VolumeDependencyTests-341232480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b160888-756d-4574-b870-30149de01b6a.f9586d46-c230-4c76-9bf5-9192155e46a7 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:14 devstack sudo[107386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b160888-756d-4574-b870-30149de01b6a.f9586d46-c230-4c76-9bf5-9192155e46a7
Jul 03 01:30:14 devstack sudo[107386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:14 devstack sudo[107380]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e8198c2f-26c3-4b89-9f5a-978bb4901f86 tempest-ProjectReaderTests-1804050025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-5c4dd852-c6d2-47a7-a1c7-c69f318dc463" returned: 0 in 0.842s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e8198c2f-26c3-4b89-9f5a-978bb4901f86 tempest-ProjectReaderTests-1804050025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-5c4dd852-c6d2-47a7-a1c7-c69f318dc463 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:14 devstack sudo[107391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-5c4dd852-c6d2-47a7-a1c7-c69f318dc463
Jul 03 01:30:14 devstack sudo[107391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:15 devstack sudo[107386]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5628b0c0-cb18-4abd-80f1-34a8f2bf49b1 tempest-VolumeDependencyTests-341232480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b160888-756d-4574-b870-30149de01b6a.f9586d46-c230-4c76-9bf5-9192155e46a7" returned: 0 in 0.688s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:15 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5628b0c0-cb18-4abd-80f1-34a8f2bf49b1 tempest-VolumeDependencyTests-341232480 None] Lock "cinder-quobyte-f9586d46-c230-4c76-9bf5-9192155e46a7" released by "_delete_snapshot" :: held 3.480s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:30:15 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5628b0c0-cb18-4abd-80f1-34a8f2bf49b1 tempest-VolumeDependencyTests-341232480 None] Lock "cinder-quobyte-8b160888-756d-4574-b870-30149de01b6a" released by "delete_snapshot" :: held 3.511s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:30:15 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-5628b0c0-cb18-4abd-80f1-34a8f2bf49b1 tempest-VolumeDependencyTests-341232480 None] Created reservations ['3fd8d3b3-0ece-4119-8650-7771864eb0bd', 'd1e6d0e4-6be0-46c5-8cf6-f5ec3c672d32', '70752928-25d6-4d66-8426-2678f9adee1c', 'c7d0c5b8-a3ad-45d7-922b-5e72b9a86bad'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:30:15 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-5628b0c0-cb18-4abd-80f1-34a8f2bf49b1 tempest-VolumeDependencyTests-341232480 None] Delete snapshot completed successfully.
Jul 03 01:30:15 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5628b0c0-cb18-4abd-80f1-34a8f2bf49b1 tempest-VolumeDependencyTests-341232480 None] Lock "cinder-f9586d46-c230-4c76-9bf5-9192155e46a7-delete_snapshot" released by "delete_snapshot" :: held 3.653s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:30:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-17554247-e01a-415a-a91c-5ffcd2b2c905 tempest-ProjectMemberTests-1866302072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:30:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-17554247-e01a-415a-a91c-5ffcd2b2c905 tempest-ProjectMemberTests-1866302072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:30:15 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-17554247-e01a-415a-a91c-5ffcd2b2c905 tempest-ProjectMemberTests-1866302072 None] Creating offline snapshot 8bdf828f-d247-40d7-ad98-1d4b05679aa1 of volume 3b4f63a1-eda7-467f-aef3-a78ba65b9bd1 {{(pid=86891) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 01:30:15 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a52820-7fa4-4cdf-b798-4786ef8df95e]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:30:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-17554247-e01a-415a-a91c-5ffcd2b2c905 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3b4f63a1-eda7-467f-aef3-a78ba65b9bd1 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:15 devstack sudo[107391]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e8198c2f-26c3-4b89-9f5a-978bb4901f86 tempest-ProjectReaderTests-1804050025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-5c4dd852-c6d2-47a7-a1c7-c69f318dc463" returned: 0 in 0.724s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:15 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e8198c2f-26c3-4b89-9f5a-978bb4901f86 tempest-ProjectReaderTests-1804050025 None] Lock "cinder-quobyte-5c4dd852-c6d2-47a7-a1c7-c69f318dc463" released by "delete_volume" :: held 1.634s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:30:15 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-e8198c2f-26c3-4b89-9f5a-978bb4901f86 tempest-ProjectReaderTests-1804050025 None] Created reservations ['9d3ba0b6-8178-4322-8d2e-c3ea25edebb3', 'da989205-d263-4d96-be41-2d4e0c27df54', 'c5fae308-6364-45e6-8be9-1182e88bd785', '0e5325b4-3d34-4ff9-bd88-fda7dfae311c'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:30:15 devstack sudo[107395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3b4f63a1-eda7-467f-aef3-a78ba65b9bd1
Jul 03 01:30:15 devstack sudo[107395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e8198c2f-26c3-4b89-9f5a-978bb4901f86 tempest-ProjectReaderTests-1804050025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:30:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e8198c2f-26c3-4b89-9f5a-978bb4901f86 tempest-ProjectReaderTests-1804050025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:30:15 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-e8198c2f-26c3-4b89-9f5a-978bb4901f86 tempest-ProjectReaderTests-1804050025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:30:15 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-e8198c2f-26c3-4b89-9f5a-978bb4901f86 tempest-ProjectReaderTests-1804050025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:30:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e8198c2f-26c3-4b89-9f5a-978bb4901f86 tempest-ProjectReaderTests-1804050025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:30:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e8198c2f-26c3-4b89-9f5a-978bb4901f86 tempest-ProjectReaderTests-1804050025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:15 devstack sudo[107397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:30:15 devstack sudo[107397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:15 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-20877ebc-1e17-40f9-8c7b-07d76f393ae1 tempest-VolumeDependencyTests-341232480 None] Acquiring lock "cinder-8b160888-756d-4574-b870-30149de01b6a-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:30:15 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-20877ebc-1e17-40f9-8c7b-07d76f393ae1 tempest-VolumeDependencyTests-341232480 None] Lock "cinder-8b160888-756d-4574-b870-30149de01b6a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:30:15 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-20877ebc-1e17-40f9-8c7b-07d76f393ae1 tempest-VolumeDependencyTests-341232480 None] Acquiring lock "cinder-quobyte-8b160888-756d-4574-b870-30149de01b6a" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:30:15 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-20877ebc-1e17-40f9-8c7b-07d76f393ae1 tempest-VolumeDependencyTests-341232480 None] Lock "cinder-quobyte-8b160888-756d-4574-b870-30149de01b6a" acquired by "delete_volume" :: waited 0.015s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:30:16 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5ef782-f548-497d-90b9-f1cc07281483]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:30:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-20877ebc-1e17-40f9-8c7b-07d76f393ae1 tempest-VolumeDependencyTests-341232480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b160888-756d-4574-b870-30149de01b6a {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:16 devstack sudo[107399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b160888-756d-4574-b870-30149de01b6a
Jul 03 01:30:16 devstack sudo[107399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:16 devstack sudo[107395]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-17554247-e01a-415a-a91c-5ffcd2b2c905 tempest-ProjectMemberTests-1866302072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3b4f63a1-eda7-467f-aef3-a78ba65b9bd1" returned: 0 in 0.949s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-17554247-e01a-415a-a91c-5ffcd2b2c905 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3b4f63a1-eda7-467f-aef3-a78ba65b9bd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3b4f63a1-eda7-467f-aef3-a78ba65b9bd1.8bdf828f-d247-40d7-ad98-1d4b05679aa1 1G {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:16 devstack sudo[107404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3b4f63a1-eda7-467f-aef3-a78ba65b9bd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3b4f63a1-eda7-467f-aef3-a78ba65b9bd1.8bdf828f-d247-40d7-ad98-1d4b05679aa1 1G
Jul 03 01:30:16 devstack sudo[107404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:16 devstack sudo[107397]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e8198c2f-26c3-4b89-9f5a-978bb4901f86 tempest-ProjectReaderTests-1804050025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 1.100s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:16 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-e8198c2f-26c3-4b89-9f5a-978bb4901f86 tempest-ProjectReaderTests-1804050025 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:30:16 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-e8198c2f-26c3-4b89-9f5a-978bb4901f86 tempest-ProjectReaderTests-1804050025 None] Deleted volume successfully.
Jul 03 01:30:16 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e8198c2f-26c3-4b89-9f5a-978bb4901f86 tempest-ProjectReaderTests-1804050025 None] Lock "cinder-5c4dd852-c6d2-47a7-a1c7-c69f318dc463-delete_volume" released by "delete_volume" :: held 3.012s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:30:16 devstack sudo[107399]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-20877ebc-1e17-40f9-8c7b-07d76f393ae1 tempest-VolumeDependencyTests-341232480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b160888-756d-4574-b870-30149de01b6a" returned: 0 in 0.986s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-20877ebc-1e17-40f9-8c7b-07d76f393ae1 tempest-VolumeDependencyTests-341232480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b160888-756d-4574-b870-30149de01b6a {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:17 devstack sudo[107412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b160888-756d-4574-b870-30149de01b6a
Jul 03 01:30:17 devstack sudo[107412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:17 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2a80980-8adf-4f67-a1ee-a742925e7333 tempest-ProjectReaderTests-1804050025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:30:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f2a80980-8adf-4f67-a1ee-a742925e7333 tempest-ProjectReaderTests-1804050025 None] Flow 'volume_create_manager' (38d4c296-c7ba-46b5-993b-41a54069dc66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:30:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f2a80980-8adf-4f67-a1ee-a742925e7333 tempest-ProjectReaderTests-1804050025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e04296c3-b388-40ea-81a5-15997d1d049a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:30:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f2a80980-8adf-4f67-a1ee-a742925e7333 tempest-ProjectReaderTests-1804050025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e04296c3-b388-40ea-81a5-15997d1d049a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:30:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1212549241',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=271a9fcc-f1e2-4807-b304-4942d9c7f546,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3c679f1635c4e2fa1010d8870605193',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:30:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:30:17Z,use_quota=True,user_id='9f1b37a81b5145a8ba88fac86273cb7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:30:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f2a80980-8adf-4f67-a1ee-a742925e7333 tempest-ProjectReaderTests-1804050025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca262788-cda4-4739-804b-94978b0ac4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:30:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f2a80980-8adf-4f67-a1ee-a742925e7333 tempest-ProjectReaderTests-1804050025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca262788-cda4-4739-804b-94978b0ac4d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:30:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f2a80980-8adf-4f67-a1ee-a742925e7333 tempest-ProjectReaderTests-1804050025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c655b27b-740f-46aa-a1d3-25e2c2ae9126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:30:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f2a80980-8adf-4f67-a1ee-a742925e7333 tempest-ProjectReaderTests-1804050025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c655b27b-740f-46aa-a1d3-25e2c2ae9126) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '271a9fcc-f1e2-4807-b304-4942d9c7f546', 'volume_name': 'volume-271a9fcc-f1e2-4807-b304-4942d9c7f546', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:30:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f2a80980-8adf-4f67-a1ee-a742925e7333 tempest-ProjectReaderTests-1804050025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8d83ce5-9407-4846-b3d0-be3d02e4ad97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:30:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f2a80980-8adf-4f67-a1ee-a742925e7333 tempest-ProjectReaderTests-1804050025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8d83ce5-9407-4846-b3d0-be3d02e4ad97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:30:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f2a80980-8adf-4f67-a1ee-a742925e7333 tempest-ProjectReaderTests-1804050025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc85d1c9-4d9e-4362-8667-9f79bf47fa7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:30:17 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-f2a80980-8adf-4f67-a1ee-a742925e7333 tempest-ProjectReaderTests-1804050025 None] Volume 271a9fcc-f1e2-4807-b304-4942d9c7f546: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-271a9fcc-f1e2-4807-b304-4942d9c7f546', 'volume_size': 1}
Jul 03 01:30:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f2a80980-8adf-4f67-a1ee-a742925e7333 tempest-ProjectReaderTests-1804050025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:30:17 devstack sudo[107404]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-17554247-e01a-415a-a91c-5ffcd2b2c905 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3b4f63a1-eda7-467f-aef3-a78ba65b9bd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3b4f63a1-eda7-467f-aef3-a78ba65b9bd1.8bdf828f-d247-40d7-ad98-1d4b05679aa1 1G" returned: 0 in 0.983s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-17554247-e01a-415a-a91c-5ffcd2b2c905 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b4f63a1-eda7-467f-aef3-a78ba65b9bd1 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3b4f63a1-eda7-467f-aef3-a78ba65b9bd1.8bdf828f-d247-40d7-ad98-1d4b05679aa1 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:17 devstack sudo[107417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b4f63a1-eda7-467f-aef3-a78ba65b9bd1 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3b4f63a1-eda7-467f-aef3-a78ba65b9bd1.8bdf828f-d247-40d7-ad98-1d4b05679aa1
Jul 03 01:30:17 devstack sudo[107417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:17 devstack sudo[107412]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-20877ebc-1e17-40f9-8c7b-07d76f393ae1 tempest-VolumeDependencyTests-341232480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-8b160888-756d-4574-b870-30149de01b6a" returned: 0 in 0.734s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:17 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-20877ebc-1e17-40f9-8c7b-07d76f393ae1 tempest-VolumeDependencyTests-341232480 None] Lock "cinder-quobyte-8b160888-756d-4574-b870-30149de01b6a" released by "delete_volume" :: held 1.817s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:30:17 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-20877ebc-1e17-40f9-8c7b-07d76f393ae1 tempest-VolumeDependencyTests-341232480 None] Created reservations ['5bdf34bd-a85c-48b5-acc6-eb3dcf4932c3', '299860de-e634-4850-b312-b38ffa4c301e', '76a73947-e656-4642-874c-7903eeeeafa6', '1012ee71-dd6d-4a63-9855-c447fa3a70ae'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:30:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-20877ebc-1e17-40f9-8c7b-07d76f393ae1 tempest-VolumeDependencyTests-341232480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:30:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-20877ebc-1e17-40f9-8c7b-07d76f393ae1 tempest-VolumeDependencyTests-341232480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:30:17 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-20877ebc-1e17-40f9-8c7b-07d76f393ae1 tempest-VolumeDependencyTests-341232480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:30:17 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-20877ebc-1e17-40f9-8c7b-07d76f393ae1 tempest-VolumeDependencyTests-341232480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:30:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-20877ebc-1e17-40f9-8c7b-07d76f393ae1 tempest-VolumeDependencyTests-341232480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:30:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-20877ebc-1e17-40f9-8c7b-07d76f393ae1 tempest-VolumeDependencyTests-341232480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:17 devstack sudo[107420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:30:17 devstack sudo[107420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:18 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5b969635-bb7a-4934-b05b-7f5418abc8bc tempest-VolumeDependencyTests-341232480 None] Acquiring lock "cinder-250d92b3-d79d-479d-8804-848032171308-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:30:18 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5b969635-bb7a-4934-b05b-7f5418abc8bc tempest-VolumeDependencyTests-341232480 None] Lock "cinder-250d92b3-d79d-479d-8804-848032171308-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:30:18 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5b969635-bb7a-4934-b05b-7f5418abc8bc tempest-VolumeDependencyTests-341232480 None] Acquiring lock "cinder-quobyte-250d92b3-d79d-479d-8804-848032171308" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:30:18 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5b969635-bb7a-4934-b05b-7f5418abc8bc tempest-VolumeDependencyTests-341232480 None] Lock "cinder-quobyte-250d92b3-d79d-479d-8804-848032171308" acquired by "delete_volume" :: waited 0.014s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:30:18 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[58da806a-86ae-47e6-965e-d7815cfe78c0]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:30:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5b969635-bb7a-4934-b05b-7f5418abc8bc tempest-VolumeDependencyTests-341232480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-250d92b3-d79d-479d-8804-848032171308 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:18 devstack sudo[107417]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-17554247-e01a-415a-a91c-5ffcd2b2c905 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b4f63a1-eda7-467f-aef3-a78ba65b9bd1 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3b4f63a1-eda7-467f-aef3-a78ba65b9bd1.8bdf828f-d247-40d7-ad98-1d4b05679aa1" returned: 0 in 0.873s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:18 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-17554247-e01a-415a-a91c-5ffcd2b2c905 tempest-ProjectMemberTests-1866302072 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3b4f63a1-eda7-467f-aef3-a78ba65b9bd1.8bdf828f-d247-40d7-ad98-1d4b05679aa1 is being set with open permissions: ugo+rw
Jul 03 01:30:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-17554247-e01a-415a-a91c-5ffcd2b2c905 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3b4f63a1-eda7-467f-aef3-a78ba65b9bd1.8bdf828f-d247-40d7-ad98-1d4b05679aa1 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:18 devstack sudo[107427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3b4f63a1-eda7-467f-aef3-a78ba65b9bd1.8bdf828f-d247-40d7-ad98-1d4b05679aa1
Jul 03 01:30:18 devstack sudo[107427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:18 devstack sudo[107426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-250d92b3-d79d-479d-8804-848032171308
Jul 03 01:30:18 devstack sudo[107426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:18 devstack sudo[107420]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-20877ebc-1e17-40f9-8c7b-07d76f393ae1 tempest-VolumeDependencyTests-341232480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.913s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:18 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-20877ebc-1e17-40f9-8c7b-07d76f393ae1 tempest-VolumeDependencyTests-341232480 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:30:18 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-20877ebc-1e17-40f9-8c7b-07d76f393ae1 tempest-VolumeDependencyTests-341232480 None] Deleted volume successfully.
Jul 03 01:30:18 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-20877ebc-1e17-40f9-8c7b-07d76f393ae1 tempest-VolumeDependencyTests-341232480 None] Lock "cinder-8b160888-756d-4574-b870-30149de01b6a-delete_volume" released by "delete_volume" :: held 3.014s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:30:19 devstack sudo[107427]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:19 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-17554247-e01a-415a-a91c-5ffcd2b2c905 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3b4f63a1-eda7-467f-aef3-a78ba65b9bd1.8bdf828f-d247-40d7-ad98-1d4b05679aa1" returned: 0 in 0.735s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:19 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-17554247-e01a-415a-a91c-5ffcd2b2c905 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3b4f63a1-eda7-467f-aef3-a78ba65b9bd1.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:19 devstack sudo[107436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3b4f63a1-eda7-467f-aef3-a78ba65b9bd1.info
Jul 03 01:30:19 devstack sudo[107436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:19 devstack sudo[107426]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:19 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5b969635-bb7a-4934-b05b-7f5418abc8bc tempest-VolumeDependencyTests-341232480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-250d92b3-d79d-479d-8804-848032171308" returned: 0 in 0.911s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:19 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5b969635-bb7a-4934-b05b-7f5418abc8bc tempest-VolumeDependencyTests-341232480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-250d92b3-d79d-479d-8804-848032171308 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:19 devstack sudo[107438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-250d92b3-d79d-479d-8804-848032171308
Jul 03 01:30:19 devstack sudo[107438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:19 devstack sudo[107436]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:19 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-17554247-e01a-415a-a91c-5ffcd2b2c905 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3b4f63a1-eda7-467f-aef3-a78ba65b9bd1.info" returned: 0 in 0.674s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:19 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-17554247-e01a-415a-a91c-5ffcd2b2c905 tempest-ProjectMemberTests-1866302072 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3b4f63a1-eda7-467f-aef3-a78ba65b9bd1.info is being set with open permissions: ugo+rw
Jul 03 01:30:19 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-17554247-e01a-415a-a91c-5ffcd2b2c905 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3b4f63a1-eda7-467f-aef3-a78ba65b9bd1.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:19 devstack sudo[107442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3b4f63a1-eda7-467f-aef3-a78ba65b9bd1.info
Jul 03 01:30:19 devstack sudo[107442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:19 devstack sudo[107438]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:19 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5b969635-bb7a-4934-b05b-7f5418abc8bc tempest-VolumeDependencyTests-341232480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-250d92b3-d79d-479d-8804-848032171308" returned: 0 in 0.695s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:19 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5b969635-bb7a-4934-b05b-7f5418abc8bc tempest-VolumeDependencyTests-341232480 None] Lock "cinder-quobyte-250d92b3-d79d-479d-8804-848032171308" released by "delete_volume" :: held 1.656s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:30:19 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-5b969635-bb7a-4934-b05b-7f5418abc8bc tempest-VolumeDependencyTests-341232480 None] Created reservations ['7314fef3-2389-4cbf-b2d2-8602ba4bac39', '2c1c2e50-7aa6-491b-b5cc-aebc212d730a', '4d3baea2-f96f-4cd2-8737-b0f39bc6744b', '95a52b14-bc12-46fe-b257-1c1b01a6bad0'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:30:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-5b969635-bb7a-4934-b05b-7f5418abc8bc tempest-VolumeDependencyTests-341232480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:30:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-5b969635-bb7a-4934-b05b-7f5418abc8bc tempest-VolumeDependencyTests-341232480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:30:20 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-5b969635-bb7a-4934-b05b-7f5418abc8bc tempest-VolumeDependencyTests-341232480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:30:20 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-5b969635-bb7a-4934-b05b-7f5418abc8bc tempest-VolumeDependencyTests-341232480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:30:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-5b969635-bb7a-4934-b05b-7f5418abc8bc tempest-VolumeDependencyTests-341232480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:30:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5b969635-bb7a-4934-b05b-7f5418abc8bc tempest-VolumeDependencyTests-341232480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:20 devstack sudo[107444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:30:20 devstack sudo[107444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:20 devstack sudo[107442]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-17554247-e01a-415a-a91c-5ffcd2b2c905 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-3b4f63a1-eda7-467f-aef3-a78ba65b9bd1.info" returned: 0 in 0.766s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-17554247-e01a-415a-a91c-5ffcd2b2c905 tempest-ProjectMemberTests-1866302072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.075s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:30:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f2a80980-8adf-4f67-a1ee-a742925e7333 tempest-ProjectReaderTests-1804050025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.424s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:30:20 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-f2a80980-8adf-4f67-a1ee-a742925e7333 tempest-ProjectReaderTests-1804050025 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:30:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1212549241',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=271a9fcc-f1e2-4807-b304-4942d9c7f546,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3c679f1635c4e2fa1010d8870605193',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:30:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:30:17Z,use_quota=True,user_id='9f1b37a81b5145a8ba88fac86273cb7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:30:20 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-f2a80980-8adf-4f67-a1ee-a742925e7333 tempest-ProjectReaderTests-1804050025 None] Creating volume 271a9fcc-f1e2-4807-b304-4942d9c7f546 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:30:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f2a80980-8adf-4f67-a1ee-a742925e7333 tempest-ProjectReaderTests-1804050025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:30:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f2a80980-8adf-4f67-a1ee-a742925e7333 tempest-ProjectReaderTests-1804050025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:30:20 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-f2a80980-8adf-4f67-a1ee-a742925e7333 tempest-ProjectReaderTests-1804050025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:30:20 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-f2a80980-8adf-4f67-a1ee-a742925e7333 tempest-ProjectReaderTests-1804050025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:30:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f2a80980-8adf-4f67-a1ee-a742925e7333 tempest-ProjectReaderTests-1804050025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:30:20 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-f2a80980-8adf-4f67-a1ee-a742925e7333 tempest-ProjectReaderTests-1804050025 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:30:20 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-f2a80980-8adf-4f67-a1ee-a742925e7333 tempest-ProjectReaderTests-1804050025 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:30:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f2a80980-8adf-4f67-a1ee-a742925e7333 tempest-ProjectReaderTests-1804050025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-271a9fcc-f1e2-4807-b304-4942d9c7f546 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:20 devstack sudo[107449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-271a9fcc-f1e2-4807-b304-4942d9c7f546 1073741824
Jul 03 01:30:20 devstack sudo[107449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:20 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-17554247-e01a-415a-a91c-5ffcd2b2c905 tempest-ProjectMemberTests-1866302072 None] Create snapshot completed successfully
Jul 03 01:30:20 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5d4fc88d-825e-49bd-b8c1-377110cfce51 tempest-ProjectMemberTests-1866302072 None] Acquiring lock "cinder-8bdf828f-d247-40d7-ad98-1d4b05679aa1-delete_snapshot" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:30:20 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5d4fc88d-825e-49bd-b8c1-377110cfce51 tempest-ProjectMemberTests-1866302072 None] Lock "cinder-8bdf828f-d247-40d7-ad98-1d4b05679aa1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:30:20 devstack sudo[107444]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5b969635-bb7a-4934-b05b-7f5418abc8bc tempest-VolumeDependencyTests-341232480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.818s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:20 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-5b969635-bb7a-4934-b05b-7f5418abc8bc tempest-VolumeDependencyTests-341232480 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:30:20 devstack cinder-volume[86891]: INFO cinder.message.api [None req-5d4fc88d-825e-49bd-b8c1-377110cfce51 tempest-ProjectMemberTests-1866302072 None] Creating message record for request_id = req-5d4fc88d-825e-49bd-b8c1-377110cfce51
Jul 03 01:30:20 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-5b969635-bb7a-4934-b05b-7f5418abc8bc tempest-VolumeDependencyTests-341232480 None] Deleted volume successfully.
Jul 03 01:30:20 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5d4fc88d-825e-49bd-b8c1-377110cfce51 tempest-ProjectMemberTests-1866302072 None] Lock "cinder-8bdf828f-d247-40d7-ad98-1d4b05679aa1-delete_snapshot" released by "delete_snapshot" :: held 0.068s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:30:20 devstack cinder-volume[86891]: ERROR oslo_messaging.rpc.server [None req-5d4fc88d-825e-49bd-b8c1-377110cfce51 tempest-ProjectMemberTests-1866302072 None] Exception during message handling: AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'?
Jul 03 01:30:20 devstack cinder-volume[86891]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Jul 03 01:30:20 devstack cinder-volume[86891]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming
Jul 03 01:30:20 devstack cinder-volume[86891]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Jul 03 01:30:20 devstack cinder-volume[86891]: ERROR oslo_messaging.rpc.server           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jul 03 01:30:20 devstack cinder-volume[86891]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Jul 03 01:30:20 devstack cinder-volume[86891]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Jul 03 01:30:20 devstack cinder-volume[86891]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jul 03 01:30:20 devstack cinder-volume[86891]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Jul 03 01:30:20 devstack cinder-volume[86891]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Jul 03 01:30:20 devstack cinder-volume[86891]: ERROR oslo_messaging.rpc.server              ^^^^^^^^^^^^^^^^^^^^^^
Jul 03 01:30:20 devstack cinder-volume[86891]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 220, in wrapper
Jul 03 01:30:20 devstack cinder-volume[86891]: ERROR oslo_messaging.rpc.server     skip_clean = func(self, context, snapshot, *args, **kwargs)
Jul 03 01:30:20 devstack cinder-volume[86891]: ERROR oslo_messaging.rpc.server                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jul 03 01:30:20 devstack cinder-volume[86891]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/decorator/__init__.py", line 247, in fun
Jul 03 01:30:20 devstack cinder-volume[86891]: ERROR oslo_messaging.rpc.server     return caller(func, *(extras + args), **kw)
Jul 03 01:30:20 devstack cinder-volume[86891]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jul 03 01:30:20 devstack cinder-volume[86891]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/coordination.py", line 234, in _synchronized
Jul 03 01:30:20 devstack cinder-volume[86891]: ERROR oslo_messaging.rpc.server     return f(*a, **k)
Jul 03 01:30:20 devstack cinder-volume[86891]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^
Jul 03 01:30:20 devstack cinder-volume[86891]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 1351, in delete_snapshot
Jul 03 01:30:20 devstack cinder-volume[86891]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Jul 03 01:30:20 devstack cinder-volume[86891]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__
Jul 03 01:30:20 devstack cinder-volume[86891]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Jul 03 01:30:20 devstack cinder-volume[86891]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise
Jul 03 01:30:20 devstack cinder-volume[86891]: ERROR oslo_messaging.rpc.server     raise self.value
Jul 03 01:30:20 devstack cinder-volume[86891]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 1335, in delete_snapshot
Jul 03 01:30:20 devstack cinder-volume[86891]: ERROR oslo_messaging.rpc.server     self.driver.unmanage_snapshot(snapshot)
Jul 03 01:30:20 devstack cinder-volume[86891]: ERROR oslo_messaging.rpc.server     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jul 03 01:30:20 devstack cinder-volume[86891]: ERROR oslo_messaging.rpc.server AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'?
Jul 03 01:30:20 devstack cinder-volume[86891]: ERROR oslo_messaging.rpc.server 
Jul 03 01:30:20 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5b969635-bb7a-4934-b05b-7f5418abc8bc tempest-VolumeDependencyTests-341232480 None] Lock "cinder-250d92b3-d79d-479d-8804-848032171308-delete_volume" released by "delete_volume" :: held 2.807s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:30:21 devstack sudo[107449]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f2a80980-8adf-4f67-a1ee-a742925e7333 tempest-ProjectReaderTests-1804050025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-271a9fcc-f1e2-4807-b304-4942d9c7f546 1073741824" returned: 0 in 1.086s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f2a80980-8adf-4f67-a1ee-a742925e7333 tempest-ProjectReaderTests-1804050025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-271a9fcc-f1e2-4807-b304-4942d9c7f546 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:21 devstack sudo[107456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-271a9fcc-f1e2-4807-b304-4942d9c7f546
Jul 03 01:30:21 devstack sudo[107456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:22 devstack sudo[107456]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:22 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-f2a80980-8adf-4f67-a1ee-a742925e7333 tempest-ProjectReaderTests-1804050025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-271a9fcc-f1e2-4807-b304-4942d9c7f546" returned: 0 in 0.796s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:22 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-f2a80980-8adf-4f67-a1ee-a742925e7333 tempest-ProjectReaderTests-1804050025 None] <== create_volume: return (1936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:30:22 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-f2a80980-8adf-4f67-a1ee-a742925e7333 tempest-ProjectReaderTests-1804050025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.940s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:30:22 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f2a80980-8adf-4f67-a1ee-a742925e7333 tempest-ProjectReaderTests-1804050025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc85d1c9-4d9e-4362-8667-9f79bf47fa7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-271a9fcc-f1e2-4807-b304-4942d9c7f546', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:30:22 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f2a80980-8adf-4f67-a1ee-a742925e7333 tempest-ProjectReaderTests-1804050025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a09cf807-4053-49dc-b09f-c8b46337f350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:30:22 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-f2a80980-8adf-4f67-a1ee-a742925e7333 tempest-ProjectReaderTests-1804050025 None] Volume volume-271a9fcc-f1e2-4807-b304-4942d9c7f546 (271a9fcc-f1e2-4807-b304-4942d9c7f546): created successfully
Jul 03 01:30:22 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f2a80980-8adf-4f67-a1ee-a742925e7333 tempest-ProjectReaderTests-1804050025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a09cf807-4053-49dc-b09f-c8b46337f350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:30:22 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-f2a80980-8adf-4f67-a1ee-a742925e7333 tempest-ProjectReaderTests-1804050025 None] Flow 'volume_create_manager' (38d4c296-c7ba-46b5-993b-41a54069dc66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:30:22 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-f2a80980-8adf-4f67-a1ee-a742925e7333 tempest-ProjectReaderTests-1804050025 None] Created volume successfully.
Jul 03 01:30:23 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-410de803-c22e-41d8-bca6-a03e85d613f2 tempest-ProjectReaderTests-1804050025 None] Acquiring lock "cinder-271a9fcc-f1e2-4807-b304-4942d9c7f546-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:30:23 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-410de803-c22e-41d8-bca6-a03e85d613f2 tempest-ProjectReaderTests-1804050025 None] Lock "cinder-271a9fcc-f1e2-4807-b304-4942d9c7f546-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:30:23 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-410de803-c22e-41d8-bca6-a03e85d613f2 tempest-ProjectReaderTests-1804050025 None] Acquiring lock "cinder-quobyte-271a9fcc-f1e2-4807-b304-4942d9c7f546" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:30:23 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-410de803-c22e-41d8-bca6-a03e85d613f2 tempest-ProjectReaderTests-1804050025 None] Lock "cinder-quobyte-271a9fcc-f1e2-4807-b304-4942d9c7f546" acquired by "delete_volume" :: waited 0.017s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:30:23 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1d9668-a0c1-488e-b2bb-7a404fbd4c69]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:30:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-410de803-c22e-41d8-bca6-a03e85d613f2 tempest-ProjectReaderTests-1804050025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-271a9fcc-f1e2-4807-b304-4942d9c7f546 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:23 devstack sudo[107459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-271a9fcc-f1e2-4807-b304-4942d9c7f546
Jul 03 01:30:23 devstack sudo[107459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:24 devstack sudo[107459]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-410de803-c22e-41d8-bca6-a03e85d613f2 tempest-ProjectReaderTests-1804050025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-271a9fcc-f1e2-4807-b304-4942d9c7f546" returned: 0 in 0.788s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-410de803-c22e-41d8-bca6-a03e85d613f2 tempest-ProjectReaderTests-1804050025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-271a9fcc-f1e2-4807-b304-4942d9c7f546 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:24 devstack sudo[107464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-271a9fcc-f1e2-4807-b304-4942d9c7f546
Jul 03 01:30:24 devstack sudo[107464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:24 devstack sudo[107464]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-410de803-c22e-41d8-bca6-a03e85d613f2 tempest-ProjectReaderTests-1804050025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-271a9fcc-f1e2-4807-b304-4942d9c7f546" returned: 0 in 0.663s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:24 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-410de803-c22e-41d8-bca6-a03e85d613f2 tempest-ProjectReaderTests-1804050025 None] Lock "cinder-quobyte-271a9fcc-f1e2-4807-b304-4942d9c7f546" released by "delete_volume" :: held 1.492s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:30:24 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-410de803-c22e-41d8-bca6-a03e85d613f2 tempest-ProjectReaderTests-1804050025 None] Created reservations ['a59afa76-ce0c-4a83-b39b-6b74f38ec413', '3c9797b4-8ade-403a-862a-658c41de7a6d', '404f4266-d485-4aad-973d-4d5fb6842648', 'eab9c340-6b81-4912-9b09-e013632eb5c1'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:30:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-410de803-c22e-41d8-bca6-a03e85d613f2 tempest-ProjectReaderTests-1804050025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:30:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-410de803-c22e-41d8-bca6-a03e85d613f2 tempest-ProjectReaderTests-1804050025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:30:24 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-410de803-c22e-41d8-bca6-a03e85d613f2 tempest-ProjectReaderTests-1804050025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:30:24 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-410de803-c22e-41d8-bca6-a03e85d613f2 tempest-ProjectReaderTests-1804050025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:30:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-410de803-c22e-41d8-bca6-a03e85d613f2 tempest-ProjectReaderTests-1804050025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:30:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-410de803-c22e-41d8-bca6-a03e85d613f2 tempest-ProjectReaderTests-1804050025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:25 devstack sudo[107467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:30:25 devstack sudo[107467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:25 devstack sudo[107467]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-410de803-c22e-41d8-bca6-a03e85d613f2 tempest-ProjectReaderTests-1804050025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.806s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:25 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-410de803-c22e-41d8-bca6-a03e85d613f2 tempest-ProjectReaderTests-1804050025 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:30:25 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-410de803-c22e-41d8-bca6-a03e85d613f2 tempest-ProjectReaderTests-1804050025 None] Deleted volume successfully.
Jul 03 01:30:25 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-410de803-c22e-41d8-bca6-a03e85d613f2 tempest-ProjectReaderTests-1804050025 None] Lock "cinder-271a9fcc-f1e2-4807-b304-4942d9c7f546-delete_volume" released by "delete_volume" :: held 2.553s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:30:26 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfec4abc-92e9-439b-83e4-5bc63521d545 tempest-ProjectReaderTests-1804050025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:30:26 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-cfec4abc-92e9-439b-83e4-5bc63521d545 tempest-ProjectReaderTests-1804050025 None] Flow 'volume_create_manager' (ba206e27-c900-4131-9ac6-accca581b7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:30:26 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-cfec4abc-92e9-439b-83e4-5bc63521d545 tempest-ProjectReaderTests-1804050025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (720e95dc-c119-4f75-8b34-9b3c3decdff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:30:26 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-cfec4abc-92e9-439b-83e4-5bc63521d545 tempest-ProjectReaderTests-1804050025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (720e95dc-c119-4f75-8b34-9b3c3decdff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:30:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-83718126',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1aa4439-553e-49ba-911e-3dab52ee7fa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3c679f1635c4e2fa1010d8870605193',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:30:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:30:26Z,use_quota=True,user_id='9f1b37a81b5145a8ba88fac86273cb7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:30:26 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-cfec4abc-92e9-439b-83e4-5bc63521d545 tempest-ProjectReaderTests-1804050025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba3a2260-e48a-48e5-9e72-f3b1d2bef592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:30:26 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-cfec4abc-92e9-439b-83e4-5bc63521d545 tempest-ProjectReaderTests-1804050025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba3a2260-e48a-48e5-9e72-f3b1d2bef592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:30:26 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-cfec4abc-92e9-439b-83e4-5bc63521d545 tempest-ProjectReaderTests-1804050025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1666dc0-9cdf-4f0e-9589-8a508a9addbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:30:26 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-cfec4abc-92e9-439b-83e4-5bc63521d545 tempest-ProjectReaderTests-1804050025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1666dc0-9cdf-4f0e-9589-8a508a9addbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1aa4439-553e-49ba-911e-3dab52ee7fa2', 'volume_name': 'volume-a1aa4439-553e-49ba-911e-3dab52ee7fa2', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:30:26 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-cfec4abc-92e9-439b-83e4-5bc63521d545 tempest-ProjectReaderTests-1804050025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (954b2477-16b8-44ed-ab3b-84c71c77b1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:30:26 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-cfec4abc-92e9-439b-83e4-5bc63521d545 tempest-ProjectReaderTests-1804050025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (954b2477-16b8-44ed-ab3b-84c71c77b1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:30:26 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-cfec4abc-92e9-439b-83e4-5bc63521d545 tempest-ProjectReaderTests-1804050025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c743fe3-5e8b-4a40-b29c-9450f11266f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:30:26 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-cfec4abc-92e9-439b-83e4-5bc63521d545 tempest-ProjectReaderTests-1804050025 None] Volume a1aa4439-553e-49ba-911e-3dab52ee7fa2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1aa4439-553e-49ba-911e-3dab52ee7fa2', 'volume_size': 1}
Jul 03 01:30:26 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-cfec4abc-92e9-439b-83e4-5bc63521d545 tempest-ProjectReaderTests-1804050025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:30:26 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-cfec4abc-92e9-439b-83e4-5bc63521d545 tempest-ProjectReaderTests-1804050025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:30:26 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-cfec4abc-92e9-439b-83e4-5bc63521d545 tempest-ProjectReaderTests-1804050025 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:30:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-83718126',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1aa4439-553e-49ba-911e-3dab52ee7fa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3c679f1635c4e2fa1010d8870605193',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:30:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:30:26Z,use_quota=True,user_id='9f1b37a81b5145a8ba88fac86273cb7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:30:26 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-cfec4abc-92e9-439b-83e4-5bc63521d545 tempest-ProjectReaderTests-1804050025 None] Creating volume a1aa4439-553e-49ba-911e-3dab52ee7fa2 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:30:26 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-cfec4abc-92e9-439b-83e4-5bc63521d545 tempest-ProjectReaderTests-1804050025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:30:26 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-cfec4abc-92e9-439b-83e4-5bc63521d545 tempest-ProjectReaderTests-1804050025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:30:26 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-cfec4abc-92e9-439b-83e4-5bc63521d545 tempest-ProjectReaderTests-1804050025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:30:26 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-cfec4abc-92e9-439b-83e4-5bc63521d545 tempest-ProjectReaderTests-1804050025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:30:26 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-cfec4abc-92e9-439b-83e4-5bc63521d545 tempest-ProjectReaderTests-1804050025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:30:26 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-cfec4abc-92e9-439b-83e4-5bc63521d545 tempest-ProjectReaderTests-1804050025 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:30:26 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-cfec4abc-92e9-439b-83e4-5bc63521d545 tempest-ProjectReaderTests-1804050025 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:30:26 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-cfec4abc-92e9-439b-83e4-5bc63521d545 tempest-ProjectReaderTests-1804050025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a1aa4439-553e-49ba-911e-3dab52ee7fa2 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:26 devstack sudo[107470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a1aa4439-553e-49ba-911e-3dab52ee7fa2 1073741824
Jul 03 01:30:26 devstack sudo[107470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:27 devstack sudo[107470]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-cfec4abc-92e9-439b-83e4-5bc63521d545 tempest-ProjectReaderTests-1804050025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a1aa4439-553e-49ba-911e-3dab52ee7fa2 1073741824" returned: 0 in 1.001s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-cfec4abc-92e9-439b-83e4-5bc63521d545 tempest-ProjectReaderTests-1804050025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a1aa4439-553e-49ba-911e-3dab52ee7fa2 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:27 devstack sudo[107476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a1aa4439-553e-49ba-911e-3dab52ee7fa2
Jul 03 01:30:27 devstack sudo[107476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:28 devstack sudo[107476]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:28 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-cfec4abc-92e9-439b-83e4-5bc63521d545 tempest-ProjectReaderTests-1804050025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a1aa4439-553e-49ba-911e-3dab52ee7fa2" returned: 0 in 0.779s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:28 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-cfec4abc-92e9-439b-83e4-5bc63521d545 tempest-ProjectReaderTests-1804050025 None] <== create_volume: return (1843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:30:28 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-cfec4abc-92e9-439b-83e4-5bc63521d545 tempest-ProjectReaderTests-1804050025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.845s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:30:28 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-cfec4abc-92e9-439b-83e4-5bc63521d545 tempest-ProjectReaderTests-1804050025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c743fe3-5e8b-4a40-b29c-9450f11266f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1aa4439-553e-49ba-911e-3dab52ee7fa2', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:30:28 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-cfec4abc-92e9-439b-83e4-5bc63521d545 tempest-ProjectReaderTests-1804050025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed0f24c3-eddf-4783-8e33-6fd48ff1bd3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:30:28 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-cfec4abc-92e9-439b-83e4-5bc63521d545 tempest-ProjectReaderTests-1804050025 None] Volume volume-a1aa4439-553e-49ba-911e-3dab52ee7fa2 (a1aa4439-553e-49ba-911e-3dab52ee7fa2): created successfully
Jul 03 01:30:28 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-cfec4abc-92e9-439b-83e4-5bc63521d545 tempest-ProjectReaderTests-1804050025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed0f24c3-eddf-4783-8e33-6fd48ff1bd3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:30:28 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-cfec4abc-92e9-439b-83e4-5bc63521d545 tempest-ProjectReaderTests-1804050025 None] Flow 'volume_create_manager' (ba206e27-c900-4131-9ac6-accca581b7de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:30:28 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-cfec4abc-92e9-439b-83e4-5bc63521d545 tempest-ProjectReaderTests-1804050025 None] Created volume successfully.
Jul 03 01:30:29 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-6b8fc1ce-3912-47e3-bf6d-8960970c4ea2 tempest-ProjectReaderTests-1804050025 None] Acquiring lock "cinder-a1aa4439-553e-49ba-911e-3dab52ee7fa2-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:30:29 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-6b8fc1ce-3912-47e3-bf6d-8960970c4ea2 tempest-ProjectReaderTests-1804050025 None] Lock "cinder-a1aa4439-553e-49ba-911e-3dab52ee7fa2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:30:29 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-6b8fc1ce-3912-47e3-bf6d-8960970c4ea2 tempest-ProjectReaderTests-1804050025 None] Acquiring lock "cinder-quobyte-a1aa4439-553e-49ba-911e-3dab52ee7fa2" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:30:29 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-6b8fc1ce-3912-47e3-bf6d-8960970c4ea2 tempest-ProjectReaderTests-1804050025 None] Lock "cinder-quobyte-a1aa4439-553e-49ba-911e-3dab52ee7fa2" acquired by "delete_volume" :: waited 0.030s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:30:29 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[668ab3c1-8252-4d42-9777-a73200d7f18a]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:30:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6b8fc1ce-3912-47e3-bf6d-8960970c4ea2 tempest-ProjectReaderTests-1804050025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a1aa4439-553e-49ba-911e-3dab52ee7fa2 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:29 devstack sudo[107480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a1aa4439-553e-49ba-911e-3dab52ee7fa2
Jul 03 01:30:29 devstack sudo[107480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:30 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-761c2abf-8332-414e-b489-599409cc7780 tempest-ProjectReaderTests-812849349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:30:30 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-761c2abf-8332-414e-b489-599409cc7780 tempest-ProjectReaderTests-812849349 None] Flow 'volume_create_manager' (54963c96-7651-44c8-9888-01da7682287e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:30:30 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-761c2abf-8332-414e-b489-599409cc7780 tempest-ProjectReaderTests-812849349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b64b1529-6a7e-47f2-a182-001e82fa293e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:30:30 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-761c2abf-8332-414e-b489-599409cc7780 tempest-ProjectReaderTests-812849349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b64b1529-6a7e-47f2-a182-001e82fa293e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:30:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2028845273',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=916903cb-1a6d-49e0-b07d-de0df2743212,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5434f12e1ba472a853c0eeeee49097f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:30:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:30:30Z,use_quota=True,user_id='8473987273274ccf818181429aafb11a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:30:30 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-761c2abf-8332-414e-b489-599409cc7780 tempest-ProjectReaderTests-812849349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (579b1ecc-ea07-4dfa-a9eb-cf776534e993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:30:30 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-761c2abf-8332-414e-b489-599409cc7780 tempest-ProjectReaderTests-812849349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (579b1ecc-ea07-4dfa-a9eb-cf776534e993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:30:30 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-761c2abf-8332-414e-b489-599409cc7780 tempest-ProjectReaderTests-812849349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23d0c06d-18a9-489f-b462-37cfeaea9341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:30:30 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-761c2abf-8332-414e-b489-599409cc7780 tempest-ProjectReaderTests-812849349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23d0c06d-18a9-489f-b462-37cfeaea9341) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '916903cb-1a6d-49e0-b07d-de0df2743212', 'volume_name': 'volume-916903cb-1a6d-49e0-b07d-de0df2743212', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:30:30 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-761c2abf-8332-414e-b489-599409cc7780 tempest-ProjectReaderTests-812849349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1b237ca-e4ff-47f5-a744-53a48f987f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:30:30 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-761c2abf-8332-414e-b489-599409cc7780 tempest-ProjectReaderTests-812849349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1b237ca-e4ff-47f5-a744-53a48f987f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:30:30 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-761c2abf-8332-414e-b489-599409cc7780 tempest-ProjectReaderTests-812849349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c567eae-9d99-4f1d-b5f3-d1af4352feb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:30:30 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-761c2abf-8332-414e-b489-599409cc7780 tempest-ProjectReaderTests-812849349 None] Volume 916903cb-1a6d-49e0-b07d-de0df2743212: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-916903cb-1a6d-49e0-b07d-de0df2743212', 'volume_size': 1}
Jul 03 01:30:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-761c2abf-8332-414e-b489-599409cc7780 tempest-ProjectReaderTests-812849349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:30:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-761c2abf-8332-414e-b489-599409cc7780 tempest-ProjectReaderTests-812849349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:30:30 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-761c2abf-8332-414e-b489-599409cc7780 tempest-ProjectReaderTests-812849349 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:30:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2028845273',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=916903cb-1a6d-49e0-b07d-de0df2743212,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5434f12e1ba472a853c0eeeee49097f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:30:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:30:30Z,use_quota=True,user_id='8473987273274ccf818181429aafb11a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:30:30 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-761c2abf-8332-414e-b489-599409cc7780 tempest-ProjectReaderTests-812849349 None] Creating volume 916903cb-1a6d-49e0-b07d-de0df2743212 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:30:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-761c2abf-8332-414e-b489-599409cc7780 tempest-ProjectReaderTests-812849349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:30:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-761c2abf-8332-414e-b489-599409cc7780 tempest-ProjectReaderTests-812849349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:30:30 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-761c2abf-8332-414e-b489-599409cc7780 tempest-ProjectReaderTests-812849349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:30:30 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-761c2abf-8332-414e-b489-599409cc7780 tempest-ProjectReaderTests-812849349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:30:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-761c2abf-8332-414e-b489-599409cc7780 tempest-ProjectReaderTests-812849349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:30:30 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-761c2abf-8332-414e-b489-599409cc7780 tempest-ProjectReaderTests-812849349 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:30:30 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-761c2abf-8332-414e-b489-599409cc7780 tempest-ProjectReaderTests-812849349 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:30:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-761c2abf-8332-414e-b489-599409cc7780 tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-916903cb-1a6d-49e0-b07d-de0df2743212 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:30 devstack sudo[107483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-916903cb-1a6d-49e0-b07d-de0df2743212 1073741824
Jul 03 01:30:30 devstack sudo[107483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:30 devstack sudo[107480]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6b8fc1ce-3912-47e3-bf6d-8960970c4ea2 tempest-ProjectReaderTests-1804050025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a1aa4439-553e-49ba-911e-3dab52ee7fa2" returned: 0 in 0.886s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6b8fc1ce-3912-47e3-bf6d-8960970c4ea2 tempest-ProjectReaderTests-1804050025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a1aa4439-553e-49ba-911e-3dab52ee7fa2 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:30 devstack sudo[107488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a1aa4439-553e-49ba-911e-3dab52ee7fa2
Jul 03 01:30:30 devstack sudo[107488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:31 devstack sudo[107488]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:31 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6b8fc1ce-3912-47e3-bf6d-8960970c4ea2 tempest-ProjectReaderTests-1804050025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-a1aa4439-553e-49ba-911e-3dab52ee7fa2" returned: 0 in 0.727s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:31 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-6b8fc1ce-3912-47e3-bf6d-8960970c4ea2 tempest-ProjectReaderTests-1804050025 None] Lock "cinder-quobyte-a1aa4439-553e-49ba-911e-3dab52ee7fa2" released by "delete_volume" :: held 1.662s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:30:31 devstack sudo[107483]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:31 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-761c2abf-8332-414e-b489-599409cc7780 tempest-ProjectReaderTests-812849349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-916903cb-1a6d-49e0-b07d-de0df2743212 1073741824" returned: 0 in 0.954s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:31 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-761c2abf-8332-414e-b489-599409cc7780 tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-916903cb-1a6d-49e0-b07d-de0df2743212 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:31 devstack sudo[107496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-916903cb-1a6d-49e0-b07d-de0df2743212
Jul 03 01:30:31 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-6b8fc1ce-3912-47e3-bf6d-8960970c4ea2 tempest-ProjectReaderTests-1804050025 None] Created reservations ['c4962759-2ebb-4022-b556-6a2a8022c9d3', 'f3679aa4-7c8e-4109-8a51-7e734ad298eb', 'c98ab963-1c17-4f9a-b328-6cfb22e2dc70', 'd8ccce12-fa6a-4f1c-8e1b-fde4da994ce8'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:30:31 devstack sudo[107496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:31 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-6b8fc1ce-3912-47e3-bf6d-8960970c4ea2 tempest-ProjectReaderTests-1804050025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:30:31 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-6b8fc1ce-3912-47e3-bf6d-8960970c4ea2 tempest-ProjectReaderTests-1804050025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:30:31 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-6b8fc1ce-3912-47e3-bf6d-8960970c4ea2 tempest-ProjectReaderTests-1804050025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:30:31 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-6b8fc1ce-3912-47e3-bf6d-8960970c4ea2 tempest-ProjectReaderTests-1804050025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:30:31 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-6b8fc1ce-3912-47e3-bf6d-8960970c4ea2 tempest-ProjectReaderTests-1804050025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:30:31 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6b8fc1ce-3912-47e3-bf6d-8960970c4ea2 tempest-ProjectReaderTests-1804050025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:31 devstack sudo[107498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:30:31 devstack sudo[107498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:31 devstack sudo[107496]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:31 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-761c2abf-8332-414e-b489-599409cc7780 tempest-ProjectReaderTests-812849349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-916903cb-1a6d-49e0-b07d-de0df2743212" returned: 0 in 0.748s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:31 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-761c2abf-8332-414e-b489-599409cc7780 tempest-ProjectReaderTests-812849349 None] <== create_volume: return (1770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:30:31 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-761c2abf-8332-414e-b489-599409cc7780 tempest-ProjectReaderTests-812849349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.775s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:30:32 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-761c2abf-8332-414e-b489-599409cc7780 tempest-ProjectReaderTests-812849349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c567eae-9d99-4f1d-b5f3-d1af4352feb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-916903cb-1a6d-49e0-b07d-de0df2743212', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:30:32 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-761c2abf-8332-414e-b489-599409cc7780 tempest-ProjectReaderTests-812849349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60ea3cb9-cfc7-422c-958e-760f5bd29376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:30:32 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-761c2abf-8332-414e-b489-599409cc7780 tempest-ProjectReaderTests-812849349 None] Volume volume-916903cb-1a6d-49e0-b07d-de0df2743212 (916903cb-1a6d-49e0-b07d-de0df2743212): created successfully
Jul 03 01:30:32 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-761c2abf-8332-414e-b489-599409cc7780 tempest-ProjectReaderTests-812849349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60ea3cb9-cfc7-422c-958e-760f5bd29376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:30:32 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-761c2abf-8332-414e-b489-599409cc7780 tempest-ProjectReaderTests-812849349 None] Flow 'volume_create_manager' (54963c96-7651-44c8-9888-01da7682287e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:30:32 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-761c2abf-8332-414e-b489-599409cc7780 tempest-ProjectReaderTests-812849349 None] Created volume successfully.
Jul 03 01:30:32 devstack sudo[107498]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6b8fc1ce-3912-47e3-bf6d-8960970c4ea2 tempest-ProjectReaderTests-1804050025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.813s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:32 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-6b8fc1ce-3912-47e3-bf6d-8960970c4ea2 tempest-ProjectReaderTests-1804050025 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:30:32 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-6b8fc1ce-3912-47e3-bf6d-8960970c4ea2 tempest-ProjectReaderTests-1804050025 None] Deleted volume successfully.
Jul 03 01:30:32 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-6b8fc1ce-3912-47e3-bf6d-8960970c4ea2 tempest-ProjectReaderTests-1804050025 None] Lock "cinder-a1aa4439-553e-49ba-911e-3dab52ee7fa2-delete_volume" released by "delete_volume" :: held 2.805s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:30:32 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2275e8d-d594-4db2-a235-d6f723bdce1d tempest-ProjectReaderTests-1804050025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:30:32 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a2275e8d-d594-4db2-a235-d6f723bdce1d tempest-ProjectReaderTests-1804050025 None] Flow 'volume_create_manager' (41e32cb5-f502-443e-adc4-5fdf1f6e4ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:30:32 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a2275e8d-d594-4db2-a235-d6f723bdce1d tempest-ProjectReaderTests-1804050025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25618a17-3485-4e40-bbb1-893b29781c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:30:32 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a2275e8d-d594-4db2-a235-d6f723bdce1d tempest-ProjectReaderTests-1804050025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25618a17-3485-4e40-bbb1-893b29781c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1233346465',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4854447a-71d3-4e2c-9004-927b980be6e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3c679f1635c4e2fa1010d8870605193',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:30:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:30:32Z,use_quota=True,user_id='9f1b37a81b5145a8ba88fac86273cb7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:30:32 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a2275e8d-d594-4db2-a235-d6f723bdce1d tempest-ProjectReaderTests-1804050025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d691c4b-81c1-486f-929a-2c8dd8156d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:30:32 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a2275e8d-d594-4db2-a235-d6f723bdce1d tempest-ProjectReaderTests-1804050025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d691c4b-81c1-486f-929a-2c8dd8156d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:30:32 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a2275e8d-d594-4db2-a235-d6f723bdce1d tempest-ProjectReaderTests-1804050025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ef90106-80fa-4293-8bf8-6b6dae6d3b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:30:32 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a2275e8d-d594-4db2-a235-d6f723bdce1d tempest-ProjectReaderTests-1804050025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ef90106-80fa-4293-8bf8-6b6dae6d3b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4854447a-71d3-4e2c-9004-927b980be6e0', 'volume_name': 'volume-4854447a-71d3-4e2c-9004-927b980be6e0', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:30:32 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a2275e8d-d594-4db2-a235-d6f723bdce1d tempest-ProjectReaderTests-1804050025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (661cf560-685e-4222-9888-60cbc5e90597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:30:32 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a2275e8d-d594-4db2-a235-d6f723bdce1d tempest-ProjectReaderTests-1804050025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (661cf560-685e-4222-9888-60cbc5e90597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:30:32 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a2275e8d-d594-4db2-a235-d6f723bdce1d tempest-ProjectReaderTests-1804050025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a98c9e6b-c984-4ed6-a37f-00a78c4ced6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:30:32 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-a2275e8d-d594-4db2-a235-d6f723bdce1d tempest-ProjectReaderTests-1804050025 None] Volume 4854447a-71d3-4e2c-9004-927b980be6e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4854447a-71d3-4e2c-9004-927b980be6e0', 'volume_size': 1}
Jul 03 01:30:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a2275e8d-d594-4db2-a235-d6f723bdce1d tempest-ProjectReaderTests-1804050025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:30:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a2275e8d-d594-4db2-a235-d6f723bdce1d tempest-ProjectReaderTests-1804050025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:30:32 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-a2275e8d-d594-4db2-a235-d6f723bdce1d tempest-ProjectReaderTests-1804050025 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1233346465',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4854447a-71d3-4e2c-9004-927b980be6e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3c679f1635c4e2fa1010d8870605193',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:30:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:30:32Z,use_quota=True,user_id='9f1b37a81b5145a8ba88fac86273cb7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:30:32 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-a2275e8d-d594-4db2-a235-d6f723bdce1d tempest-ProjectReaderTests-1804050025 None] Creating volume 4854447a-71d3-4e2c-9004-927b980be6e0 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:30:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a2275e8d-d594-4db2-a235-d6f723bdce1d tempest-ProjectReaderTests-1804050025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:30:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a2275e8d-d594-4db2-a235-d6f723bdce1d tempest-ProjectReaderTests-1804050025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:30:32 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-a2275e8d-d594-4db2-a235-d6f723bdce1d tempest-ProjectReaderTests-1804050025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:30:32 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-a2275e8d-d594-4db2-a235-d6f723bdce1d tempest-ProjectReaderTests-1804050025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:30:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a2275e8d-d594-4db2-a235-d6f723bdce1d tempest-ProjectReaderTests-1804050025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:30:32 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-a2275e8d-d594-4db2-a235-d6f723bdce1d tempest-ProjectReaderTests-1804050025 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:30:32 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-a2275e8d-d594-4db2-a235-d6f723bdce1d tempest-ProjectReaderTests-1804050025 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:30:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a2275e8d-d594-4db2-a235-d6f723bdce1d tempest-ProjectReaderTests-1804050025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4854447a-71d3-4e2c-9004-927b980be6e0 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:32 devstack sudo[107502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4854447a-71d3-4e2c-9004-927b980be6e0 1073741824
Jul 03 01:30:32 devstack sudo[107502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-c48bb1f2-817c-4622-a80f-3da1ad637866 tempest-ProjectReaderTests-812849349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:30:33 devstack sudo[107502]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a2275e8d-d594-4db2-a235-d6f723bdce1d tempest-ProjectReaderTests-1804050025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4854447a-71d3-4e2c-9004-927b980be6e0 1073741824" returned: 0 in 0.903s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a2275e8d-d594-4db2-a235-d6f723bdce1d tempest-ProjectReaderTests-1804050025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4854447a-71d3-4e2c-9004-927b980be6e0 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:33 devstack sudo[107508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4854447a-71d3-4e2c-9004-927b980be6e0
Jul 03 01:30:33 devstack sudo[107508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:33 devstack sudo[107508]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a2275e8d-d594-4db2-a235-d6f723bdce1d tempest-ProjectReaderTests-1804050025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4854447a-71d3-4e2c-9004-927b980be6e0" returned: 0 in 0.656s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:33 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-a2275e8d-d594-4db2-a235-d6f723bdce1d tempest-ProjectReaderTests-1804050025 None] <== create_volume: return (1597ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:30:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a2275e8d-d594-4db2-a235-d6f723bdce1d tempest-ProjectReaderTests-1804050025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.599s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:30:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-c48bb1f2-817c-4622-a80f-3da1ad637866 tempest-ProjectReaderTests-812849349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.396s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:30:33 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a2275e8d-d594-4db2-a235-d6f723bdce1d tempest-ProjectReaderTests-1804050025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a98c9e6b-c984-4ed6-a37f-00a78c4ced6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4854447a-71d3-4e2c-9004-927b980be6e0', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:30:33 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a2275e8d-d594-4db2-a235-d6f723bdce1d tempest-ProjectReaderTests-1804050025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d8bbb9e-8c9f-4581-bccb-2ee6d0e93dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:30:33 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-c48bb1f2-817c-4622-a80f-3da1ad637866 tempest-ProjectReaderTests-812849349 None] Creating offline snapshot 547520b1-dec6-41c7-b9cc-ce350042e1a4 of volume 916903cb-1a6d-49e0-b07d-de0df2743212 {{(pid=86891) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 01:30:33 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-a2275e8d-d594-4db2-a235-d6f723bdce1d tempest-ProjectReaderTests-1804050025 None] Volume volume-4854447a-71d3-4e2c-9004-927b980be6e0 (4854447a-71d3-4e2c-9004-927b980be6e0): created successfully
Jul 03 01:30:33 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a2275e8d-d594-4db2-a235-d6f723bdce1d tempest-ProjectReaderTests-1804050025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d8bbb9e-8c9f-4581-bccb-2ee6d0e93dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:30:33 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-a2275e8d-d594-4db2-a235-d6f723bdce1d tempest-ProjectReaderTests-1804050025 None] Flow 'volume_create_manager' (41e32cb5-f502-443e-adc4-5fdf1f6e4ffa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:30:33 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[f504d0b5-0e2e-456a-b6d2-a3450f72aeb2]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:30:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c48bb1f2-817c-4622-a80f-3da1ad637866 tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-916903cb-1a6d-49e0-b07d-de0df2743212 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:33 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-a2275e8d-d594-4db2-a235-d6f723bdce1d tempest-ProjectReaderTests-1804050025 None] Created volume successfully.
Jul 03 01:30:34 devstack sudo[107511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-916903cb-1a6d-49e0-b07d-de0df2743212
Jul 03 01:30:34 devstack sudo[107511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:34 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d2841074-cb27-46f8-8328-9a981f8cd182 tempest-ProjectReaderTests-1804050025 None] Acquiring lock "cinder-4854447a-71d3-4e2c-9004-927b980be6e0-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:30:34 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d2841074-cb27-46f8-8328-9a981f8cd182 tempest-ProjectReaderTests-1804050025 None] Lock "cinder-4854447a-71d3-4e2c-9004-927b980be6e0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:30:34 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d2841074-cb27-46f8-8328-9a981f8cd182 tempest-ProjectReaderTests-1804050025 None] Acquiring lock "cinder-quobyte-4854447a-71d3-4e2c-9004-927b980be6e0" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:30:34 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d2841074-cb27-46f8-8328-9a981f8cd182 tempest-ProjectReaderTests-1804050025 None] Lock "cinder-quobyte-4854447a-71d3-4e2c-9004-927b980be6e0" acquired by "delete_volume" :: waited 0.024s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:30:34 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d034708-7c85-44bc-903a-81f9ab456610]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:30:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d2841074-cb27-46f8-8328-9a981f8cd182 tempest-ProjectReaderTests-1804050025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4854447a-71d3-4e2c-9004-927b980be6e0 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:34 devstack sudo[107513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4854447a-71d3-4e2c-9004-927b980be6e0
Jul 03 01:30:34 devstack sudo[107513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:34 devstack sudo[107511]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c48bb1f2-817c-4622-a80f-3da1ad637866 tempest-ProjectReaderTests-812849349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-916903cb-1a6d-49e0-b07d-de0df2743212" returned: 0 in 0.749s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c48bb1f2-817c-4622-a80f-3da1ad637866 tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-916903cb-1a6d-49e0-b07d-de0df2743212,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-916903cb-1a6d-49e0-b07d-de0df2743212.547520b1-dec6-41c7-b9cc-ce350042e1a4 1G {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:34 devstack sudo[107518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-916903cb-1a6d-49e0-b07d-de0df2743212,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-916903cb-1a6d-49e0-b07d-de0df2743212.547520b1-dec6-41c7-b9cc-ce350042e1a4 1G
Jul 03 01:30:34 devstack sudo[107518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:35 devstack sudo[107513]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d2841074-cb27-46f8-8328-9a981f8cd182 tempest-ProjectReaderTests-1804050025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4854447a-71d3-4e2c-9004-927b980be6e0" returned: 0 in 0.824s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d2841074-cb27-46f8-8328-9a981f8cd182 tempest-ProjectReaderTests-1804050025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4854447a-71d3-4e2c-9004-927b980be6e0 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:35 devstack sudo[107558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4854447a-71d3-4e2c-9004-927b980be6e0
Jul 03 01:30:35 devstack sudo[107558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:35 devstack sudo[107518]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c48bb1f2-817c-4622-a80f-3da1ad637866 tempest-ProjectReaderTests-812849349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-916903cb-1a6d-49e0-b07d-de0df2743212,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-916903cb-1a6d-49e0-b07d-de0df2743212.547520b1-dec6-41c7-b9cc-ce350042e1a4 1G" returned: 0 in 0.828s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c48bb1f2-817c-4622-a80f-3da1ad637866 tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-916903cb-1a6d-49e0-b07d-de0df2743212 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-916903cb-1a6d-49e0-b07d-de0df2743212.547520b1-dec6-41c7-b9cc-ce350042e1a4 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:35 devstack sudo[107565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-916903cb-1a6d-49e0-b07d-de0df2743212 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-916903cb-1a6d-49e0-b07d-de0df2743212.547520b1-dec6-41c7-b9cc-ce350042e1a4
Jul 03 01:30:35 devstack sudo[107565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:35 devstack sudo[107558]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d2841074-cb27-46f8-8328-9a981f8cd182 tempest-ProjectReaderTests-1804050025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-4854447a-71d3-4e2c-9004-927b980be6e0" returned: 0 in 0.695s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:35 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d2841074-cb27-46f8-8328-9a981f8cd182 tempest-ProjectReaderTests-1804050025 None] Lock "cinder-quobyte-4854447a-71d3-4e2c-9004-927b980be6e0" released by "delete_volume" :: held 1.564s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:30:35 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-d2841074-cb27-46f8-8328-9a981f8cd182 tempest-ProjectReaderTests-1804050025 None] Created reservations ['480ca31a-7e2e-44a9-9d18-227a21e41282', 'bd07fba0-06d3-4811-a1c8-e861a4c0ef07', 'b6307831-8432-4db6-a979-84af6c86a616', '8b0d3bb7-7e32-44d1-beff-3f8f67d29c7e'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:30:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-d2841074-cb27-46f8-8328-9a981f8cd182 tempest-ProjectReaderTests-1804050025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:30:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-d2841074-cb27-46f8-8328-9a981f8cd182 tempest-ProjectReaderTests-1804050025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:30:35 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-d2841074-cb27-46f8-8328-9a981f8cd182 tempest-ProjectReaderTests-1804050025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:30:35 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-d2841074-cb27-46f8-8328-9a981f8cd182 tempest-ProjectReaderTests-1804050025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:30:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-d2841074-cb27-46f8-8328-9a981f8cd182 tempest-ProjectReaderTests-1804050025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:30:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d2841074-cb27-46f8-8328-9a981f8cd182 tempest-ProjectReaderTests-1804050025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:35 devstack sudo[107568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:30:35 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:36 devstack sudo[107565]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c48bb1f2-817c-4622-a80f-3da1ad637866 tempest-ProjectReaderTests-812849349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-916903cb-1a6d-49e0-b07d-de0df2743212 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-916903cb-1a6d-49e0-b07d-de0df2743212.547520b1-dec6-41c7-b9cc-ce350042e1a4" returned: 0 in 0.699s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:36 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-c48bb1f2-817c-4622-a80f-3da1ad637866 tempest-ProjectReaderTests-812849349 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-916903cb-1a6d-49e0-b07d-de0df2743212.547520b1-dec6-41c7-b9cc-ce350042e1a4 is being set with open permissions: ugo+rw
Jul 03 01:30:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c48bb1f2-817c-4622-a80f-3da1ad637866 tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-916903cb-1a6d-49e0-b07d-de0df2743212.547520b1-dec6-41c7-b9cc-ce350042e1a4 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:36 devstack sudo[107573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-916903cb-1a6d-49e0-b07d-de0df2743212.547520b1-dec6-41c7-b9cc-ce350042e1a4
Jul 03 01:30:36 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:36 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d2841074-cb27-46f8-8328-9a981f8cd182 tempest-ProjectReaderTests-1804050025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.721s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:36 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-d2841074-cb27-46f8-8328-9a981f8cd182 tempest-ProjectReaderTests-1804050025 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:30:36 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-d2841074-cb27-46f8-8328-9a981f8cd182 tempest-ProjectReaderTests-1804050025 None] Deleted volume successfully.
Jul 03 01:30:36 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d2841074-cb27-46f8-8328-9a981f8cd182 tempest-ProjectReaderTests-1804050025 None] Lock "cinder-4854447a-71d3-4e2c-9004-927b980be6e0-delete_volume" released by "delete_volume" :: held 2.513s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:30:36 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c48bb1f2-817c-4622-a80f-3da1ad637866 tempest-ProjectReaderTests-812849349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-916903cb-1a6d-49e0-b07d-de0df2743212.547520b1-dec6-41c7-b9cc-ce350042e1a4" returned: 0 in 0.687s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c48bb1f2-817c-4622-a80f-3da1ad637866 tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-916903cb-1a6d-49e0-b07d-de0df2743212.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:36 devstack sudo[107577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-916903cb-1a6d-49e0-b07d-de0df2743212.info
Jul 03 01:30:36 devstack sudo[107577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:37 devstack sudo[107577]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c48bb1f2-817c-4622-a80f-3da1ad637866 tempest-ProjectReaderTests-812849349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-916903cb-1a6d-49e0-b07d-de0df2743212.info" returned: 0 in 0.726s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:37 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-c48bb1f2-817c-4622-a80f-3da1ad637866 tempest-ProjectReaderTests-812849349 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-916903cb-1a6d-49e0-b07d-de0df2743212.info is being set with open permissions: ugo+rw
Jul 03 01:30:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c48bb1f2-817c-4622-a80f-3da1ad637866 tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-916903cb-1a6d-49e0-b07d-de0df2743212.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:37 devstack sudo[107580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-916903cb-1a6d-49e0-b07d-de0df2743212.info
Jul 03 01:30:37 devstack sudo[107580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:38 devstack sudo[107580]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c48bb1f2-817c-4622-a80f-3da1ad637866 tempest-ProjectReaderTests-812849349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-916903cb-1a6d-49e0-b07d-de0df2743212.info" returned: 0 in 0.699s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-c48bb1f2-817c-4622-a80f-3da1ad637866 tempest-ProjectReaderTests-812849349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.487s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:30:38 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:SELECT=139,cinder:INSERT=49,cinder:UPDATE=197,cinder:DELETE=18 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:30:38 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:SELECT=132,cinder:INSERT=50,cinder:UPDATE=194,cinder:DELETE=16 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:30:38 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-c48bb1f2-817c-4622-a80f-3da1ad637866 tempest-ProjectReaderTests-812849349 None] Create snapshot completed successfully
Jul 03 01:30:38 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-2cff4052-7493-4a3a-a001-3ba5bd1c7510 tempest-ProjectReaderTests-812849349 None] Acquiring lock "cinder-547520b1-dec6-41c7-b9cc-ce350042e1a4-delete_snapshot" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:30:38 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-2cff4052-7493-4a3a-a001-3ba5bd1c7510 tempest-ProjectReaderTests-812849349 None] Lock "cinder-547520b1-dec6-41c7-b9cc-ce350042e1a4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:30:38 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-2cff4052-7493-4a3a-a001-3ba5bd1c7510 tempest-ProjectReaderTests-812849349 None] Acquiring lock "cinder-quobyte-916903cb-1a6d-49e0-b07d-de0df2743212" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:30:39 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-2cff4052-7493-4a3a-a001-3ba5bd1c7510 tempest-ProjectReaderTests-812849349 None] Lock "cinder-quobyte-916903cb-1a6d-49e0-b07d-de0df2743212" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:30:39 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-2cff4052-7493-4a3a-a001-3ba5bd1c7510 tempest-ProjectReaderTests-812849349 None] Acquiring lock "cinder-quobyte-547520b1-dec6-41c7-b9cc-ce350042e1a4" by "_delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:30:39 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-2cff4052-7493-4a3a-a001-3ba5bd1c7510 tempest-ProjectReaderTests-812849349 None] Lock "cinder-quobyte-547520b1-dec6-41c7-b9cc-ce350042e1a4" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:30:39 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-2cff4052-7493-4a3a-a001-3ba5bd1c7510 tempest-ProjectReaderTests-812849349 None] Deleting offline snapshot 547520b1-dec6-41c7-b9cc-ce350042e1a4 of volume 916903cb-1a6d-49e0-b07d-de0df2743212 {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 01:30:39 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-2cff4052-7493-4a3a-a001-3ba5bd1c7510 tempest-ProjectReaderTests-812849349 None] snapshot_file for this snap is: volume-916903cb-1a6d-49e0-b07d-de0df2743212.547520b1-dec6-41c7-b9cc-ce350042e1a4 {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 01:30:39 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[13fff31b-ac9a-4f96-ad2f-709ee27ab7bb]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:30:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-2cff4052-7493-4a3a-a001-3ba5bd1c7510 tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-916903cb-1a6d-49e0-b07d-de0df2743212.547520b1-dec6-41c7-b9cc-ce350042e1a4 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:39 devstack sudo[107584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-916903cb-1a6d-49e0-b07d-de0df2743212.547520b1-dec6-41c7-b9cc-ce350042e1a4
Jul 03 01:30:39 devstack sudo[107584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:39 devstack sudo[107584]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-2cff4052-7493-4a3a-a001-3ba5bd1c7510 tempest-ProjectReaderTests-812849349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-916903cb-1a6d-49e0-b07d-de0df2743212.547520b1-dec6-41c7-b9cc-ce350042e1a4" returned: 0 in 0.753s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:39 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-2cff4052-7493-4a3a-a001-3ba5bd1c7510 tempest-ProjectReaderTests-812849349 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-916903cb-1a6d-49e0-b07d-de0df2743212(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:30:39 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[69076b99-2e58-460b-bdc0-485676377aec]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:30:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-2cff4052-7493-4a3a-a001-3ba5bd1c7510 tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-916903cb-1a6d-49e0-b07d-de0df2743212 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:39 devstack sudo[107589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-916903cb-1a6d-49e0-b07d-de0df2743212
Jul 03 01:30:39 devstack sudo[107589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:40 devstack sudo[107589]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-2cff4052-7493-4a3a-a001-3ba5bd1c7510 tempest-ProjectReaderTests-812849349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-916903cb-1a6d-49e0-b07d-de0df2743212" returned: 0 in 0.743s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-2cff4052-7493-4a3a-a001-3ba5bd1c7510 tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-916903cb-1a6d-49e0-b07d-de0df2743212.547520b1-dec6-41c7-b9cc-ce350042e1a4 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:40 devstack sudo[107594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-916903cb-1a6d-49e0-b07d-de0df2743212.547520b1-dec6-41c7-b9cc-ce350042e1a4
Jul 03 01:30:40 devstack sudo[107594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:41 devstack sudo[107594]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-2cff4052-7493-4a3a-a001-3ba5bd1c7510 tempest-ProjectReaderTests-812849349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-916903cb-1a6d-49e0-b07d-de0df2743212.547520b1-dec6-41c7-b9cc-ce350042e1a4" returned: 0 in 0.744s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-2cff4052-7493-4a3a-a001-3ba5bd1c7510 tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-916903cb-1a6d-49e0-b07d-de0df2743212.547520b1-dec6-41c7-b9cc-ce350042e1a4 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:41 devstack sudo[107605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-916903cb-1a6d-49e0-b07d-de0df2743212.547520b1-dec6-41c7-b9cc-ce350042e1a4
Jul 03 01:30:41 devstack sudo[107605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:41 devstack sudo[107605]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-2cff4052-7493-4a3a-a001-3ba5bd1c7510 tempest-ProjectReaderTests-812849349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-916903cb-1a6d-49e0-b07d-de0df2743212.547520b1-dec6-41c7-b9cc-ce350042e1a4" returned: 0 in 0.646s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:42 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-2cff4052-7493-4a3a-a001-3ba5bd1c7510 tempest-ProjectReaderTests-812849349 None] Lock "cinder-quobyte-547520b1-dec6-41c7-b9cc-ce350042e1a4" released by "_delete_snapshot" :: held 2.980s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:30:42 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-2cff4052-7493-4a3a-a001-3ba5bd1c7510 tempest-ProjectReaderTests-812849349 None] Lock "cinder-quobyte-916903cb-1a6d-49e0-b07d-de0df2743212" released by "delete_snapshot" :: held 3.006s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:30:42 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-2cff4052-7493-4a3a-a001-3ba5bd1c7510 tempest-ProjectReaderTests-812849349 None] Created reservations ['069a6e65-9a17-4919-a05f-efeb1403b44f', 'f42a25b7-c4f9-4f7b-81ce-9fa64671053e', '4f8159fe-4208-40c2-acb4-09573eed0058', '37a4527d-5f28-48ba-b4c9-faa041ca8df3'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:30:42 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-2cff4052-7493-4a3a-a001-3ba5bd1c7510 tempest-ProjectReaderTests-812849349 None] Delete snapshot completed successfully.
Jul 03 01:30:42 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-2cff4052-7493-4a3a-a001-3ba5bd1c7510 tempest-ProjectReaderTests-812849349 None] Lock "cinder-547520b1-dec6-41c7-b9cc-ce350042e1a4-delete_snapshot" released by "delete_snapshot" :: held 3.142s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:30:42 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-abfa824a-c445-41b1-8da7-707ab8f56e83 tempest-ProjectReaderTests-812849349 None] Acquiring lock "cinder-916903cb-1a6d-49e0-b07d-de0df2743212-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:30:42 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-abfa824a-c445-41b1-8da7-707ab8f56e83 tempest-ProjectReaderTests-812849349 None] Lock "cinder-916903cb-1a6d-49e0-b07d-de0df2743212-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:30:42 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-abfa824a-c445-41b1-8da7-707ab8f56e83 tempest-ProjectReaderTests-812849349 None] Acquiring lock "cinder-quobyte-916903cb-1a6d-49e0-b07d-de0df2743212" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:30:42 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-abfa824a-c445-41b1-8da7-707ab8f56e83 tempest-ProjectReaderTests-812849349 None] Lock "cinder-quobyte-916903cb-1a6d-49e0-b07d-de0df2743212" acquired by "delete_volume" :: waited 0.018s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:30:42 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba18e0b-33ad-4aa9-a9f1-aca801036915]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:30:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-abfa824a-c445-41b1-8da7-707ab8f56e83 tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-916903cb-1a6d-49e0-b07d-de0df2743212 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:42 devstack sudo[107608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-916903cb-1a6d-49e0-b07d-de0df2743212
Jul 03 01:30:42 devstack sudo[107608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:43 devstack sudo[107608]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-abfa824a-c445-41b1-8da7-707ab8f56e83 tempest-ProjectReaderTests-812849349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-916903cb-1a6d-49e0-b07d-de0df2743212" returned: 0 in 0.741s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-abfa824a-c445-41b1-8da7-707ab8f56e83 tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-916903cb-1a6d-49e0-b07d-de0df2743212 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:43 devstack sudo[107613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-916903cb-1a6d-49e0-b07d-de0df2743212
Jul 03 01:30:43 devstack sudo[107613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:43 devstack sudo[107613]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-abfa824a-c445-41b1-8da7-707ab8f56e83 tempest-ProjectReaderTests-812849349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-916903cb-1a6d-49e0-b07d-de0df2743212" returned: 0 in 0.665s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:43 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-abfa824a-c445-41b1-8da7-707ab8f56e83 tempest-ProjectReaderTests-812849349 None] Lock "cinder-quobyte-916903cb-1a6d-49e0-b07d-de0df2743212" released by "delete_volume" :: held 1.462s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:30:43 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-abfa824a-c445-41b1-8da7-707ab8f56e83 tempest-ProjectReaderTests-812849349 None] Created reservations ['2fc3aa4f-bf02-4c05-b5b0-a8e2bc230eff', '2002072f-ac46-44a6-a743-9e97ce0a37e2', '8806a153-4c1d-4f40-ac72-df9e6cf38b26', 'f2ea1d1b-ba84-4208-a0e1-f3b2a4480743'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:30:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-abfa824a-c445-41b1-8da7-707ab8f56e83 tempest-ProjectReaderTests-812849349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:30:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-abfa824a-c445-41b1-8da7-707ab8f56e83 tempest-ProjectReaderTests-812849349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:30:43 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-abfa824a-c445-41b1-8da7-707ab8f56e83 tempest-ProjectReaderTests-812849349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:30:43 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-abfa824a-c445-41b1-8da7-707ab8f56e83 tempest-ProjectReaderTests-812849349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:30:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-abfa824a-c445-41b1-8da7-707ab8f56e83 tempest-ProjectReaderTests-812849349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:30:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-abfa824a-c445-41b1-8da7-707ab8f56e83 tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:43 devstack sudo[107616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:30:43 devstack sudo[107616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:44 devstack sudo[107616]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-abfa824a-c445-41b1-8da7-707ab8f56e83 tempest-ProjectReaderTests-812849349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.658s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:44 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-abfa824a-c445-41b1-8da7-707ab8f56e83 tempest-ProjectReaderTests-812849349 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:30:44 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-abfa824a-c445-41b1-8da7-707ab8f56e83 tempest-ProjectReaderTests-812849349 None] Deleted volume successfully.
Jul 03 01:30:44 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-abfa824a-c445-41b1-8da7-707ab8f56e83 tempest-ProjectReaderTests-812849349 None] Lock "cinder-916903cb-1a6d-49e0-b07d-de0df2743212-delete_volume" released by "delete_volume" :: held 2.308s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:30:44 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2fad918-db1b-47f1-a481-c62a470ffced tempest-ProjectReaderTests-812849349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:30:44 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c2fad918-db1b-47f1-a481-c62a470ffced tempest-ProjectReaderTests-812849349 None] Flow 'volume_create_manager' (0af0e155-46b3-46ba-8fa3-758a848ca5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:30:44 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c2fad918-db1b-47f1-a481-c62a470ffced tempest-ProjectReaderTests-812849349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55aabf2a-cafb-470b-ae52-6ee44db8f3b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:30:44 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c2fad918-db1b-47f1-a481-c62a470ffced tempest-ProjectReaderTests-812849349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55aabf2a-cafb-470b-ae52-6ee44db8f3b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:30:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1460728691',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c54e2b6-81f1-4d1a-82df-1b959a7bf37e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5434f12e1ba472a853c0eeeee49097f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:30:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:30:45Z,use_quota=True,user_id='8473987273274ccf818181429aafb11a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:30:44 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c2fad918-db1b-47f1-a481-c62a470ffced tempest-ProjectReaderTests-812849349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (377f91b9-b1f5-4da6-8111-c9f2c19009d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:30:44 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c2fad918-db1b-47f1-a481-c62a470ffced tempest-ProjectReaderTests-812849349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (377f91b9-b1f5-4da6-8111-c9f2c19009d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:30:44 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c2fad918-db1b-47f1-a481-c62a470ffced tempest-ProjectReaderTests-812849349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (324480b2-d32e-4310-8275-53421f8128c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:30:44 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c2fad918-db1b-47f1-a481-c62a470ffced tempest-ProjectReaderTests-812849349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (324480b2-d32e-4310-8275-53421f8128c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c54e2b6-81f1-4d1a-82df-1b959a7bf37e', 'volume_name': 'volume-7c54e2b6-81f1-4d1a-82df-1b959a7bf37e', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:30:44 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c2fad918-db1b-47f1-a481-c62a470ffced tempest-ProjectReaderTests-812849349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d05277c8-20ce-45ba-8915-5f7b01194dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:30:44 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c2fad918-db1b-47f1-a481-c62a470ffced tempest-ProjectReaderTests-812849349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d05277c8-20ce-45ba-8915-5f7b01194dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:30:44 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c2fad918-db1b-47f1-a481-c62a470ffced tempest-ProjectReaderTests-812849349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2da5137e-59e2-4451-bbe6-e11e75c29f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:30:44 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-c2fad918-db1b-47f1-a481-c62a470ffced tempest-ProjectReaderTests-812849349 None] Volume 7c54e2b6-81f1-4d1a-82df-1b959a7bf37e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c54e2b6-81f1-4d1a-82df-1b959a7bf37e', 'volume_size': 1}
Jul 03 01:30:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-c2fad918-db1b-47f1-a481-c62a470ffced tempest-ProjectReaderTests-812849349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:30:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-c2fad918-db1b-47f1-a481-c62a470ffced tempest-ProjectReaderTests-812849349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:30:44 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-c2fad918-db1b-47f1-a481-c62a470ffced tempest-ProjectReaderTests-812849349 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:30:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1460728691',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c54e2b6-81f1-4d1a-82df-1b959a7bf37e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5434f12e1ba472a853c0eeeee49097f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:30:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:30:45Z,use_quota=True,user_id='8473987273274ccf818181429aafb11a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:30:44 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-c2fad918-db1b-47f1-a481-c62a470ffced tempest-ProjectReaderTests-812849349 None] Creating volume 7c54e2b6-81f1-4d1a-82df-1b959a7bf37e {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:30:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-c2fad918-db1b-47f1-a481-c62a470ffced tempest-ProjectReaderTests-812849349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:30:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-c2fad918-db1b-47f1-a481-c62a470ffced tempest-ProjectReaderTests-812849349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:30:44 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-c2fad918-db1b-47f1-a481-c62a470ffced tempest-ProjectReaderTests-812849349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:30:44 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-c2fad918-db1b-47f1-a481-c62a470ffced tempest-ProjectReaderTests-812849349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:30:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-c2fad918-db1b-47f1-a481-c62a470ffced tempest-ProjectReaderTests-812849349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:30:44 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-c2fad918-db1b-47f1-a481-c62a470ffced tempest-ProjectReaderTests-812849349 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:30:44 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-c2fad918-db1b-47f1-a481-c62a470ffced tempest-ProjectReaderTests-812849349 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:30:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c2fad918-db1b-47f1-a481-c62a470ffced tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7c54e2b6-81f1-4d1a-82df-1b959a7bf37e 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:44 devstack sudo[107619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7c54e2b6-81f1-4d1a-82df-1b959a7bf37e 1073741824
Jul 03 01:30:44 devstack sudo[107619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:45 devstack sudo[107619]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c2fad918-db1b-47f1-a481-c62a470ffced tempest-ProjectReaderTests-812849349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7c54e2b6-81f1-4d1a-82df-1b959a7bf37e 1073741824" returned: 0 in 0.781s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c2fad918-db1b-47f1-a481-c62a470ffced tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7c54e2b6-81f1-4d1a-82df-1b959a7bf37e {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:45 devstack sudo[107625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7c54e2b6-81f1-4d1a-82df-1b959a7bf37e
Jul 03 01:30:45 devstack sudo[107625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:46 devstack sudo[107625]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c2fad918-db1b-47f1-a481-c62a470ffced tempest-ProjectReaderTests-812849349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7c54e2b6-81f1-4d1a-82df-1b959a7bf37e" returned: 0 in 0.645s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:46 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-c2fad918-db1b-47f1-a481-c62a470ffced tempest-ProjectReaderTests-812849349 None] <== create_volume: return (1463ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:30:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-c2fad918-db1b-47f1-a481-c62a470ffced tempest-ProjectReaderTests-812849349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.466s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:30:46 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c2fad918-db1b-47f1-a481-c62a470ffced tempest-ProjectReaderTests-812849349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2da5137e-59e2-4451-bbe6-e11e75c29f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c54e2b6-81f1-4d1a-82df-1b959a7bf37e', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:30:46 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c2fad918-db1b-47f1-a481-c62a470ffced tempest-ProjectReaderTests-812849349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (085a65d7-845b-463c-afef-8355008b36d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:30:46 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-c2fad918-db1b-47f1-a481-c62a470ffced tempest-ProjectReaderTests-812849349 None] Volume volume-7c54e2b6-81f1-4d1a-82df-1b959a7bf37e (7c54e2b6-81f1-4d1a-82df-1b959a7bf37e): created successfully
Jul 03 01:30:46 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c2fad918-db1b-47f1-a481-c62a470ffced tempest-ProjectReaderTests-812849349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (085a65d7-845b-463c-afef-8355008b36d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:30:46 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-c2fad918-db1b-47f1-a481-c62a470ffced tempest-ProjectReaderTests-812849349 None] Flow 'volume_create_manager' (0af0e155-46b3-46ba-8fa3-758a848ca5a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:30:46 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-c2fad918-db1b-47f1-a481-c62a470ffced tempest-ProjectReaderTests-812849349 None] Created volume successfully.
Jul 03 01:30:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b6ae11b9-589d-422c-a7e8-508bd597df61 tempest-ProjectReaderTests-812849349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:30:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b6ae11b9-589d-422c-a7e8-508bd597df61 tempest-ProjectReaderTests-812849349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:30:47 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-b6ae11b9-589d-422c-a7e8-508bd597df61 tempest-ProjectReaderTests-812849349 None] Creating offline snapshot 7627f44c-8e09-4a3b-a5e0-eaf8c1b3d11b of volume 7c54e2b6-81f1-4d1a-82df-1b959a7bf37e {{(pid=86891) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 01:30:47 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[51902820-85b7-411d-9da8-59db5d6dc9e6]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:30:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b6ae11b9-589d-422c-a7e8-508bd597df61 tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7c54e2b6-81f1-4d1a-82df-1b959a7bf37e {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:47 devstack sudo[107628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7c54e2b6-81f1-4d1a-82df-1b959a7bf37e
Jul 03 01:30:47 devstack sudo[107628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:47 devstack sudo[107628]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b6ae11b9-589d-422c-a7e8-508bd597df61 tempest-ProjectReaderTests-812849349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7c54e2b6-81f1-4d1a-82df-1b959a7bf37e" returned: 0 in 0.751s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b6ae11b9-589d-422c-a7e8-508bd597df61 tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7c54e2b6-81f1-4d1a-82df-1b959a7bf37e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7c54e2b6-81f1-4d1a-82df-1b959a7bf37e.7627f44c-8e09-4a3b-a5e0-eaf8c1b3d11b 1G {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:47 devstack sudo[107633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7c54e2b6-81f1-4d1a-82df-1b959a7bf37e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7c54e2b6-81f1-4d1a-82df-1b959a7bf37e.7627f44c-8e09-4a3b-a5e0-eaf8c1b3d11b 1G
Jul 03 01:30:47 devstack sudo[107633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:48 devstack sudo[107633]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b6ae11b9-589d-422c-a7e8-508bd597df61 tempest-ProjectReaderTests-812849349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7c54e2b6-81f1-4d1a-82df-1b959a7bf37e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7c54e2b6-81f1-4d1a-82df-1b959a7bf37e.7627f44c-8e09-4a3b-a5e0-eaf8c1b3d11b 1G" returned: 0 in 0.794s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b6ae11b9-589d-422c-a7e8-508bd597df61 tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c54e2b6-81f1-4d1a-82df-1b959a7bf37e -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7c54e2b6-81f1-4d1a-82df-1b959a7bf37e.7627f44c-8e09-4a3b-a5e0-eaf8c1b3d11b {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:48 devstack sudo[107638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c54e2b6-81f1-4d1a-82df-1b959a7bf37e -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7c54e2b6-81f1-4d1a-82df-1b959a7bf37e.7627f44c-8e09-4a3b-a5e0-eaf8c1b3d11b
Jul 03 01:30:48 devstack sudo[107638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:49 devstack sudo[107638]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b6ae11b9-589d-422c-a7e8-508bd597df61 tempest-ProjectReaderTests-812849349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c54e2b6-81f1-4d1a-82df-1b959a7bf37e -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7c54e2b6-81f1-4d1a-82df-1b959a7bf37e.7627f44c-8e09-4a3b-a5e0-eaf8c1b3d11b" returned: 0 in 0.671s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:49 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-b6ae11b9-589d-422c-a7e8-508bd597df61 tempest-ProjectReaderTests-812849349 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7c54e2b6-81f1-4d1a-82df-1b959a7bf37e.7627f44c-8e09-4a3b-a5e0-eaf8c1b3d11b is being set with open permissions: ugo+rw
Jul 03 01:30:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b6ae11b9-589d-422c-a7e8-508bd597df61 tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7c54e2b6-81f1-4d1a-82df-1b959a7bf37e.7627f44c-8e09-4a3b-a5e0-eaf8c1b3d11b {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:49 devstack sudo[107644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7c54e2b6-81f1-4d1a-82df-1b959a7bf37e.7627f44c-8e09-4a3b-a5e0-eaf8c1b3d11b
Jul 03 01:30:49 devstack sudo[107644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:49 devstack sudo[107644]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b6ae11b9-589d-422c-a7e8-508bd597df61 tempest-ProjectReaderTests-812849349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7c54e2b6-81f1-4d1a-82df-1b959a7bf37e.7627f44c-8e09-4a3b-a5e0-eaf8c1b3d11b" returned: 0 in 0.643s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b6ae11b9-589d-422c-a7e8-508bd597df61 tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7c54e2b6-81f1-4d1a-82df-1b959a7bf37e.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:49 devstack sudo[107647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7c54e2b6-81f1-4d1a-82df-1b959a7bf37e.info
Jul 03 01:30:49 devstack sudo[107647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:50 devstack sudo[107647]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b6ae11b9-589d-422c-a7e8-508bd597df61 tempest-ProjectReaderTests-812849349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7c54e2b6-81f1-4d1a-82df-1b959a7bf37e.info" returned: 0 in 0.624s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:50 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-b6ae11b9-589d-422c-a7e8-508bd597df61 tempest-ProjectReaderTests-812849349 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7c54e2b6-81f1-4d1a-82df-1b959a7bf37e.info is being set with open permissions: ugo+rw
Jul 03 01:30:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b6ae11b9-589d-422c-a7e8-508bd597df61 tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7c54e2b6-81f1-4d1a-82df-1b959a7bf37e.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:50 devstack sudo[107650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7c54e2b6-81f1-4d1a-82df-1b959a7bf37e.info
Jul 03 01:30:50 devstack sudo[107650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:51 devstack sudo[107650]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:51 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b6ae11b9-589d-422c-a7e8-508bd597df61 tempest-ProjectReaderTests-812849349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7c54e2b6-81f1-4d1a-82df-1b959a7bf37e.info" returned: 0 in 0.651s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:51 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b6ae11b9-589d-422c-a7e8-508bd597df61 tempest-ProjectReaderTests-812849349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.210s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:30:51 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-b6ae11b9-589d-422c-a7e8-508bd597df61 tempest-ProjectReaderTests-812849349 None] Create snapshot completed successfully
Jul 03 01:30:52 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d41a575c-e662-4e91-8478-74bf30e42f77 tempest-ProjectReaderTests-812849349 None] Acquiring lock "cinder-7627f44c-8e09-4a3b-a5e0-eaf8c1b3d11b-delete_snapshot" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:30:52 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d41a575c-e662-4e91-8478-74bf30e42f77 tempest-ProjectReaderTests-812849349 None] Lock "cinder-7627f44c-8e09-4a3b-a5e0-eaf8c1b3d11b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:30:52 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d41a575c-e662-4e91-8478-74bf30e42f77 tempest-ProjectReaderTests-812849349 None] Acquiring lock "cinder-quobyte-7c54e2b6-81f1-4d1a-82df-1b959a7bf37e" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:30:52 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d41a575c-e662-4e91-8478-74bf30e42f77 tempest-ProjectReaderTests-812849349 None] Lock "cinder-quobyte-7c54e2b6-81f1-4d1a-82df-1b959a7bf37e" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:30:52 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d41a575c-e662-4e91-8478-74bf30e42f77 tempest-ProjectReaderTests-812849349 None] Acquiring lock "cinder-quobyte-7627f44c-8e09-4a3b-a5e0-eaf8c1b3d11b" by "_delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:30:52 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d41a575c-e662-4e91-8478-74bf30e42f77 tempest-ProjectReaderTests-812849349 None] Lock "cinder-quobyte-7627f44c-8e09-4a3b-a5e0-eaf8c1b3d11b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:30:52 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-d41a575c-e662-4e91-8478-74bf30e42f77 tempest-ProjectReaderTests-812849349 None] Deleting offline snapshot 7627f44c-8e09-4a3b-a5e0-eaf8c1b3d11b of volume 7c54e2b6-81f1-4d1a-82df-1b959a7bf37e {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 01:30:52 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-d41a575c-e662-4e91-8478-74bf30e42f77 tempest-ProjectReaderTests-812849349 None] snapshot_file for this snap is: volume-7c54e2b6-81f1-4d1a-82df-1b959a7bf37e.7627f44c-8e09-4a3b-a5e0-eaf8c1b3d11b {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 01:30:52 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b88a827-efc9-4f43-bd1b-f985ce9c27fb]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:30:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d41a575c-e662-4e91-8478-74bf30e42f77 tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7c54e2b6-81f1-4d1a-82df-1b959a7bf37e.7627f44c-8e09-4a3b-a5e0-eaf8c1b3d11b {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:52 devstack sudo[107653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7c54e2b6-81f1-4d1a-82df-1b959a7bf37e.7627f44c-8e09-4a3b-a5e0-eaf8c1b3d11b
Jul 03 01:30:52 devstack sudo[107653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:53 devstack sudo[107653]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d41a575c-e662-4e91-8478-74bf30e42f77 tempest-ProjectReaderTests-812849349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7c54e2b6-81f1-4d1a-82df-1b959a7bf37e.7627f44c-8e09-4a3b-a5e0-eaf8c1b3d11b" returned: 0 in 0.769s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:53 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-d41a575c-e662-4e91-8478-74bf30e42f77 tempest-ProjectReaderTests-812849349 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c54e2b6-81f1-4d1a-82df-1b959a7bf37e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:30:53 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b199e6-7a35-48fc-9676-9f0bcf0fce51]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:30:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d41a575c-e662-4e91-8478-74bf30e42f77 tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7c54e2b6-81f1-4d1a-82df-1b959a7bf37e {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:53 devstack sudo[107658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7c54e2b6-81f1-4d1a-82df-1b959a7bf37e
Jul 03 01:30:53 devstack sudo[107658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:53 devstack sudo[107658]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d41a575c-e662-4e91-8478-74bf30e42f77 tempest-ProjectReaderTests-812849349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7c54e2b6-81f1-4d1a-82df-1b959a7bf37e" returned: 0 in 0.740s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d41a575c-e662-4e91-8478-74bf30e42f77 tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7c54e2b6-81f1-4d1a-82df-1b959a7bf37e.7627f44c-8e09-4a3b-a5e0-eaf8c1b3d11b {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:53 devstack sudo[107663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7c54e2b6-81f1-4d1a-82df-1b959a7bf37e.7627f44c-8e09-4a3b-a5e0-eaf8c1b3d11b
Jul 03 01:30:53 devstack sudo[107663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:54 devstack sudo[107663]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:54 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d41a575c-e662-4e91-8478-74bf30e42f77 tempest-ProjectReaderTests-812849349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7c54e2b6-81f1-4d1a-82df-1b959a7bf37e.7627f44c-8e09-4a3b-a5e0-eaf8c1b3d11b" returned: 0 in 0.697s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:54 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d41a575c-e662-4e91-8478-74bf30e42f77 tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7c54e2b6-81f1-4d1a-82df-1b959a7bf37e.7627f44c-8e09-4a3b-a5e0-eaf8c1b3d11b {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:54 devstack sudo[107668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7c54e2b6-81f1-4d1a-82df-1b959a7bf37e.7627f44c-8e09-4a3b-a5e0-eaf8c1b3d11b
Jul 03 01:30:54 devstack sudo[107668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:55 devstack sudo[107668]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d41a575c-e662-4e91-8478-74bf30e42f77 tempest-ProjectReaderTests-812849349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7c54e2b6-81f1-4d1a-82df-1b959a7bf37e.7627f44c-8e09-4a3b-a5e0-eaf8c1b3d11b" returned: 0 in 0.666s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:55 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d41a575c-e662-4e91-8478-74bf30e42f77 tempest-ProjectReaderTests-812849349 None] Lock "cinder-quobyte-7627f44c-8e09-4a3b-a5e0-eaf8c1b3d11b" released by "_delete_snapshot" :: held 2.964s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:30:55 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d41a575c-e662-4e91-8478-74bf30e42f77 tempest-ProjectReaderTests-812849349 None] Lock "cinder-quobyte-7c54e2b6-81f1-4d1a-82df-1b959a7bf37e" released by "delete_snapshot" :: held 2.988s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:30:55 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-d41a575c-e662-4e91-8478-74bf30e42f77 tempest-ProjectReaderTests-812849349 None] Created reservations ['8c72dda6-7482-4952-87b4-d305c0841a5e', '53a47aea-a7b1-4d45-988d-7704c3840507', '5c689dba-71f4-44fd-90cf-97206de5733f', '543521df-2b81-44fa-9acf-aa70c01d21bc'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:30:55 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-d41a575c-e662-4e91-8478-74bf30e42f77 tempest-ProjectReaderTests-812849349 None] Delete snapshot completed successfully.
Jul 03 01:30:55 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d41a575c-e662-4e91-8478-74bf30e42f77 tempest-ProjectReaderTests-812849349 None] Lock "cinder-7627f44c-8e09-4a3b-a5e0-eaf8c1b3d11b-delete_snapshot" released by "delete_snapshot" :: held 3.114s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:30:55 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-2c0538c4-86a2-4624-9b93-5caba43f5cc9 tempest-ProjectReaderTests-812849349 None] Acquiring lock "cinder-7c54e2b6-81f1-4d1a-82df-1b959a7bf37e-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:30:55 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-2c0538c4-86a2-4624-9b93-5caba43f5cc9 tempest-ProjectReaderTests-812849349 None] Lock "cinder-7c54e2b6-81f1-4d1a-82df-1b959a7bf37e-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:30:55 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-2c0538c4-86a2-4624-9b93-5caba43f5cc9 tempest-ProjectReaderTests-812849349 None] Acquiring lock "cinder-quobyte-7c54e2b6-81f1-4d1a-82df-1b959a7bf37e" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:30:55 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-2c0538c4-86a2-4624-9b93-5caba43f5cc9 tempest-ProjectReaderTests-812849349 None] Lock "cinder-quobyte-7c54e2b6-81f1-4d1a-82df-1b959a7bf37e" acquired by "delete_volume" :: waited 0.015s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:30:55 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[5147f81e-e276-479b-b74a-c88d24333d8a]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:30:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-2c0538c4-86a2-4624-9b93-5caba43f5cc9 tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7c54e2b6-81f1-4d1a-82df-1b959a7bf37e {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:55 devstack sudo[107671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7c54e2b6-81f1-4d1a-82df-1b959a7bf37e
Jul 03 01:30:55 devstack sudo[107671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:56 devstack sudo[107671]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-2c0538c4-86a2-4624-9b93-5caba43f5cc9 tempest-ProjectReaderTests-812849349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7c54e2b6-81f1-4d1a-82df-1b959a7bf37e" returned: 0 in 0.751s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-2c0538c4-86a2-4624-9b93-5caba43f5cc9 tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7c54e2b6-81f1-4d1a-82df-1b959a7bf37e {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:56 devstack sudo[107676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7c54e2b6-81f1-4d1a-82df-1b959a7bf37e
Jul 03 01:30:56 devstack sudo[107676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:56 devstack sudo[107676]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-2c0538c4-86a2-4624-9b93-5caba43f5cc9 tempest-ProjectReaderTests-812849349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7c54e2b6-81f1-4d1a-82df-1b959a7bf37e" returned: 0 in 0.626s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:56 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-2c0538c4-86a2-4624-9b93-5caba43f5cc9 tempest-ProjectReaderTests-812849349 None] Lock "cinder-quobyte-7c54e2b6-81f1-4d1a-82df-1b959a7bf37e" released by "delete_volume" :: held 1.434s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:30:57 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-2c0538c4-86a2-4624-9b93-5caba43f5cc9 tempest-ProjectReaderTests-812849349 None] Created reservations ['2bff8905-1ad6-4918-bab6-b2412f159c72', 'df2d5fe3-8aea-47f5-9409-8cb7859feb14', '4d9c0133-2958-47e2-9f52-3238197a3ed4', 'de50e66b-6d87-44a3-a550-fe7af2c27b62'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:30:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-2c0538c4-86a2-4624-9b93-5caba43f5cc9 tempest-ProjectReaderTests-812849349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:30:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-2c0538c4-86a2-4624-9b93-5caba43f5cc9 tempest-ProjectReaderTests-812849349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:30:57 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-2c0538c4-86a2-4624-9b93-5caba43f5cc9 tempest-ProjectReaderTests-812849349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:30:57 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-2c0538c4-86a2-4624-9b93-5caba43f5cc9 tempest-ProjectReaderTests-812849349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:30:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-2c0538c4-86a2-4624-9b93-5caba43f5cc9 tempest-ProjectReaderTests-812849349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:30:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-2c0538c4-86a2-4624-9b93-5caba43f5cc9 tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:57 devstack sudo[107679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:30:57 devstack sudo[107679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:57 devstack sudo[107679]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-2c0538c4-86a2-4624-9b93-5caba43f5cc9 tempest-ProjectReaderTests-812849349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.662s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:57 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-2c0538c4-86a2-4624-9b93-5caba43f5cc9 tempest-ProjectReaderTests-812849349 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:30:57 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-2c0538c4-86a2-4624-9b93-5caba43f5cc9 tempest-ProjectReaderTests-812849349 None] Deleted volume successfully.
Jul 03 01:30:57 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-2c0538c4-86a2-4624-9b93-5caba43f5cc9 tempest-ProjectReaderTests-812849349 None] Lock "cinder-7c54e2b6-81f1-4d1a-82df-1b959a7bf37e-delete_volume" released by "delete_volume" :: held 2.289s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:30:58 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-b25f47d2-c353-4ee9-b001-afe789416f60 tempest-ProjectReaderTests-812849349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:30:58 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b25f47d2-c353-4ee9-b001-afe789416f60 tempest-ProjectReaderTests-812849349 None] Flow 'volume_create_manager' (301a3924-1c5a-4ff6-95be-bedbcaa60105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:30:58 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b25f47d2-c353-4ee9-b001-afe789416f60 tempest-ProjectReaderTests-812849349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe02275c-3051-4cb5-8b44-2ba878e9d6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:30:58 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b25f47d2-c353-4ee9-b001-afe789416f60 tempest-ProjectReaderTests-812849349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe02275c-3051-4cb5-8b44-2ba878e9d6be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:30:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1664062607',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=175b8dbb-9b90-44ca-927c-f2cb8406c1f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5434f12e1ba472a853c0eeeee49097f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:30:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:30:58Z,use_quota=True,user_id='8473987273274ccf818181429aafb11a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:30:58 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b25f47d2-c353-4ee9-b001-afe789416f60 tempest-ProjectReaderTests-812849349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1341a1c8-8ae6-46cd-8c64-375835dc38a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:30:58 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b25f47d2-c353-4ee9-b001-afe789416f60 tempest-ProjectReaderTests-812849349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1341a1c8-8ae6-46cd-8c64-375835dc38a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:30:58 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b25f47d2-c353-4ee9-b001-afe789416f60 tempest-ProjectReaderTests-812849349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1efee0c1-5250-4d88-98fa-b238c99ffab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:30:58 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b25f47d2-c353-4ee9-b001-afe789416f60 tempest-ProjectReaderTests-812849349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1efee0c1-5250-4d88-98fa-b238c99ffab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '175b8dbb-9b90-44ca-927c-f2cb8406c1f9', 'volume_name': 'volume-175b8dbb-9b90-44ca-927c-f2cb8406c1f9', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:30:58 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b25f47d2-c353-4ee9-b001-afe789416f60 tempest-ProjectReaderTests-812849349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d1aa71f-3d04-4c70-a77a-d1ed353bda0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:30:58 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b25f47d2-c353-4ee9-b001-afe789416f60 tempest-ProjectReaderTests-812849349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d1aa71f-3d04-4c70-a77a-d1ed353bda0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:30:58 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b25f47d2-c353-4ee9-b001-afe789416f60 tempest-ProjectReaderTests-812849349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (884962e6-7e0c-4053-bb27-3ac9c8a0d011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:30:58 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-b25f47d2-c353-4ee9-b001-afe789416f60 tempest-ProjectReaderTests-812849349 None] Volume 175b8dbb-9b90-44ca-927c-f2cb8406c1f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-175b8dbb-9b90-44ca-927c-f2cb8406c1f9', 'volume_size': 1}
Jul 03 01:30:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b25f47d2-c353-4ee9-b001-afe789416f60 tempest-ProjectReaderTests-812849349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:30:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b25f47d2-c353-4ee9-b001-afe789416f60 tempest-ProjectReaderTests-812849349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:30:58 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-b25f47d2-c353-4ee9-b001-afe789416f60 tempest-ProjectReaderTests-812849349 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:30:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1664062607',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=175b8dbb-9b90-44ca-927c-f2cb8406c1f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5434f12e1ba472a853c0eeeee49097f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:30:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:30:58Z,use_quota=True,user_id='8473987273274ccf818181429aafb11a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:30:58 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-b25f47d2-c353-4ee9-b001-afe789416f60 tempest-ProjectReaderTests-812849349 None] Creating volume 175b8dbb-9b90-44ca-927c-f2cb8406c1f9 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:30:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b25f47d2-c353-4ee9-b001-afe789416f60 tempest-ProjectReaderTests-812849349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:30:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b25f47d2-c353-4ee9-b001-afe789416f60 tempest-ProjectReaderTests-812849349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:30:58 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-b25f47d2-c353-4ee9-b001-afe789416f60 tempest-ProjectReaderTests-812849349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:30:58 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-b25f47d2-c353-4ee9-b001-afe789416f60 tempest-ProjectReaderTests-812849349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:30:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b25f47d2-c353-4ee9-b001-afe789416f60 tempest-ProjectReaderTests-812849349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:30:58 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-b25f47d2-c353-4ee9-b001-afe789416f60 tempest-ProjectReaderTests-812849349 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:30:58 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-b25f47d2-c353-4ee9-b001-afe789416f60 tempest-ProjectReaderTests-812849349 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:30:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b25f47d2-c353-4ee9-b001-afe789416f60 tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-175b8dbb-9b90-44ca-927c-f2cb8406c1f9 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:58 devstack sudo[107682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-175b8dbb-9b90-44ca-927c-f2cb8406c1f9 1073741824
Jul 03 01:30:58 devstack sudo[107682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:59 devstack sudo[107682]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b25f47d2-c353-4ee9-b001-afe789416f60 tempest-ProjectReaderTests-812849349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-175b8dbb-9b90-44ca-927c-f2cb8406c1f9 1073741824" returned: 0 in 0.807s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b25f47d2-c353-4ee9-b001-afe789416f60 tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-175b8dbb-9b90-44ca-927c-f2cb8406c1f9 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:30:59 devstack sudo[107688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-175b8dbb-9b90-44ca-927c-f2cb8406c1f9
Jul 03 01:30:59 devstack sudo[107688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:30:59 devstack sudo[107688]: pam_unix(sudo:session): session closed for user root
Jul 03 01:30:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b25f47d2-c353-4ee9-b001-afe789416f60 tempest-ProjectReaderTests-812849349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-175b8dbb-9b90-44ca-927c-f2cb8406c1f9" returned: 0 in 0.669s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:30:59 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-b25f47d2-c353-4ee9-b001-afe789416f60 tempest-ProjectReaderTests-812849349 None] <== create_volume: return (1517ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:30:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b25f47d2-c353-4ee9-b001-afe789416f60 tempest-ProjectReaderTests-812849349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.519s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:30:59 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b25f47d2-c353-4ee9-b001-afe789416f60 tempest-ProjectReaderTests-812849349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (884962e6-7e0c-4053-bb27-3ac9c8a0d011) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-175b8dbb-9b90-44ca-927c-f2cb8406c1f9', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:30:59 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b25f47d2-c353-4ee9-b001-afe789416f60 tempest-ProjectReaderTests-812849349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b35783b2-d06f-4b00-a5df-ca43e543e19c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:30:59 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-b25f47d2-c353-4ee9-b001-afe789416f60 tempest-ProjectReaderTests-812849349 None] Volume volume-175b8dbb-9b90-44ca-927c-f2cb8406c1f9 (175b8dbb-9b90-44ca-927c-f2cb8406c1f9): created successfully
Jul 03 01:30:59 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b25f47d2-c353-4ee9-b001-afe789416f60 tempest-ProjectReaderTests-812849349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b35783b2-d06f-4b00-a5df-ca43e543e19c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:30:59 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b25f47d2-c353-4ee9-b001-afe789416f60 tempest-ProjectReaderTests-812849349 None] Flow 'volume_create_manager' (301a3924-1c5a-4ff6-95be-bedbcaa60105) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:30:59 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-b25f47d2-c353-4ee9-b001-afe789416f60 tempest-ProjectReaderTests-812849349 None] Created volume successfully.
Jul 03 01:31:00 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-c50a6111-c6aa-448c-8e30-05121faf4786 tempest-ProjectReaderTests-812849349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:31:00 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-c50a6111-c6aa-448c-8e30-05121faf4786 tempest-ProjectReaderTests-812849349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:31:00 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-c50a6111-c6aa-448c-8e30-05121faf4786 tempest-ProjectReaderTests-812849349 None] Creating offline snapshot 604d2131-1382-4267-b30f-c77ec0de90e3 of volume 175b8dbb-9b90-44ca-927c-f2cb8406c1f9 {{(pid=86891) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 01:31:00 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a3b348-7c94-43f3-9306-ab21c39f544d]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:31:00 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c50a6111-c6aa-448c-8e30-05121faf4786 tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-175b8dbb-9b90-44ca-927c-f2cb8406c1f9 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:31:00 devstack sudo[107691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-175b8dbb-9b90-44ca-927c-f2cb8406c1f9
Jul 03 01:31:00 devstack sudo[107691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:31:01 devstack sudo[107691]: pam_unix(sudo:session): session closed for user root
Jul 03 01:31:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c50a6111-c6aa-448c-8e30-05121faf4786 tempest-ProjectReaderTests-812849349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-175b8dbb-9b90-44ca-927c-f2cb8406c1f9" returned: 0 in 0.754s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:31:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c50a6111-c6aa-448c-8e30-05121faf4786 tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-175b8dbb-9b90-44ca-927c-f2cb8406c1f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-175b8dbb-9b90-44ca-927c-f2cb8406c1f9.604d2131-1382-4267-b30f-c77ec0de90e3 1G {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:31:01 devstack sudo[107696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-175b8dbb-9b90-44ca-927c-f2cb8406c1f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-175b8dbb-9b90-44ca-927c-f2cb8406c1f9.604d2131-1382-4267-b30f-c77ec0de90e3 1G
Jul 03 01:31:01 devstack sudo[107696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:31:01 devstack sudo[107696]: pam_unix(sudo:session): session closed for user root
Jul 03 01:31:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c50a6111-c6aa-448c-8e30-05121faf4786 tempest-ProjectReaderTests-812849349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-175b8dbb-9b90-44ca-927c-f2cb8406c1f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-175b8dbb-9b90-44ca-927c-f2cb8406c1f9.604d2131-1382-4267-b30f-c77ec0de90e3 1G" returned: 0 in 0.794s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:31:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c50a6111-c6aa-448c-8e30-05121faf4786 tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-175b8dbb-9b90-44ca-927c-f2cb8406c1f9 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-175b8dbb-9b90-44ca-927c-f2cb8406c1f9.604d2131-1382-4267-b30f-c77ec0de90e3 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:31:01 devstack sudo[107701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-175b8dbb-9b90-44ca-927c-f2cb8406c1f9 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-175b8dbb-9b90-44ca-927c-f2cb8406c1f9.604d2131-1382-4267-b30f-c77ec0de90e3
Jul 03 01:31:01 devstack sudo[107701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:31:01 devstack cinder-volume[86891]: DEBUG oslo_service.periodic_task [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86891) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 01:31:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:31:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:31:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:31:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:31:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:31:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:31:01 devstack sudo[107703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:31:01 devstack sudo[107703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:31:02 devstack sudo[107703]: pam_unix(sudo:session): session closed for user root
Jul 03 01:31:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.685s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:31:02 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:31:02 devstack cinder-volume[86891]: DEBUG oslo_service.periodic_task [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running periodic task VolumeManager._thread_info {{(pid=86891) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 01:31:02 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] thread count: 28 {{(pid=86891) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 01:31:02 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] thread info: [<_MainThread(MainThread, started 136731296534656)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136731184953280)>, <Thread(Thread-3 (stat_writer), started daemon 136731184058816)>, <Thread(Rabbit-heartbeat, started daemon 136731184846080)>, <Thread(Thread-5 (_runner), started daemon 136731182936576)>, <Thread(Thread-7 (_runner), started daemon 136731182954944)>, <Thread(fd_logger, started daemon 136731181916416)>, <Thread(privsep_reader, started daemon 136731180942208)>, <Thread(tpool_thread_0, started daemon 136731172161216)>, <Thread(tpool_thread_1, started daemon 136731163768512)>, <Thread(tpool_thread_2, started daemon 136731155375808)>, <Thread(tpool_thread_3, started daemon 136731146983104)>, <Thread(tpool_thread_4, started daemon 136731138590400)>, <Thread(tpool_thread_5, started daemon 136731130197696)>, <Thread(tpool_thread_6, started daemon 136731121804992)>, <Thread(tpool_thread_7, started daemon 136731113412288)>, <Thread(tpool_thread_8, started daemon 136731105003200)>, <Thread(tpool_thread_9, started daemon 136731096594112)>, <Thread(tpool_thread_10, started daemon 136731088185024)>, <Thread(tpool_thread_11, started daemon 136731079775936)>, <Thread(tpool_thread_12, started daemon 136731071366848)>, <Thread(tpool_thread_13, started daemon 136731062957760)>, <Thread(tpool_thread_14, started daemon 136731054548672)>, <Thread(tpool_thread_15, started daemon 136731046139584)>, <Thread(tpool_thread_16, started daemon 136731037730496)>, <Thread(tpool_thread_17, started daemon 136731029321408)>, <Thread(tpool_thread_18, started daemon 136731020912320)>, <Thread(tpool_thread_19, started daemon 136731012503232)>] {{(pid=86891) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 01:31:02 devstack sudo[107701]: pam_unix(sudo:session): session closed for user root
Jul 03 01:31:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c50a6111-c6aa-448c-8e30-05121faf4786 tempest-ProjectReaderTests-812849349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-175b8dbb-9b90-44ca-927c-f2cb8406c1f9 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-175b8dbb-9b90-44ca-927c-f2cb8406c1f9.604d2131-1382-4267-b30f-c77ec0de90e3" returned: 0 in 0.742s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:31:02 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-c50a6111-c6aa-448c-8e30-05121faf4786 tempest-ProjectReaderTests-812849349 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-175b8dbb-9b90-44ca-927c-f2cb8406c1f9.604d2131-1382-4267-b30f-c77ec0de90e3 is being set with open permissions: ugo+rw
Jul 03 01:31:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c50a6111-c6aa-448c-8e30-05121faf4786 tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-175b8dbb-9b90-44ca-927c-f2cb8406c1f9.604d2131-1382-4267-b30f-c77ec0de90e3 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:31:02 devstack sudo[107709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-175b8dbb-9b90-44ca-927c-f2cb8406c1f9.604d2131-1382-4267-b30f-c77ec0de90e3
Jul 03 01:31:02 devstack sudo[107709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:31:03 devstack sudo[107709]: pam_unix(sudo:session): session closed for user root
Jul 03 01:31:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c50a6111-c6aa-448c-8e30-05121faf4786 tempest-ProjectReaderTests-812849349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-175b8dbb-9b90-44ca-927c-f2cb8406c1f9.604d2131-1382-4267-b30f-c77ec0de90e3" returned: 0 in 0.647s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:31:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c50a6111-c6aa-448c-8e30-05121faf4786 tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-175b8dbb-9b90-44ca-927c-f2cb8406c1f9.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:31:03 devstack sudo[107712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-175b8dbb-9b90-44ca-927c-f2cb8406c1f9.info
Jul 03 01:31:03 devstack sudo[107712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:31:03 devstack sudo[107712]: pam_unix(sudo:session): session closed for user root
Jul 03 01:31:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c50a6111-c6aa-448c-8e30-05121faf4786 tempest-ProjectReaderTests-812849349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-175b8dbb-9b90-44ca-927c-f2cb8406c1f9.info" returned: 0 in 0.650s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:31:03 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-c50a6111-c6aa-448c-8e30-05121faf4786 tempest-ProjectReaderTests-812849349 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-175b8dbb-9b90-44ca-927c-f2cb8406c1f9.info is being set with open permissions: ugo+rw
Jul 03 01:31:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c50a6111-c6aa-448c-8e30-05121faf4786 tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-175b8dbb-9b90-44ca-927c-f2cb8406c1f9.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:31:04 devstack sudo[107715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-175b8dbb-9b90-44ca-927c-f2cb8406c1f9.info
Jul 03 01:31:04 devstack sudo[107715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:31:04 devstack sudo[107715]: pam_unix(sudo:session): session closed for user root
Jul 03 01:31:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c50a6111-c6aa-448c-8e30-05121faf4786 tempest-ProjectReaderTests-812849349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-175b8dbb-9b90-44ca-927c-f2cb8406c1f9.info" returned: 0 in 0.672s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:31:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-c50a6111-c6aa-448c-8e30-05121faf4786 tempest-ProjectReaderTests-812849349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.342s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:31:04 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-c50a6111-c6aa-448c-8e30-05121faf4786 tempest-ProjectReaderTests-812849349 None] Create snapshot completed successfully
Jul 03 01:31:05 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-b8835d77-778c-47dc-96be-e917ef2f0639 tempest-ProjectReaderTests-812849349 None] Acquiring lock "cinder-604d2131-1382-4267-b30f-c77ec0de90e3-delete_snapshot" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:31:05 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-b8835d77-778c-47dc-96be-e917ef2f0639 tempest-ProjectReaderTests-812849349 None] Lock "cinder-604d2131-1382-4267-b30f-c77ec0de90e3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:31:05 devstack cinder-volume[86891]: INFO cinder.message.api [None req-b8835d77-778c-47dc-96be-e917ef2f0639 tempest-ProjectReaderTests-812849349 None] Creating message record for request_id = req-b8835d77-778c-47dc-96be-e917ef2f0639
Jul 03 01:31:05 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-b8835d77-778c-47dc-96be-e917ef2f0639 tempest-ProjectReaderTests-812849349 None] Lock "cinder-604d2131-1382-4267-b30f-c77ec0de90e3-delete_snapshot" released by "delete_snapshot" :: held 0.031s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:31:05 devstack cinder-volume[86891]: ERROR oslo_messaging.rpc.server [None req-b8835d77-778c-47dc-96be-e917ef2f0639 tempest-ProjectReaderTests-812849349 None] Exception during message handling: AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'?
Jul 03 01:31:05 devstack cinder-volume[86891]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Jul 03 01:31:05 devstack cinder-volume[86891]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming
Jul 03 01:31:05 devstack cinder-volume[86891]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Jul 03 01:31:05 devstack cinder-volume[86891]: ERROR oslo_messaging.rpc.server           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jul 03 01:31:05 devstack cinder-volume[86891]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Jul 03 01:31:05 devstack cinder-volume[86891]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Jul 03 01:31:05 devstack cinder-volume[86891]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jul 03 01:31:05 devstack cinder-volume[86891]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Jul 03 01:31:05 devstack cinder-volume[86891]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Jul 03 01:31:05 devstack cinder-volume[86891]: ERROR oslo_messaging.rpc.server              ^^^^^^^^^^^^^^^^^^^^^^
Jul 03 01:31:05 devstack cinder-volume[86891]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 220, in wrapper
Jul 03 01:31:05 devstack cinder-volume[86891]: ERROR oslo_messaging.rpc.server     skip_clean = func(self, context, snapshot, *args, **kwargs)
Jul 03 01:31:05 devstack cinder-volume[86891]: ERROR oslo_messaging.rpc.server                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jul 03 01:31:05 devstack cinder-volume[86891]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/decorator/__init__.py", line 247, in fun
Jul 03 01:31:05 devstack cinder-volume[86891]: ERROR oslo_messaging.rpc.server     return caller(func, *(extras + args), **kw)
Jul 03 01:31:05 devstack cinder-volume[86891]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jul 03 01:31:05 devstack cinder-volume[86891]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/coordination.py", line 234, in _synchronized
Jul 03 01:31:05 devstack cinder-volume[86891]: ERROR oslo_messaging.rpc.server     return f(*a, **k)
Jul 03 01:31:05 devstack cinder-volume[86891]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^
Jul 03 01:31:05 devstack cinder-volume[86891]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 1351, in delete_snapshot
Jul 03 01:31:05 devstack cinder-volume[86891]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Jul 03 01:31:05 devstack cinder-volume[86891]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__
Jul 03 01:31:05 devstack cinder-volume[86891]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Jul 03 01:31:05 devstack cinder-volume[86891]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise
Jul 03 01:31:05 devstack cinder-volume[86891]: ERROR oslo_messaging.rpc.server     raise self.value
Jul 03 01:31:05 devstack cinder-volume[86891]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 1335, in delete_snapshot
Jul 03 01:31:05 devstack cinder-volume[86891]: ERROR oslo_messaging.rpc.server     self.driver.unmanage_snapshot(snapshot)
Jul 03 01:31:05 devstack cinder-volume[86891]: ERROR oslo_messaging.rpc.server     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jul 03 01:31:05 devstack cinder-volume[86891]: ERROR oslo_messaging.rpc.server AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'?
Jul 03 01:31:05 devstack cinder-volume[86891]: ERROR oslo_messaging.rpc.server 
Jul 03 01:31:15 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:DELETE=3,cinder:SELECT=33,cinder:INSERT=10,cinder:UPDATE=39 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:31:15 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:SELECT=24,cinder:INSERT=11,cinder:UPDATE=35,cinder:DELETE=4 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:32:01 devstack cinder-volume[86891]: DEBUG oslo_service.periodic_task [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86891) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 01:32:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:32:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:32:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:32:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:32:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:32:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:32:01 devstack sudo[107771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:32:01 devstack sudo[107771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:32:02 devstack sudo[107771]: pam_unix(sudo:session): session closed for user root
Jul 03 01:32:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.716s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:32:02 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:32:02 devstack cinder-volume[86891]: DEBUG oslo_service.periodic_task [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running periodic task VolumeManager._thread_info {{(pid=86891) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 01:32:02 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] thread count: 28 {{(pid=86891) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 01:32:02 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] thread info: [<_MainThread(MainThread, started 136731296534656)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136731184953280)>, <Thread(Thread-3 (stat_writer), started daemon 136731184058816)>, <Thread(Rabbit-heartbeat, started daemon 136731184846080)>, <Thread(Thread-5 (_runner), started daemon 136731182936576)>, <Thread(Thread-7 (_runner), started daemon 136731182954944)>, <Thread(fd_logger, started daemon 136731181916416)>, <Thread(privsep_reader, started daemon 136731180942208)>, <Thread(tpool_thread_0, started daemon 136731172161216)>, <Thread(tpool_thread_1, started daemon 136731163768512)>, <Thread(tpool_thread_2, started daemon 136731155375808)>, <Thread(tpool_thread_3, started daemon 136731146983104)>, <Thread(tpool_thread_4, started daemon 136731138590400)>, <Thread(tpool_thread_5, started daemon 136731130197696)>, <Thread(tpool_thread_6, started daemon 136731121804992)>, <Thread(tpool_thread_7, started daemon 136731113412288)>, <Thread(tpool_thread_8, started daemon 136731105003200)>, <Thread(tpool_thread_9, started daemon 136731096594112)>, <Thread(tpool_thread_10, started daemon 136731088185024)>, <Thread(tpool_thread_11, started daemon 136731079775936)>, <Thread(tpool_thread_12, started daemon 136731071366848)>, <Thread(tpool_thread_13, started daemon 136731062957760)>, <Thread(tpool_thread_14, started daemon 136731054548672)>, <Thread(tpool_thread_15, started daemon 136731046139584)>, <Thread(tpool_thread_16, started daemon 136731037730496)>, <Thread(tpool_thread_17, started daemon 136731029321408)>, <Thread(tpool_thread_18, started daemon 136731020912320)>, <Thread(tpool_thread_19, started daemon 136731012503232)>] {{(pid=86891) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 01:33:01 devstack cinder-volume[86891]: DEBUG oslo_service.periodic_task [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86891) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 01:33:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:33:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:33:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:33:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:33:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:33:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:33:01 devstack sudo[107826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:33:01 devstack sudo[107826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:33:02 devstack sudo[107826]: pam_unix(sudo:session): session closed for user root
Jul 03 01:33:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.662s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:33:02 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:33:02 devstack cinder-volume[86891]: DEBUG oslo_service.periodic_task [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running periodic task VolumeManager._thread_info {{(pid=86891) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 01:33:02 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] thread count: 28 {{(pid=86891) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 01:33:02 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] thread info: [<_MainThread(MainThread, started 136731296534656)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136731184953280)>, <Thread(Thread-3 (stat_writer), started daemon 136731184058816)>, <Thread(Rabbit-heartbeat, started daemon 136731184846080)>, <Thread(Thread-5 (_runner), started daemon 136731182936576)>, <Thread(Thread-7 (_runner), started daemon 136731182954944)>, <Thread(fd_logger, started daemon 136731181916416)>, <Thread(privsep_reader, started daemon 136731180942208)>, <Thread(tpool_thread_0, started daemon 136731172161216)>, <Thread(tpool_thread_1, started daemon 136731163768512)>, <Thread(tpool_thread_2, started daemon 136731155375808)>, <Thread(tpool_thread_3, started daemon 136731146983104)>, <Thread(tpool_thread_4, started daemon 136731138590400)>, <Thread(tpool_thread_5, started daemon 136731130197696)>, <Thread(tpool_thread_6, started daemon 136731121804992)>, <Thread(tpool_thread_7, started daemon 136731113412288)>, <Thread(tpool_thread_8, started daemon 136731105003200)>, <Thread(tpool_thread_9, started daemon 136731096594112)>, <Thread(tpool_thread_10, started daemon 136731088185024)>, <Thread(tpool_thread_11, started daemon 136731079775936)>, <Thread(tpool_thread_12, started daemon 136731071366848)>, <Thread(tpool_thread_13, started daemon 136731062957760)>, <Thread(tpool_thread_14, started daemon 136731054548672)>, <Thread(tpool_thread_15, started daemon 136731046139584)>, <Thread(tpool_thread_16, started daemon 136731037730496)>, <Thread(tpool_thread_17, started daemon 136731029321408)>, <Thread(tpool_thread_18, started daemon 136731020912320)>, <Thread(tpool_thread_19, started daemon 136731012503232)>] {{(pid=86891) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 01:33:08 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:33:37 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-95e52387-686c-41c5-917d-54eaacb24fce tempest-ProjectMemberTests-1866302072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:33:37 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-95e52387-686c-41c5-917d-54eaacb24fce tempest-ProjectMemberTests-1866302072 None] Flow 'volume_create_manager' (984729fa-a359-4571-92da-9fbcfd616034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:33:37 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-95e52387-686c-41c5-917d-54eaacb24fce tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21164a93-c4a5-4afa-b249-a6aafac574f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:33:37 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-95e52387-686c-41c5-917d-54eaacb24fce tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21164a93-c4a5-4afa-b249-a6aafac574f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:33:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-349671254',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54dda17f-5631-42d5-b466-fbbf89762b76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16429f2745354b0591f4044f3a99b9fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:33:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:33:37Z,use_quota=True,user_id='31dd51f2dcdd4724a4c6b78cb80e6d8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:33:37 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-95e52387-686c-41c5-917d-54eaacb24fce tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0a52e3d-e852-4c29-9651-75292e50ea2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:33:37 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-95e52387-686c-41c5-917d-54eaacb24fce tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0a52e3d-e852-4c29-9651-75292e50ea2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:33:37 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-95e52387-686c-41c5-917d-54eaacb24fce tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8e35f05-a60e-4971-a47f-92c95b91bffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:33:37 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-95e52387-686c-41c5-917d-54eaacb24fce tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8e35f05-a60e-4971-a47f-92c95b91bffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54dda17f-5631-42d5-b466-fbbf89762b76', 'volume_name': 'volume-54dda17f-5631-42d5-b466-fbbf89762b76', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:33:37 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-95e52387-686c-41c5-917d-54eaacb24fce tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6da1dbfe-8e9c-4782-806b-d96f6f527adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:33:37 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-95e52387-686c-41c5-917d-54eaacb24fce tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6da1dbfe-8e9c-4782-806b-d96f6f527adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:33:37 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-95e52387-686c-41c5-917d-54eaacb24fce tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dab7d09d-19ab-4f94-80c9-aa6c845d7bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:33:37 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-95e52387-686c-41c5-917d-54eaacb24fce tempest-ProjectMemberTests-1866302072 None] Volume 54dda17f-5631-42d5-b466-fbbf89762b76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54dda17f-5631-42d5-b466-fbbf89762b76', 'volume_size': 1}
Jul 03 01:33:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-95e52387-686c-41c5-917d-54eaacb24fce tempest-ProjectMemberTests-1866302072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:33:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-95e52387-686c-41c5-917d-54eaacb24fce tempest-ProjectMemberTests-1866302072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:33:37 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-95e52387-686c-41c5-917d-54eaacb24fce tempest-ProjectMemberTests-1866302072 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:33:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-349671254',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54dda17f-5631-42d5-b466-fbbf89762b76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16429f2745354b0591f4044f3a99b9fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:33:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:33:37Z,use_quota=True,user_id='31dd51f2dcdd4724a4c6b78cb80e6d8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:33:37 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-95e52387-686c-41c5-917d-54eaacb24fce tempest-ProjectMemberTests-1866302072 None] Creating volume 54dda17f-5631-42d5-b466-fbbf89762b76 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:33:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-95e52387-686c-41c5-917d-54eaacb24fce tempest-ProjectMemberTests-1866302072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:33:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-95e52387-686c-41c5-917d-54eaacb24fce tempest-ProjectMemberTests-1866302072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:33:37 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-95e52387-686c-41c5-917d-54eaacb24fce tempest-ProjectMemberTests-1866302072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:33:37 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-95e52387-686c-41c5-917d-54eaacb24fce tempest-ProjectMemberTests-1866302072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:33:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-95e52387-686c-41c5-917d-54eaacb24fce tempest-ProjectMemberTests-1866302072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:33:37 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-95e52387-686c-41c5-917d-54eaacb24fce tempest-ProjectMemberTests-1866302072 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:33:37 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-95e52387-686c-41c5-917d-54eaacb24fce tempest-ProjectMemberTests-1866302072 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:33:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-95e52387-686c-41c5-917d-54eaacb24fce tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-54dda17f-5631-42d5-b466-fbbf89762b76 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:33:37 devstack sudo[107872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-54dda17f-5631-42d5-b466-fbbf89762b76 1073741824
Jul 03 01:33:37 devstack sudo[107872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:33:38 devstack sudo[107872]: pam_unix(sudo:session): session closed for user root
Jul 03 01:33:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-95e52387-686c-41c5-917d-54eaacb24fce tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-54dda17f-5631-42d5-b466-fbbf89762b76 1073741824" returned: 0 in 0.819s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:33:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-95e52387-686c-41c5-917d-54eaacb24fce tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-54dda17f-5631-42d5-b466-fbbf89762b76 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:33:38 devstack sudo[107878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-54dda17f-5631-42d5-b466-fbbf89762b76
Jul 03 01:33:38 devstack sudo[107878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:33:38 devstack sudo[107878]: pam_unix(sudo:session): session closed for user root
Jul 03 01:33:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-95e52387-686c-41c5-917d-54eaacb24fce tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-54dda17f-5631-42d5-b466-fbbf89762b76" returned: 0 in 0.613s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:33:38 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-95e52387-686c-41c5-917d-54eaacb24fce tempest-ProjectMemberTests-1866302072 None] <== create_volume: return (1475ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:33:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-95e52387-686c-41c5-917d-54eaacb24fce tempest-ProjectMemberTests-1866302072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.478s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:33:38 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-95e52387-686c-41c5-917d-54eaacb24fce tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dab7d09d-19ab-4f94-80c9-aa6c845d7bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54dda17f-5631-42d5-b466-fbbf89762b76', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:33:38 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-95e52387-686c-41c5-917d-54eaacb24fce tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea2a7c85-5777-4242-bb14-ca5f03eb8435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:33:38 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-95e52387-686c-41c5-917d-54eaacb24fce tempest-ProjectMemberTests-1866302072 None] Volume volume-54dda17f-5631-42d5-b466-fbbf89762b76 (54dda17f-5631-42d5-b466-fbbf89762b76): created successfully
Jul 03 01:33:38 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-95e52387-686c-41c5-917d-54eaacb24fce tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea2a7c85-5777-4242-bb14-ca5f03eb8435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:33:38 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-95e52387-686c-41c5-917d-54eaacb24fce tempest-ProjectMemberTests-1866302072 None] Flow 'volume_create_manager' (984729fa-a359-4571-92da-9fbcfd616034) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:33:38 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-95e52387-686c-41c5-917d-54eaacb24fce tempest-ProjectMemberTests-1866302072 None] Created volume successfully.
Jul 03 01:33:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b822afd9-0102-4dd3-8293-e49b3cda3a76 tempest-ProjectMemberTests-1866302072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:33:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b822afd9-0102-4dd3-8293-e49b3cda3a76 tempest-ProjectMemberTests-1866302072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:33:39 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-b822afd9-0102-4dd3-8293-e49b3cda3a76 tempest-ProjectMemberTests-1866302072 None] Creating offline snapshot 42d11c60-5095-41cd-90b9-df9a14c5a27b of volume 54dda17f-5631-42d5-b466-fbbf89762b76 {{(pid=86891) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 01:33:39 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[16dd4746-f029-4966-b5dc-e747af6ceea6]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:33:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b822afd9-0102-4dd3-8293-e49b3cda3a76 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-54dda17f-5631-42d5-b466-fbbf89762b76 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:33:39 devstack sudo[107882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-54dda17f-5631-42d5-b466-fbbf89762b76
Jul 03 01:33:39 devstack sudo[107882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:33:40 devstack sudo[107882]: pam_unix(sudo:session): session closed for user root
Jul 03 01:33:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b822afd9-0102-4dd3-8293-e49b3cda3a76 tempest-ProjectMemberTests-1866302072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-54dda17f-5631-42d5-b466-fbbf89762b76" returned: 0 in 0.747s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:33:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b822afd9-0102-4dd3-8293-e49b3cda3a76 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-54dda17f-5631-42d5-b466-fbbf89762b76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-54dda17f-5631-42d5-b466-fbbf89762b76.42d11c60-5095-41cd-90b9-df9a14c5a27b 1G {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:33:40 devstack sudo[107887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-54dda17f-5631-42d5-b466-fbbf89762b76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-54dda17f-5631-42d5-b466-fbbf89762b76.42d11c60-5095-41cd-90b9-df9a14c5a27b 1G
Jul 03 01:33:40 devstack sudo[107887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:33:41 devstack sudo[107887]: pam_unix(sudo:session): session closed for user root
Jul 03 01:33:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b822afd9-0102-4dd3-8293-e49b3cda3a76 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-54dda17f-5631-42d5-b466-fbbf89762b76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-54dda17f-5631-42d5-b466-fbbf89762b76.42d11c60-5095-41cd-90b9-df9a14c5a27b 1G" returned: 0 in 0.767s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:33:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b822afd9-0102-4dd3-8293-e49b3cda3a76 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54dda17f-5631-42d5-b466-fbbf89762b76 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-54dda17f-5631-42d5-b466-fbbf89762b76.42d11c60-5095-41cd-90b9-df9a14c5a27b {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:33:41 devstack sudo[107892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54dda17f-5631-42d5-b466-fbbf89762b76 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-54dda17f-5631-42d5-b466-fbbf89762b76.42d11c60-5095-41cd-90b9-df9a14c5a27b
Jul 03 01:33:41 devstack sudo[107892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:33:41 devstack sudo[107892]: pam_unix(sudo:session): session closed for user root
Jul 03 01:33:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b822afd9-0102-4dd3-8293-e49b3cda3a76 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54dda17f-5631-42d5-b466-fbbf89762b76 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-54dda17f-5631-42d5-b466-fbbf89762b76.42d11c60-5095-41cd-90b9-df9a14c5a27b" returned: 0 in 0.662s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:33:41 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-b822afd9-0102-4dd3-8293-e49b3cda3a76 tempest-ProjectMemberTests-1866302072 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-54dda17f-5631-42d5-b466-fbbf89762b76.42d11c60-5095-41cd-90b9-df9a14c5a27b is being set with open permissions: ugo+rw
Jul 03 01:33:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b822afd9-0102-4dd3-8293-e49b3cda3a76 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-54dda17f-5631-42d5-b466-fbbf89762b76.42d11c60-5095-41cd-90b9-df9a14c5a27b {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:33:41 devstack sudo[107903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-54dda17f-5631-42d5-b466-fbbf89762b76.42d11c60-5095-41cd-90b9-df9a14c5a27b
Jul 03 01:33:41 devstack sudo[107903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:33:42 devstack sudo[107903]: pam_unix(sudo:session): session closed for user root
Jul 03 01:33:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b822afd9-0102-4dd3-8293-e49b3cda3a76 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-54dda17f-5631-42d5-b466-fbbf89762b76.42d11c60-5095-41cd-90b9-df9a14c5a27b" returned: 0 in 0.619s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:33:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b822afd9-0102-4dd3-8293-e49b3cda3a76 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-54dda17f-5631-42d5-b466-fbbf89762b76.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:33:42 devstack sudo[107906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-54dda17f-5631-42d5-b466-fbbf89762b76.info
Jul 03 01:33:42 devstack sudo[107906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:33:43 devstack sudo[107906]: pam_unix(sudo:session): session closed for user root
Jul 03 01:33:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b822afd9-0102-4dd3-8293-e49b3cda3a76 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-54dda17f-5631-42d5-b466-fbbf89762b76.info" returned: 0 in 0.640s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:33:43 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-b822afd9-0102-4dd3-8293-e49b3cda3a76 tempest-ProjectMemberTests-1866302072 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-54dda17f-5631-42d5-b466-fbbf89762b76.info is being set with open permissions: ugo+rw
Jul 03 01:33:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b822afd9-0102-4dd3-8293-e49b3cda3a76 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-54dda17f-5631-42d5-b466-fbbf89762b76.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:33:43 devstack sudo[107909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-54dda17f-5631-42d5-b466-fbbf89762b76.info
Jul 03 01:33:43 devstack sudo[107909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:33:43 devstack sudo[107909]: pam_unix(sudo:session): session closed for user root
Jul 03 01:33:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b822afd9-0102-4dd3-8293-e49b3cda3a76 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-54dda17f-5631-42d5-b466-fbbf89762b76.info" returned: 0 in 0.621s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:33:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b822afd9-0102-4dd3-8293-e49b3cda3a76 tempest-ProjectMemberTests-1866302072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.130s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:33:43 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-b822afd9-0102-4dd3-8293-e49b3cda3a76 tempest-ProjectMemberTests-1866302072 None] Create snapshot completed successfully
Jul 03 01:33:44 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-614fdf4f-2181-49ea-b8e3-9177dfcf8bbe tempest-ProjectMemberTests-1866302072 None] Acquiring lock "cinder-42d11c60-5095-41cd-90b9-df9a14c5a27b-delete_snapshot" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:33:44 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-614fdf4f-2181-49ea-b8e3-9177dfcf8bbe tempest-ProjectMemberTests-1866302072 None] Lock "cinder-42d11c60-5095-41cd-90b9-df9a14c5a27b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:33:44 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-614fdf4f-2181-49ea-b8e3-9177dfcf8bbe tempest-ProjectMemberTests-1866302072 None] Acquiring lock "cinder-quobyte-54dda17f-5631-42d5-b466-fbbf89762b76" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:33:44 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-614fdf4f-2181-49ea-b8e3-9177dfcf8bbe tempest-ProjectMemberTests-1866302072 None] Lock "cinder-quobyte-54dda17f-5631-42d5-b466-fbbf89762b76" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:33:44 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-614fdf4f-2181-49ea-b8e3-9177dfcf8bbe tempest-ProjectMemberTests-1866302072 None] Acquiring lock "cinder-quobyte-42d11c60-5095-41cd-90b9-df9a14c5a27b" by "_delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:33:45 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-614fdf4f-2181-49ea-b8e3-9177dfcf8bbe tempest-ProjectMemberTests-1866302072 None] Lock "cinder-quobyte-42d11c60-5095-41cd-90b9-df9a14c5a27b" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:33:45 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-614fdf4f-2181-49ea-b8e3-9177dfcf8bbe tempest-ProjectMemberTests-1866302072 None] Deleting offline snapshot 42d11c60-5095-41cd-90b9-df9a14c5a27b of volume 54dda17f-5631-42d5-b466-fbbf89762b76 {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 01:33:45 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-614fdf4f-2181-49ea-b8e3-9177dfcf8bbe tempest-ProjectMemberTests-1866302072 None] snapshot_file for this snap is: volume-54dda17f-5631-42d5-b466-fbbf89762b76.42d11c60-5095-41cd-90b9-df9a14c5a27b {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 01:33:45 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8771cc-0b48-4de1-b43f-41ec905bbce0]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:33:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-614fdf4f-2181-49ea-b8e3-9177dfcf8bbe tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-54dda17f-5631-42d5-b466-fbbf89762b76.42d11c60-5095-41cd-90b9-df9a14c5a27b {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:33:45 devstack sudo[107912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-54dda17f-5631-42d5-b466-fbbf89762b76.42d11c60-5095-41cd-90b9-df9a14c5a27b
Jul 03 01:33:45 devstack sudo[107912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:33:45 devstack sudo[107912]: pam_unix(sudo:session): session closed for user root
Jul 03 01:33:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-614fdf4f-2181-49ea-b8e3-9177dfcf8bbe tempest-ProjectMemberTests-1866302072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-54dda17f-5631-42d5-b466-fbbf89762b76.42d11c60-5095-41cd-90b9-df9a14c5a27b" returned: 0 in 0.730s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:33:45 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-614fdf4f-2181-49ea-b8e3-9177dfcf8bbe tempest-ProjectMemberTests-1866302072 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-54dda17f-5631-42d5-b466-fbbf89762b76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:33:45 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[74bf148f-a094-4095-82d8-70f335f33996]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:33:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-614fdf4f-2181-49ea-b8e3-9177dfcf8bbe tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-54dda17f-5631-42d5-b466-fbbf89762b76 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:33:45 devstack sudo[107917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-54dda17f-5631-42d5-b466-fbbf89762b76
Jul 03 01:33:45 devstack sudo[107917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:33:46 devstack sudo[107917]: pam_unix(sudo:session): session closed for user root
Jul 03 01:33:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-614fdf4f-2181-49ea-b8e3-9177dfcf8bbe tempest-ProjectMemberTests-1866302072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-54dda17f-5631-42d5-b466-fbbf89762b76" returned: 0 in 0.726s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:33:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-614fdf4f-2181-49ea-b8e3-9177dfcf8bbe tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-54dda17f-5631-42d5-b466-fbbf89762b76.42d11c60-5095-41cd-90b9-df9a14c5a27b {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:33:46 devstack sudo[107922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-54dda17f-5631-42d5-b466-fbbf89762b76.42d11c60-5095-41cd-90b9-df9a14c5a27b
Jul 03 01:33:46 devstack sudo[107922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:33:47 devstack sudo[107922]: pam_unix(sudo:session): session closed for user root
Jul 03 01:33:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-614fdf4f-2181-49ea-b8e3-9177dfcf8bbe tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-54dda17f-5631-42d5-b466-fbbf89762b76.42d11c60-5095-41cd-90b9-df9a14c5a27b" returned: 0 in 0.706s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:33:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-614fdf4f-2181-49ea-b8e3-9177dfcf8bbe tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-54dda17f-5631-42d5-b466-fbbf89762b76.42d11c60-5095-41cd-90b9-df9a14c5a27b {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:33:47 devstack sudo[107927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-54dda17f-5631-42d5-b466-fbbf89762b76.42d11c60-5095-41cd-90b9-df9a14c5a27b
Jul 03 01:33:47 devstack sudo[107927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:33:47 devstack sudo[107927]: pam_unix(sudo:session): session closed for user root
Jul 03 01:33:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-614fdf4f-2181-49ea-b8e3-9177dfcf8bbe tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-54dda17f-5631-42d5-b466-fbbf89762b76.42d11c60-5095-41cd-90b9-df9a14c5a27b" returned: 0 in 0.621s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:33:47 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-614fdf4f-2181-49ea-b8e3-9177dfcf8bbe tempest-ProjectMemberTests-1866302072 None] Lock "cinder-quobyte-42d11c60-5095-41cd-90b9-df9a14c5a27b" released by "_delete_snapshot" :: held 2.871s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:33:47 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-614fdf4f-2181-49ea-b8e3-9177dfcf8bbe tempest-ProjectMemberTests-1866302072 None] Lock "cinder-quobyte-54dda17f-5631-42d5-b466-fbbf89762b76" released by "delete_snapshot" :: held 2.891s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:33:47 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-614fdf4f-2181-49ea-b8e3-9177dfcf8bbe tempest-ProjectMemberTests-1866302072 None] Created reservations ['3b0761e8-2c11-41cd-9231-68044d7b9277', 'ad05e920-689a-4fac-a7ea-25e463905770', '9276cfe8-8990-4fb3-9562-841e81d62e18', '49e84903-897f-4fbb-a9d7-ea2029fc1e64'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:33:47 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-614fdf4f-2181-49ea-b8e3-9177dfcf8bbe tempest-ProjectMemberTests-1866302072 None] Delete snapshot completed successfully.
Jul 03 01:33:47 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-614fdf4f-2181-49ea-b8e3-9177dfcf8bbe tempest-ProjectMemberTests-1866302072 None] Lock "cinder-42d11c60-5095-41cd-90b9-df9a14c5a27b-delete_snapshot" released by "delete_snapshot" :: held 3.011s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:33:48 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e412adb1-1aa2-46d2-8f3e-771617f3e15d tempest-ProjectMemberTests-1866302072 None] Acquiring lock "cinder-54dda17f-5631-42d5-b466-fbbf89762b76-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:33:48 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e412adb1-1aa2-46d2-8f3e-771617f3e15d tempest-ProjectMemberTests-1866302072 None] Lock "cinder-54dda17f-5631-42d5-b466-fbbf89762b76-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:33:48 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e412adb1-1aa2-46d2-8f3e-771617f3e15d tempest-ProjectMemberTests-1866302072 None] Acquiring lock "cinder-quobyte-54dda17f-5631-42d5-b466-fbbf89762b76" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:33:48 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e412adb1-1aa2-46d2-8f3e-771617f3e15d tempest-ProjectMemberTests-1866302072 None] Lock "cinder-quobyte-54dda17f-5631-42d5-b466-fbbf89762b76" acquired by "delete_volume" :: waited 0.016s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:33:48 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9994af2-e14f-4948-815b-b2935c0ba8fa]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:33:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e412adb1-1aa2-46d2-8f3e-771617f3e15d tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-54dda17f-5631-42d5-b466-fbbf89762b76 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:33:48 devstack sudo[107930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-54dda17f-5631-42d5-b466-fbbf89762b76
Jul 03 01:33:48 devstack sudo[107930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:33:48 devstack sudo[107930]: pam_unix(sudo:session): session closed for user root
Jul 03 01:33:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e412adb1-1aa2-46d2-8f3e-771617f3e15d tempest-ProjectMemberTests-1866302072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-54dda17f-5631-42d5-b466-fbbf89762b76" returned: 0 in 0.717s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:33:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e412adb1-1aa2-46d2-8f3e-771617f3e15d tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-54dda17f-5631-42d5-b466-fbbf89762b76 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:33:48 devstack sudo[107936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-54dda17f-5631-42d5-b466-fbbf89762b76
Jul 03 01:33:48 devstack sudo[107936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:33:49 devstack sudo[107936]: pam_unix(sudo:session): session closed for user root
Jul 03 01:33:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e412adb1-1aa2-46d2-8f3e-771617f3e15d tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-54dda17f-5631-42d5-b466-fbbf89762b76" returned: 0 in 0.631s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:33:49 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e412adb1-1aa2-46d2-8f3e-771617f3e15d tempest-ProjectMemberTests-1866302072 None] Lock "cinder-quobyte-54dda17f-5631-42d5-b466-fbbf89762b76" released by "delete_volume" :: held 1.397s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:33:49 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-e412adb1-1aa2-46d2-8f3e-771617f3e15d tempest-ProjectMemberTests-1866302072 None] Created reservations ['ee91bd32-485c-423f-80db-b95a55f07aee', '6f773160-bcf6-4463-bdac-72bd18ba142b', '20f634ae-335a-49b1-a9f4-8ff5fd5611db', '7cd4015a-d6e1-454b-b974-aca62db63ab4'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:33:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e412adb1-1aa2-46d2-8f3e-771617f3e15d tempest-ProjectMemberTests-1866302072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:33:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e412adb1-1aa2-46d2-8f3e-771617f3e15d tempest-ProjectMemberTests-1866302072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:33:49 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-e412adb1-1aa2-46d2-8f3e-771617f3e15d tempest-ProjectMemberTests-1866302072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:33:49 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-e412adb1-1aa2-46d2-8f3e-771617f3e15d tempest-ProjectMemberTests-1866302072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:33:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e412adb1-1aa2-46d2-8f3e-771617f3e15d tempest-ProjectMemberTests-1866302072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:33:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e412adb1-1aa2-46d2-8f3e-771617f3e15d tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:33:49 devstack sudo[107939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:33:49 devstack sudo[107939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:33:50 devstack sudo[107939]: pam_unix(sudo:session): session closed for user root
Jul 03 01:33:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e412adb1-1aa2-46d2-8f3e-771617f3e15d tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.628s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:33:50 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-e412adb1-1aa2-46d2-8f3e-771617f3e15d tempest-ProjectMemberTests-1866302072 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:33:50 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-e412adb1-1aa2-46d2-8f3e-771617f3e15d tempest-ProjectMemberTests-1866302072 None] Deleted volume successfully.
Jul 03 01:33:50 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e412adb1-1aa2-46d2-8f3e-771617f3e15d tempest-ProjectMemberTests-1866302072 None] Lock "cinder-54dda17f-5631-42d5-b466-fbbf89762b76-delete_volume" released by "delete_volume" :: held 2.227s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:33:50 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-e636904f-d80e-48dd-aeb5-d945f2387c50 tempest-ProjectMemberTests-1866302072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:33:50 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e636904f-d80e-48dd-aeb5-d945f2387c50 tempest-ProjectMemberTests-1866302072 None] Flow 'volume_create_manager' (75ecf9a9-1171-4086-acf1-12c81f5ed5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:33:50 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e636904f-d80e-48dd-aeb5-d945f2387c50 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (679f1e33-8c0b-4697-8da2-dbefca4d991f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:33:50 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e636904f-d80e-48dd-aeb5-d945f2387c50 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (679f1e33-8c0b-4697-8da2-dbefca4d991f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:33:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1055673465',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab566414-0965-4c01-8f5c-6d536a3748bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16429f2745354b0591f4044f3a99b9fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:33:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:33:51Z,use_quota=True,user_id='31dd51f2dcdd4724a4c6b78cb80e6d8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:33:50 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e636904f-d80e-48dd-aeb5-d945f2387c50 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddf35532-04c2-4ab0-9abe-7dbc3cdf336c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:33:50 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e636904f-d80e-48dd-aeb5-d945f2387c50 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddf35532-04c2-4ab0-9abe-7dbc3cdf336c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:33:50 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e636904f-d80e-48dd-aeb5-d945f2387c50 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26f07bf2-3683-4499-890f-37955c0ea124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:33:50 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e636904f-d80e-48dd-aeb5-d945f2387c50 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26f07bf2-3683-4499-890f-37955c0ea124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab566414-0965-4c01-8f5c-6d536a3748bc', 'volume_name': 'volume-ab566414-0965-4c01-8f5c-6d536a3748bc', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:33:50 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e636904f-d80e-48dd-aeb5-d945f2387c50 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b0fe32b-0938-4d5a-b2e0-c0656aaf3ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:33:50 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e636904f-d80e-48dd-aeb5-d945f2387c50 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b0fe32b-0938-4d5a-b2e0-c0656aaf3ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:33:50 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e636904f-d80e-48dd-aeb5-d945f2387c50 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (924eb781-b4b9-45bf-a303-0a68eedf40f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:33:50 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-e636904f-d80e-48dd-aeb5-d945f2387c50 tempest-ProjectMemberTests-1866302072 None] Volume ab566414-0965-4c01-8f5c-6d536a3748bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab566414-0965-4c01-8f5c-6d536a3748bc', 'volume_size': 1}
Jul 03 01:33:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e636904f-d80e-48dd-aeb5-d945f2387c50 tempest-ProjectMemberTests-1866302072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:33:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e636904f-d80e-48dd-aeb5-d945f2387c50 tempest-ProjectMemberTests-1866302072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:33:50 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-e636904f-d80e-48dd-aeb5-d945f2387c50 tempest-ProjectMemberTests-1866302072 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:33:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1055673465',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab566414-0965-4c01-8f5c-6d536a3748bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16429f2745354b0591f4044f3a99b9fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:33:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:33:51Z,use_quota=True,user_id='31dd51f2dcdd4724a4c6b78cb80e6d8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:33:50 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-e636904f-d80e-48dd-aeb5-d945f2387c50 tempest-ProjectMemberTests-1866302072 None] Creating volume ab566414-0965-4c01-8f5c-6d536a3748bc {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:33:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e636904f-d80e-48dd-aeb5-d945f2387c50 tempest-ProjectMemberTests-1866302072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:33:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e636904f-d80e-48dd-aeb5-d945f2387c50 tempest-ProjectMemberTests-1866302072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:33:50 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-e636904f-d80e-48dd-aeb5-d945f2387c50 tempest-ProjectMemberTests-1866302072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:33:50 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-e636904f-d80e-48dd-aeb5-d945f2387c50 tempest-ProjectMemberTests-1866302072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:33:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e636904f-d80e-48dd-aeb5-d945f2387c50 tempest-ProjectMemberTests-1866302072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:33:50 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-e636904f-d80e-48dd-aeb5-d945f2387c50 tempest-ProjectMemberTests-1866302072 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:33:50 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-e636904f-d80e-48dd-aeb5-d945f2387c50 tempest-ProjectMemberTests-1866302072 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:33:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e636904f-d80e-48dd-aeb5-d945f2387c50 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ab566414-0965-4c01-8f5c-6d536a3748bc 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:33:50 devstack sudo[107942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ab566414-0965-4c01-8f5c-6d536a3748bc 1073741824
Jul 03 01:33:50 devstack sudo[107942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:33:51 devstack sudo[107942]: pam_unix(sudo:session): session closed for user root
Jul 03 01:33:51 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e636904f-d80e-48dd-aeb5-d945f2387c50 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ab566414-0965-4c01-8f5c-6d536a3748bc 1073741824" returned: 0 in 0.775s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:33:51 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e636904f-d80e-48dd-aeb5-d945f2387c50 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ab566414-0965-4c01-8f5c-6d536a3748bc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:33:51 devstack sudo[107948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ab566414-0965-4c01-8f5c-6d536a3748bc
Jul 03 01:33:51 devstack sudo[107948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:33:52 devstack sudo[107948]: pam_unix(sudo:session): session closed for user root
Jul 03 01:33:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e636904f-d80e-48dd-aeb5-d945f2387c50 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ab566414-0965-4c01-8f5c-6d536a3748bc" returned: 0 in 0.632s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:33:52 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-e636904f-d80e-48dd-aeb5-d945f2387c50 tempest-ProjectMemberTests-1866302072 None] <== create_volume: return (1442ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:33:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-e636904f-d80e-48dd-aeb5-d945f2387c50 tempest-ProjectMemberTests-1866302072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.445s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:33:52 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e636904f-d80e-48dd-aeb5-d945f2387c50 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (924eb781-b4b9-45bf-a303-0a68eedf40f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab566414-0965-4c01-8f5c-6d536a3748bc', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:33:52 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e636904f-d80e-48dd-aeb5-d945f2387c50 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7836729-1c59-4ae3-86e3-d65339cee176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:33:52 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-e636904f-d80e-48dd-aeb5-d945f2387c50 tempest-ProjectMemberTests-1866302072 None] Volume volume-ab566414-0965-4c01-8f5c-6d536a3748bc (ab566414-0965-4c01-8f5c-6d536a3748bc): created successfully
Jul 03 01:33:52 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e636904f-d80e-48dd-aeb5-d945f2387c50 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7836729-1c59-4ae3-86e3-d65339cee176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:33:52 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-e636904f-d80e-48dd-aeb5-d945f2387c50 tempest-ProjectMemberTests-1866302072 None] Flow 'volume_create_manager' (75ecf9a9-1171-4086-acf1-12c81f5ed5c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:33:52 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-e636904f-d80e-48dd-aeb5-d945f2387c50 tempest-ProjectMemberTests-1866302072 None] Created volume successfully.
Jul 03 01:33:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-0e90af58-f527-4d6b-a766-a15f5323e927 tempest-ProjectMemberTests-1866302072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:33:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-0e90af58-f527-4d6b-a766-a15f5323e927 tempest-ProjectMemberTests-1866302072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:33:53 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-0e90af58-f527-4d6b-a766-a15f5323e927 tempest-ProjectMemberTests-1866302072 None] Creating offline snapshot e98745f8-3b13-49aa-9faa-054ab2522d20 of volume ab566414-0965-4c01-8f5c-6d536a3748bc {{(pid=86891) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 01:33:53 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27865cf-3737-4903-b57f-8ce741739d86]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:33:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0e90af58-f527-4d6b-a766-a15f5323e927 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ab566414-0965-4c01-8f5c-6d536a3748bc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:33:53 devstack sudo[107951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ab566414-0965-4c01-8f5c-6d536a3748bc
Jul 03 01:33:53 devstack sudo[107951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:33:53 devstack sudo[107951]: pam_unix(sudo:session): session closed for user root
Jul 03 01:33:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0e90af58-f527-4d6b-a766-a15f5323e927 tempest-ProjectMemberTests-1866302072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ab566414-0965-4c01-8f5c-6d536a3748bc" returned: 0 in 0.733s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:33:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0e90af58-f527-4d6b-a766-a15f5323e927 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ab566414-0965-4c01-8f5c-6d536a3748bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ab566414-0965-4c01-8f5c-6d536a3748bc.e98745f8-3b13-49aa-9faa-054ab2522d20 1G {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:33:53 devstack sudo[107956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ab566414-0965-4c01-8f5c-6d536a3748bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ab566414-0965-4c01-8f5c-6d536a3748bc.e98745f8-3b13-49aa-9faa-054ab2522d20 1G
Jul 03 01:33:53 devstack sudo[107956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:33:54 devstack sudo[107956]: pam_unix(sudo:session): session closed for user root
Jul 03 01:33:54 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0e90af58-f527-4d6b-a766-a15f5323e927 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ab566414-0965-4c01-8f5c-6d536a3748bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ab566414-0965-4c01-8f5c-6d536a3748bc.e98745f8-3b13-49aa-9faa-054ab2522d20 1G" returned: 0 in 0.742s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:33:54 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0e90af58-f527-4d6b-a766-a15f5323e927 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab566414-0965-4c01-8f5c-6d536a3748bc -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ab566414-0965-4c01-8f5c-6d536a3748bc.e98745f8-3b13-49aa-9faa-054ab2522d20 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:33:54 devstack sudo[107962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab566414-0965-4c01-8f5c-6d536a3748bc -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ab566414-0965-4c01-8f5c-6d536a3748bc.e98745f8-3b13-49aa-9faa-054ab2522d20
Jul 03 01:33:54 devstack sudo[107962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:33:55 devstack sudo[107962]: pam_unix(sudo:session): session closed for user root
Jul 03 01:33:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0e90af58-f527-4d6b-a766-a15f5323e927 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab566414-0965-4c01-8f5c-6d536a3748bc -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ab566414-0965-4c01-8f5c-6d536a3748bc.e98745f8-3b13-49aa-9faa-054ab2522d20" returned: 0 in 0.681s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:33:55 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-0e90af58-f527-4d6b-a766-a15f5323e927 tempest-ProjectMemberTests-1866302072 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ab566414-0965-4c01-8f5c-6d536a3748bc.e98745f8-3b13-49aa-9faa-054ab2522d20 is being set with open permissions: ugo+rw
Jul 03 01:33:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0e90af58-f527-4d6b-a766-a15f5323e927 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ab566414-0965-4c01-8f5c-6d536a3748bc.e98745f8-3b13-49aa-9faa-054ab2522d20 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:33:55 devstack sudo[107967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ab566414-0965-4c01-8f5c-6d536a3748bc.e98745f8-3b13-49aa-9faa-054ab2522d20
Jul 03 01:33:55 devstack sudo[107967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:33:55 devstack sudo[107967]: pam_unix(sudo:session): session closed for user root
Jul 03 01:33:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0e90af58-f527-4d6b-a766-a15f5323e927 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ab566414-0965-4c01-8f5c-6d536a3748bc.e98745f8-3b13-49aa-9faa-054ab2522d20" returned: 0 in 0.608s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:33:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0e90af58-f527-4d6b-a766-a15f5323e927 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ab566414-0965-4c01-8f5c-6d536a3748bc.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:33:55 devstack sudo[107970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ab566414-0965-4c01-8f5c-6d536a3748bc.info
Jul 03 01:33:55 devstack sudo[107970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:33:56 devstack sudo[107970]: pam_unix(sudo:session): session closed for user root
Jul 03 01:33:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0e90af58-f527-4d6b-a766-a15f5323e927 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ab566414-0965-4c01-8f5c-6d536a3748bc.info" returned: 0 in 0.630s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:33:56 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-0e90af58-f527-4d6b-a766-a15f5323e927 tempest-ProjectMemberTests-1866302072 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ab566414-0965-4c01-8f5c-6d536a3748bc.info is being set with open permissions: ugo+rw
Jul 03 01:33:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0e90af58-f527-4d6b-a766-a15f5323e927 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ab566414-0965-4c01-8f5c-6d536a3748bc.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:33:56 devstack sudo[107973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ab566414-0965-4c01-8f5c-6d536a3748bc.info
Jul 03 01:33:56 devstack sudo[107973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:33:57 devstack sudo[107973]: pam_unix(sudo:session): session closed for user root
Jul 03 01:33:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-0e90af58-f527-4d6b-a766-a15f5323e927 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ab566414-0965-4c01-8f5c-6d536a3748bc.info" returned: 0 in 0.637s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:33:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-0e90af58-f527-4d6b-a766-a15f5323e927 tempest-ProjectMemberTests-1866302072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.153s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:33:57 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-0e90af58-f527-4d6b-a766-a15f5323e927 tempest-ProjectMemberTests-1866302072 None] Create snapshot completed successfully
Jul 03 01:33:58 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-6604ff67-6acf-4175-92f9-3240651017b9 tempest-ProjectMemberTests-1866302072 None] Acquiring lock "cinder-e98745f8-3b13-49aa-9faa-054ab2522d20-delete_snapshot" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:33:58 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-6604ff67-6acf-4175-92f9-3240651017b9 tempest-ProjectMemberTests-1866302072 None] Lock "cinder-e98745f8-3b13-49aa-9faa-054ab2522d20-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:33:58 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-6604ff67-6acf-4175-92f9-3240651017b9 tempest-ProjectMemberTests-1866302072 None] Acquiring lock "cinder-quobyte-ab566414-0965-4c01-8f5c-6d536a3748bc" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:33:58 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-6604ff67-6acf-4175-92f9-3240651017b9 tempest-ProjectMemberTests-1866302072 None] Lock "cinder-quobyte-ab566414-0965-4c01-8f5c-6d536a3748bc" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:33:58 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-6604ff67-6acf-4175-92f9-3240651017b9 tempest-ProjectMemberTests-1866302072 None] Acquiring lock "cinder-quobyte-e98745f8-3b13-49aa-9faa-054ab2522d20" by "_delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:33:58 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-6604ff67-6acf-4175-92f9-3240651017b9 tempest-ProjectMemberTests-1866302072 None] Lock "cinder-quobyte-e98745f8-3b13-49aa-9faa-054ab2522d20" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:33:58 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-6604ff67-6acf-4175-92f9-3240651017b9 tempest-ProjectMemberTests-1866302072 None] Deleting offline snapshot e98745f8-3b13-49aa-9faa-054ab2522d20 of volume ab566414-0965-4c01-8f5c-6d536a3748bc {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 01:33:58 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-6604ff67-6acf-4175-92f9-3240651017b9 tempest-ProjectMemberTests-1866302072 None] snapshot_file for this snap is: volume-ab566414-0965-4c01-8f5c-6d536a3748bc.e98745f8-3b13-49aa-9faa-054ab2522d20 {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 01:33:58 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c2aa520-7717-4da0-87ca-b354761e248a]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:33:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6604ff67-6acf-4175-92f9-3240651017b9 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ab566414-0965-4c01-8f5c-6d536a3748bc.e98745f8-3b13-49aa-9faa-054ab2522d20 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:33:58 devstack sudo[107976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ab566414-0965-4c01-8f5c-6d536a3748bc.e98745f8-3b13-49aa-9faa-054ab2522d20
Jul 03 01:33:58 devstack sudo[107976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:33:59 devstack sudo[107976]: pam_unix(sudo:session): session closed for user root
Jul 03 01:33:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6604ff67-6acf-4175-92f9-3240651017b9 tempest-ProjectMemberTests-1866302072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ab566414-0965-4c01-8f5c-6d536a3748bc.e98745f8-3b13-49aa-9faa-054ab2522d20" returned: 0 in 0.744s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:33:59 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-6604ff67-6acf-4175-92f9-3240651017b9 tempest-ProjectMemberTests-1866302072 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab566414-0965-4c01-8f5c-6d536a3748bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:33:59 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a08e550-3387-4b69-b507-97597a418bde]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:33:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6604ff67-6acf-4175-92f9-3240651017b9 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ab566414-0965-4c01-8f5c-6d536a3748bc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:33:59 devstack sudo[107982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ab566414-0965-4c01-8f5c-6d536a3748bc
Jul 03 01:33:59 devstack sudo[107982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:33:59 devstack sudo[107982]: pam_unix(sudo:session): session closed for user root
Jul 03 01:33:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6604ff67-6acf-4175-92f9-3240651017b9 tempest-ProjectMemberTests-1866302072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ab566414-0965-4c01-8f5c-6d536a3748bc" returned: 0 in 0.724s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:33:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6604ff67-6acf-4175-92f9-3240651017b9 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ab566414-0965-4c01-8f5c-6d536a3748bc.e98745f8-3b13-49aa-9faa-054ab2522d20 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:33:59 devstack sudo[107987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ab566414-0965-4c01-8f5c-6d536a3748bc.e98745f8-3b13-49aa-9faa-054ab2522d20
Jul 03 01:33:59 devstack sudo[107987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:00 devstack sudo[107987]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:00 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6604ff67-6acf-4175-92f9-3240651017b9 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ab566414-0965-4c01-8f5c-6d536a3748bc.e98745f8-3b13-49aa-9faa-054ab2522d20" returned: 0 in 0.709s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:00 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6604ff67-6acf-4175-92f9-3240651017b9 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ab566414-0965-4c01-8f5c-6d536a3748bc.e98745f8-3b13-49aa-9faa-054ab2522d20 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:00 devstack sudo[107992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ab566414-0965-4c01-8f5c-6d536a3748bc.e98745f8-3b13-49aa-9faa-054ab2522d20
Jul 03 01:34:00 devstack sudo[107992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:01 devstack sudo[107992]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6604ff67-6acf-4175-92f9-3240651017b9 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ab566414-0965-4c01-8f5c-6d536a3748bc.e98745f8-3b13-49aa-9faa-054ab2522d20" returned: 0 in 0.607s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:01 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-6604ff67-6acf-4175-92f9-3240651017b9 tempest-ProjectMemberTests-1866302072 None] Lock "cinder-quobyte-e98745f8-3b13-49aa-9faa-054ab2522d20" released by "_delete_snapshot" :: held 2.870s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:34:01 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-6604ff67-6acf-4175-92f9-3240651017b9 tempest-ProjectMemberTests-1866302072 None] Lock "cinder-quobyte-ab566414-0965-4c01-8f5c-6d536a3748bc" released by "delete_snapshot" :: held 2.893s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:34:01 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-6604ff67-6acf-4175-92f9-3240651017b9 tempest-ProjectMemberTests-1866302072 None] Created reservations ['839eff59-7bd0-4c3b-8486-a71d73a2cfe0', 'f3ffd617-1295-44de-834a-294f3c2e66c5', '59b23411-0617-46b1-9bbf-71b2b9edf832', 'b61ee2ba-11bc-43a5-8b49-66770bc11ca3'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:34:01 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-6604ff67-6acf-4175-92f9-3240651017b9 tempest-ProjectMemberTests-1866302072 None] Delete snapshot completed successfully.
Jul 03 01:34:01 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-6604ff67-6acf-4175-92f9-3240651017b9 tempest-ProjectMemberTests-1866302072 None] Lock "cinder-e98745f8-3b13-49aa-9faa-054ab2522d20-delete_snapshot" released by "delete_snapshot" :: held 3.024s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:34:01 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8469bffe-fa9b-4864-9aa5-58e3059c6830 tempest-ProjectMemberTests-1866302072 None] Acquiring lock "cinder-ab566414-0965-4c01-8f5c-6d536a3748bc-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:34:01 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8469bffe-fa9b-4864-9aa5-58e3059c6830 tempest-ProjectMemberTests-1866302072 None] Lock "cinder-ab566414-0965-4c01-8f5c-6d536a3748bc-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:34:01 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8469bffe-fa9b-4864-9aa5-58e3059c6830 tempest-ProjectMemberTests-1866302072 None] Acquiring lock "cinder-quobyte-ab566414-0965-4c01-8f5c-6d536a3748bc" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:34:01 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8469bffe-fa9b-4864-9aa5-58e3059c6830 tempest-ProjectMemberTests-1866302072 None] Lock "cinder-quobyte-ab566414-0965-4c01-8f5c-6d536a3748bc" acquired by "delete_volume" :: waited 0.016s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:34:01 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[543d4439-45ad-4b30-a198-ac595403d7fb]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:34:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8469bffe-fa9b-4864-9aa5-58e3059c6830 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ab566414-0965-4c01-8f5c-6d536a3748bc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:01 devstack sudo[107995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ab566414-0965-4c01-8f5c-6d536a3748bc
Jul 03 01:34:01 devstack sudo[107995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:01 devstack cinder-volume[86891]: DEBUG oslo_service.periodic_task [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86891) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 01:34:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:34:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:34:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:34:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:34:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:34:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:01 devstack sudo[107997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:34:01 devstack sudo[107997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:02 devstack sudo[107995]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8469bffe-fa9b-4864-9aa5-58e3059c6830 tempest-ProjectMemberTests-1866302072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ab566414-0965-4c01-8f5c-6d536a3748bc" returned: 0 in 0.738s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8469bffe-fa9b-4864-9aa5-58e3059c6830 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ab566414-0965-4c01-8f5c-6d536a3748bc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:02 devstack sudo[108002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ab566414-0965-4c01-8f5c-6d536a3748bc
Jul 03 01:34:02 devstack sudo[108002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:02 devstack sudo[107997]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.689s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:02 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:34:02 devstack cinder-volume[86891]: DEBUG oslo_service.periodic_task [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running periodic task VolumeManager._thread_info {{(pid=86891) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 01:34:02 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] thread count: 28 {{(pid=86891) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 01:34:02 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] thread info: [<_MainThread(MainThread, started 136731296534656)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136731184953280)>, <Thread(Thread-3 (stat_writer), started daemon 136731184058816)>, <Thread(Rabbit-heartbeat, started daemon 136731184846080)>, <Thread(Thread-5 (_runner), started daemon 136731182936576)>, <Thread(Thread-7 (_runner), started daemon 136731182954944)>, <Thread(fd_logger, started daemon 136731181916416)>, <Thread(privsep_reader, started daemon 136731180942208)>, <Thread(tpool_thread_0, started daemon 136731172161216)>, <Thread(tpool_thread_1, started daemon 136731163768512)>, <Thread(tpool_thread_2, started daemon 136731155375808)>, <Thread(tpool_thread_3, started daemon 136731146983104)>, <Thread(tpool_thread_4, started daemon 136731138590400)>, <Thread(tpool_thread_5, started daemon 136731130197696)>, <Thread(tpool_thread_6, started daemon 136731121804992)>, <Thread(tpool_thread_7, started daemon 136731113412288)>, <Thread(tpool_thread_8, started daemon 136731105003200)>, <Thread(tpool_thread_9, started daemon 136731096594112)>, <Thread(tpool_thread_10, started daemon 136731088185024)>, <Thread(tpool_thread_11, started daemon 136731079775936)>, <Thread(tpool_thread_12, started daemon 136731071366848)>, <Thread(tpool_thread_13, started daemon 136731062957760)>, <Thread(tpool_thread_14, started daemon 136731054548672)>, <Thread(tpool_thread_15, started daemon 136731046139584)>, <Thread(tpool_thread_16, started daemon 136731037730496)>, <Thread(tpool_thread_17, started daemon 136731029321408)>, <Thread(tpool_thread_18, started daemon 136731020912320)>, <Thread(tpool_thread_19, started daemon 136731012503232)>] {{(pid=86891) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 01:34:02 devstack sudo[108002]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8469bffe-fa9b-4864-9aa5-58e3059c6830 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-ab566414-0965-4c01-8f5c-6d536a3748bc" returned: 0 in 0.643s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:02 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8469bffe-fa9b-4864-9aa5-58e3059c6830 tempest-ProjectMemberTests-1866302072 None] Lock "cinder-quobyte-ab566414-0965-4c01-8f5c-6d536a3748bc" released by "delete_volume" :: held 1.443s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:34:02 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-8469bffe-fa9b-4864-9aa5-58e3059c6830 tempest-ProjectMemberTests-1866302072 None] Created reservations ['69efb20a-c7a2-4b17-8b2c-0ee4206893cb', '42238068-4a81-45d7-a982-819c412627fe', 'bba0550e-9da2-47f9-81af-2f5fd7bb07ee', 'e6b59dfb-2983-44f1-b1cd-a3f37ae477da'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:34:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-8469bffe-fa9b-4864-9aa5-58e3059c6830 tempest-ProjectMemberTests-1866302072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:34:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-8469bffe-fa9b-4864-9aa5-58e3059c6830 tempest-ProjectMemberTests-1866302072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:34:03 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-8469bffe-fa9b-4864-9aa5-58e3059c6830 tempest-ProjectMemberTests-1866302072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:34:03 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-8469bffe-fa9b-4864-9aa5-58e3059c6830 tempest-ProjectMemberTests-1866302072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:34:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-8469bffe-fa9b-4864-9aa5-58e3059c6830 tempest-ProjectMemberTests-1866302072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:34:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8469bffe-fa9b-4864-9aa5-58e3059c6830 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:03 devstack sudo[108006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:34:03 devstack sudo[108006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:03 devstack sudo[108006]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8469bffe-fa9b-4864-9aa5-58e3059c6830 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.663s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:03 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-8469bffe-fa9b-4864-9aa5-58e3059c6830 tempest-ProjectMemberTests-1866302072 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:34:03 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-8469bffe-fa9b-4864-9aa5-58e3059c6830 tempest-ProjectMemberTests-1866302072 None] Deleted volume successfully.
Jul 03 01:34:03 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8469bffe-fa9b-4864-9aa5-58e3059c6830 tempest-ProjectMemberTests-1866302072 None] Lock "cinder-ab566414-0965-4c01-8f5c-6d536a3748bc-delete_volume" released by "delete_volume" :: held 2.303s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:34:04 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-7232537e-ef57-47f0-9a93-63066cc462c6 tempest-ProjectMemberTests-1866302072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:34:04 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7232537e-ef57-47f0-9a93-63066cc462c6 tempest-ProjectMemberTests-1866302072 None] Flow 'volume_create_manager' (5c0c700d-c445-4e39-b9f4-5c5c7015a847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:34:04 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7232537e-ef57-47f0-9a93-63066cc462c6 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (988c027d-4faa-4f53-abcb-e64f0b2cf8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:34:04 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7232537e-ef57-47f0-9a93-63066cc462c6 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (988c027d-4faa-4f53-abcb-e64f0b2cf8e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:34:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1080304499',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a71ea0b-de2b-456c-8e5e-102141bfc676,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16429f2745354b0591f4044f3a99b9fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:34:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:34:04Z,use_quota=True,user_id='31dd51f2dcdd4724a4c6b78cb80e6d8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:34:04 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7232537e-ef57-47f0-9a93-63066cc462c6 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4b37918-34f9-4a63-8c9c-015aa38472e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:34:04 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7232537e-ef57-47f0-9a93-63066cc462c6 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4b37918-34f9-4a63-8c9c-015aa38472e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:34:04 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7232537e-ef57-47f0-9a93-63066cc462c6 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de4b07e4-53bf-4e73-bba3-286459e5e105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:34:04 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7232537e-ef57-47f0-9a93-63066cc462c6 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de4b07e4-53bf-4e73-bba3-286459e5e105) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a71ea0b-de2b-456c-8e5e-102141bfc676', 'volume_name': 'volume-1a71ea0b-de2b-456c-8e5e-102141bfc676', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:34:04 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7232537e-ef57-47f0-9a93-63066cc462c6 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4fb9d55-f782-4446-ae34-85e09931a02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:34:04 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7232537e-ef57-47f0-9a93-63066cc462c6 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4fb9d55-f782-4446-ae34-85e09931a02a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:34:04 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7232537e-ef57-47f0-9a93-63066cc462c6 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ac0eacd-d920-49a8-b036-eea957ff1abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:34:04 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-7232537e-ef57-47f0-9a93-63066cc462c6 tempest-ProjectMemberTests-1866302072 None] Volume 1a71ea0b-de2b-456c-8e5e-102141bfc676: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a71ea0b-de2b-456c-8e5e-102141bfc676', 'volume_size': 1}
Jul 03 01:34:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-7232537e-ef57-47f0-9a93-63066cc462c6 tempest-ProjectMemberTests-1866302072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:34:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-7232537e-ef57-47f0-9a93-63066cc462c6 tempest-ProjectMemberTests-1866302072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:34:04 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-7232537e-ef57-47f0-9a93-63066cc462c6 tempest-ProjectMemberTests-1866302072 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:34:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1080304499',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a71ea0b-de2b-456c-8e5e-102141bfc676,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16429f2745354b0591f4044f3a99b9fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:34:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:34:04Z,use_quota=True,user_id='31dd51f2dcdd4724a4c6b78cb80e6d8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:34:04 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-7232537e-ef57-47f0-9a93-63066cc462c6 tempest-ProjectMemberTests-1866302072 None] Creating volume 1a71ea0b-de2b-456c-8e5e-102141bfc676 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:34:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-7232537e-ef57-47f0-9a93-63066cc462c6 tempest-ProjectMemberTests-1866302072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:34:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-7232537e-ef57-47f0-9a93-63066cc462c6 tempest-ProjectMemberTests-1866302072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:34:04 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-7232537e-ef57-47f0-9a93-63066cc462c6 tempest-ProjectMemberTests-1866302072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:34:04 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-7232537e-ef57-47f0-9a93-63066cc462c6 tempest-ProjectMemberTests-1866302072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:34:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-7232537e-ef57-47f0-9a93-63066cc462c6 tempest-ProjectMemberTests-1866302072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:34:04 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-7232537e-ef57-47f0-9a93-63066cc462c6 tempest-ProjectMemberTests-1866302072 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:34:04 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-7232537e-ef57-47f0-9a93-63066cc462c6 tempest-ProjectMemberTests-1866302072 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:34:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-7232537e-ef57-47f0-9a93-63066cc462c6 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1a71ea0b-de2b-456c-8e5e-102141bfc676 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:04 devstack sudo[108009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1a71ea0b-de2b-456c-8e5e-102141bfc676 1073741824
Jul 03 01:34:04 devstack sudo[108009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:04 devstack sudo[108009]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-7232537e-ef57-47f0-9a93-63066cc462c6 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1a71ea0b-de2b-456c-8e5e-102141bfc676 1073741824" returned: 0 in 0.798s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-7232537e-ef57-47f0-9a93-63066cc462c6 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1a71ea0b-de2b-456c-8e5e-102141bfc676 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:05 devstack sudo[108015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1a71ea0b-de2b-456c-8e5e-102141bfc676
Jul 03 01:34:05 devstack sudo[108015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:05 devstack sudo[108015]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:05 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-7232537e-ef57-47f0-9a93-63066cc462c6 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1a71ea0b-de2b-456c-8e5e-102141bfc676" returned: 0 in 0.642s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:05 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-7232537e-ef57-47f0-9a93-63066cc462c6 tempest-ProjectMemberTests-1866302072 None] <== create_volume: return (1479ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:34:05 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-7232537e-ef57-47f0-9a93-63066cc462c6 tempest-ProjectMemberTests-1866302072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.482s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:34:05 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7232537e-ef57-47f0-9a93-63066cc462c6 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ac0eacd-d920-49a8-b036-eea957ff1abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a71ea0b-de2b-456c-8e5e-102141bfc676', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:34:05 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7232537e-ef57-47f0-9a93-63066cc462c6 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5aa6647-eaed-499b-9d5c-a32972f77391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:34:05 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-7232537e-ef57-47f0-9a93-63066cc462c6 tempest-ProjectMemberTests-1866302072 None] Volume volume-1a71ea0b-de2b-456c-8e5e-102141bfc676 (1a71ea0b-de2b-456c-8e5e-102141bfc676): created successfully
Jul 03 01:34:05 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7232537e-ef57-47f0-9a93-63066cc462c6 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5aa6647-eaed-499b-9d5c-a32972f77391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:34:05 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-7232537e-ef57-47f0-9a93-63066cc462c6 tempest-ProjectMemberTests-1866302072 None] Flow 'volume_create_manager' (5c0c700d-c445-4e39-b9f4-5c5c7015a847) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:34:05 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-7232537e-ef57-47f0-9a93-63066cc462c6 tempest-ProjectMemberTests-1866302072 None] Created volume successfully.
Jul 03 01:34:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a554d6a4-259f-4ea2-8ed4-0f4341036f1f tempest-ProjectMemberTests-1866302072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:34:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a554d6a4-259f-4ea2-8ed4-0f4341036f1f tempest-ProjectMemberTests-1866302072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:34:06 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-a554d6a4-259f-4ea2-8ed4-0f4341036f1f tempest-ProjectMemberTests-1866302072 None] Creating offline snapshot 142b20c6-d18f-4ed6-879a-4f9bd968c6da of volume 1a71ea0b-de2b-456c-8e5e-102141bfc676 {{(pid=86891) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 01:34:06 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba05836-4dda-47d3-b047-8372cc68f519]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:34:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a554d6a4-259f-4ea2-8ed4-0f4341036f1f tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1a71ea0b-de2b-456c-8e5e-102141bfc676 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:06 devstack sudo[108018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1a71ea0b-de2b-456c-8e5e-102141bfc676
Jul 03 01:34:06 devstack sudo[108018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:07 devstack sudo[108018]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:07 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a554d6a4-259f-4ea2-8ed4-0f4341036f1f tempest-ProjectMemberTests-1866302072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1a71ea0b-de2b-456c-8e5e-102141bfc676" returned: 0 in 0.742s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:07 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a554d6a4-259f-4ea2-8ed4-0f4341036f1f tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1a71ea0b-de2b-456c-8e5e-102141bfc676,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1a71ea0b-de2b-456c-8e5e-102141bfc676.142b20c6-d18f-4ed6-879a-4f9bd968c6da 1G {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:07 devstack sudo[108023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1a71ea0b-de2b-456c-8e5e-102141bfc676,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1a71ea0b-de2b-456c-8e5e-102141bfc676.142b20c6-d18f-4ed6-879a-4f9bd968c6da 1G
Jul 03 01:34:07 devstack sudo[108023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:07 devstack sudo[108023]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:07 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a554d6a4-259f-4ea2-8ed4-0f4341036f1f tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1a71ea0b-de2b-456c-8e5e-102141bfc676,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1a71ea0b-de2b-456c-8e5e-102141bfc676.142b20c6-d18f-4ed6-879a-4f9bd968c6da 1G" returned: 0 in 0.827s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:07 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a554d6a4-259f-4ea2-8ed4-0f4341036f1f tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a71ea0b-de2b-456c-8e5e-102141bfc676 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1a71ea0b-de2b-456c-8e5e-102141bfc676.142b20c6-d18f-4ed6-879a-4f9bd968c6da {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:07 devstack sudo[108029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a71ea0b-de2b-456c-8e5e-102141bfc676 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1a71ea0b-de2b-456c-8e5e-102141bfc676.142b20c6-d18f-4ed6-879a-4f9bd968c6da
Jul 03 01:34:07 devstack sudo[108029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:08 devstack sudo[108029]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:08 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a554d6a4-259f-4ea2-8ed4-0f4341036f1f tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a71ea0b-de2b-456c-8e5e-102141bfc676 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1a71ea0b-de2b-456c-8e5e-102141bfc676.142b20c6-d18f-4ed6-879a-4f9bd968c6da" returned: 0 in 0.683s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:08 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-a554d6a4-259f-4ea2-8ed4-0f4341036f1f tempest-ProjectMemberTests-1866302072 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1a71ea0b-de2b-456c-8e5e-102141bfc676.142b20c6-d18f-4ed6-879a-4f9bd968c6da is being set with open permissions: ugo+rw
Jul 03 01:34:08 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a554d6a4-259f-4ea2-8ed4-0f4341036f1f tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1a71ea0b-de2b-456c-8e5e-102141bfc676.142b20c6-d18f-4ed6-879a-4f9bd968c6da {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:08 devstack sudo[108034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1a71ea0b-de2b-456c-8e5e-102141bfc676.142b20c6-d18f-4ed6-879a-4f9bd968c6da
Jul 03 01:34:08 devstack sudo[108034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:09 devstack sudo[108034]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a554d6a4-259f-4ea2-8ed4-0f4341036f1f tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1a71ea0b-de2b-456c-8e5e-102141bfc676.142b20c6-d18f-4ed6-879a-4f9bd968c6da" returned: 0 in 0.610s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a554d6a4-259f-4ea2-8ed4-0f4341036f1f tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1a71ea0b-de2b-456c-8e5e-102141bfc676.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:09 devstack sudo[108038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1a71ea0b-de2b-456c-8e5e-102141bfc676.info
Jul 03 01:34:09 devstack sudo[108038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:09 devstack sudo[108038]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a554d6a4-259f-4ea2-8ed4-0f4341036f1f tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1a71ea0b-de2b-456c-8e5e-102141bfc676.info" returned: 0 in 0.663s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:09 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-a554d6a4-259f-4ea2-8ed4-0f4341036f1f tempest-ProjectMemberTests-1866302072 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1a71ea0b-de2b-456c-8e5e-102141bfc676.info is being set with open permissions: ugo+rw
Jul 03 01:34:09 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a554d6a4-259f-4ea2-8ed4-0f4341036f1f tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1a71ea0b-de2b-456c-8e5e-102141bfc676.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:09 devstack sudo[108041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1a71ea0b-de2b-456c-8e5e-102141bfc676.info
Jul 03 01:34:09 devstack sudo[108041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:10 devstack sudo[108041]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:10 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-a554d6a4-259f-4ea2-8ed4-0f4341036f1f tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1a71ea0b-de2b-456c-8e5e-102141bfc676.info" returned: 0 in 0.630s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:10 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-a554d6a4-259f-4ea2-8ed4-0f4341036f1f tempest-ProjectMemberTests-1866302072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.228s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:34:10 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-a554d6a4-259f-4ea2-8ed4-0f4341036f1f tempest-ProjectMemberTests-1866302072 None] Create snapshot completed successfully
Jul 03 01:34:11 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-57b37573-1dbe-45cc-ba51-b8578ce26d49 tempest-ProjectMemberTests-1866302072 None] Acquiring lock "cinder-142b20c6-d18f-4ed6-879a-4f9bd968c6da-delete_snapshot" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:34:11 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-57b37573-1dbe-45cc-ba51-b8578ce26d49 tempest-ProjectMemberTests-1866302072 None] Lock "cinder-142b20c6-d18f-4ed6-879a-4f9bd968c6da-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:34:11 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-57b37573-1dbe-45cc-ba51-b8578ce26d49 tempest-ProjectMemberTests-1866302072 None] Acquiring lock "cinder-quobyte-1a71ea0b-de2b-456c-8e5e-102141bfc676" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:34:11 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-57b37573-1dbe-45cc-ba51-b8578ce26d49 tempest-ProjectMemberTests-1866302072 None] Lock "cinder-quobyte-1a71ea0b-de2b-456c-8e5e-102141bfc676" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:34:11 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-57b37573-1dbe-45cc-ba51-b8578ce26d49 tempest-ProjectMemberTests-1866302072 None] Acquiring lock "cinder-quobyte-142b20c6-d18f-4ed6-879a-4f9bd968c6da" by "_delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:34:11 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-57b37573-1dbe-45cc-ba51-b8578ce26d49 tempest-ProjectMemberTests-1866302072 None] Lock "cinder-quobyte-142b20c6-d18f-4ed6-879a-4f9bd968c6da" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:34:11 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-57b37573-1dbe-45cc-ba51-b8578ce26d49 tempest-ProjectMemberTests-1866302072 None] Deleting offline snapshot 142b20c6-d18f-4ed6-879a-4f9bd968c6da of volume 1a71ea0b-de2b-456c-8e5e-102141bfc676 {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 01:34:11 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-57b37573-1dbe-45cc-ba51-b8578ce26d49 tempest-ProjectMemberTests-1866302072 None] snapshot_file for this snap is: volume-1a71ea0b-de2b-456c-8e5e-102141bfc676.142b20c6-d18f-4ed6-879a-4f9bd968c6da {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 01:34:11 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeca3da4-449b-47ca-ab4e-456b1103519c]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:34:11 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-57b37573-1dbe-45cc-ba51-b8578ce26d49 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1a71ea0b-de2b-456c-8e5e-102141bfc676.142b20c6-d18f-4ed6-879a-4f9bd968c6da {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:11 devstack sudo[108044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1a71ea0b-de2b-456c-8e5e-102141bfc676.142b20c6-d18f-4ed6-879a-4f9bd968c6da
Jul 03 01:34:11 devstack sudo[108044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:12 devstack sudo[108044]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-57b37573-1dbe-45cc-ba51-b8578ce26d49 tempest-ProjectMemberTests-1866302072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1a71ea0b-de2b-456c-8e5e-102141bfc676.142b20c6-d18f-4ed6-879a-4f9bd968c6da" returned: 0 in 0.740s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:12 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-57b37573-1dbe-45cc-ba51-b8578ce26d49 tempest-ProjectMemberTests-1866302072 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a71ea0b-de2b-456c-8e5e-102141bfc676(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:34:12 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da3cf5f-5649-4e81-b367-4652486dd584]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:34:12 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-57b37573-1dbe-45cc-ba51-b8578ce26d49 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1a71ea0b-de2b-456c-8e5e-102141bfc676 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:12 devstack sudo[108049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1a71ea0b-de2b-456c-8e5e-102141bfc676
Jul 03 01:34:12 devstack sudo[108049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:13 devstack sudo[108049]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-57b37573-1dbe-45cc-ba51-b8578ce26d49 tempest-ProjectMemberTests-1866302072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1a71ea0b-de2b-456c-8e5e-102141bfc676" returned: 0 in 0.741s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-57b37573-1dbe-45cc-ba51-b8578ce26d49 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1a71ea0b-de2b-456c-8e5e-102141bfc676.142b20c6-d18f-4ed6-879a-4f9bd968c6da {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:13 devstack sudo[108054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1a71ea0b-de2b-456c-8e5e-102141bfc676.142b20c6-d18f-4ed6-879a-4f9bd968c6da
Jul 03 01:34:13 devstack sudo[108054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:13 devstack sudo[108054]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-57b37573-1dbe-45cc-ba51-b8578ce26d49 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1a71ea0b-de2b-456c-8e5e-102141bfc676.142b20c6-d18f-4ed6-879a-4f9bd968c6da" returned: 0 in 0.697s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:13 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-57b37573-1dbe-45cc-ba51-b8578ce26d49 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1a71ea0b-de2b-456c-8e5e-102141bfc676.142b20c6-d18f-4ed6-879a-4f9bd968c6da {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:13 devstack sudo[108059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1a71ea0b-de2b-456c-8e5e-102141bfc676.142b20c6-d18f-4ed6-879a-4f9bd968c6da
Jul 03 01:34:13 devstack sudo[108059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:14 devstack sudo[108059]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-57b37573-1dbe-45cc-ba51-b8578ce26d49 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1a71ea0b-de2b-456c-8e5e-102141bfc676.142b20c6-d18f-4ed6-879a-4f9bd968c6da" returned: 0 in 0.625s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:14 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-57b37573-1dbe-45cc-ba51-b8578ce26d49 tempest-ProjectMemberTests-1866302072 None] Lock "cinder-quobyte-142b20c6-d18f-4ed6-879a-4f9bd968c6da" released by "_delete_snapshot" :: held 2.882s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:34:14 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-57b37573-1dbe-45cc-ba51-b8578ce26d49 tempest-ProjectMemberTests-1866302072 None] Lock "cinder-quobyte-1a71ea0b-de2b-456c-8e5e-102141bfc676" released by "delete_snapshot" :: held 2.906s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:34:14 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-57b37573-1dbe-45cc-ba51-b8578ce26d49 tempest-ProjectMemberTests-1866302072 None] Created reservations ['ea40361b-0a6b-47bd-99eb-4f3c3d9fe9c8', '77641b6f-631d-43b7-a02b-b85977f7c743', '59230f83-7d19-4813-887d-9e25af455c17', '4aa03bbf-1586-4b4e-aba2-80002b8ec555'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:34:14 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-57b37573-1dbe-45cc-ba51-b8578ce26d49 tempest-ProjectMemberTests-1866302072 None] Delete snapshot completed successfully.
Jul 03 01:34:14 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-57b37573-1dbe-45cc-ba51-b8578ce26d49 tempest-ProjectMemberTests-1866302072 None] Lock "cinder-142b20c6-d18f-4ed6-879a-4f9bd968c6da-delete_snapshot" released by "delete_snapshot" :: held 3.029s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:34:14 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8e373931-9a8b-4252-b7aa-1f808f895622 tempest-ProjectMemberTests-1866302072 None] Acquiring lock "cinder-1a71ea0b-de2b-456c-8e5e-102141bfc676-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:34:14 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8e373931-9a8b-4252-b7aa-1f808f895622 tempest-ProjectMemberTests-1866302072 None] Lock "cinder-1a71ea0b-de2b-456c-8e5e-102141bfc676-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:34:14 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8e373931-9a8b-4252-b7aa-1f808f895622 tempest-ProjectMemberTests-1866302072 None] Acquiring lock "cinder-quobyte-1a71ea0b-de2b-456c-8e5e-102141bfc676" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:34:14 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8e373931-9a8b-4252-b7aa-1f808f895622 tempest-ProjectMemberTests-1866302072 None] Lock "cinder-quobyte-1a71ea0b-de2b-456c-8e5e-102141bfc676" acquired by "delete_volume" :: waited 0.015s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:34:14 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc9d592c-7ec2-4e7b-bd45-d8203d89f01f]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:34:14 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8e373931-9a8b-4252-b7aa-1f808f895622 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1a71ea0b-de2b-456c-8e5e-102141bfc676 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:14 devstack sudo[108062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1a71ea0b-de2b-456c-8e5e-102141bfc676
Jul 03 01:34:14 devstack sudo[108062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:15 devstack sudo[108062]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8e373931-9a8b-4252-b7aa-1f808f895622 tempest-ProjectMemberTests-1866302072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1a71ea0b-de2b-456c-8e5e-102141bfc676" returned: 0 in 0.725s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:15 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8e373931-9a8b-4252-b7aa-1f808f895622 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1a71ea0b-de2b-456c-8e5e-102141bfc676 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:15 devstack sudo[108067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1a71ea0b-de2b-456c-8e5e-102141bfc676
Jul 03 01:34:15 devstack sudo[108067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:16 devstack sudo[108067]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8e373931-9a8b-4252-b7aa-1f808f895622 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1a71ea0b-de2b-456c-8e5e-102141bfc676" returned: 0 in 0.625s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:16 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8e373931-9a8b-4252-b7aa-1f808f895622 tempest-ProjectMemberTests-1866302072 None] Lock "cinder-quobyte-1a71ea0b-de2b-456c-8e5e-102141bfc676" released by "delete_volume" :: held 1.401s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:34:16 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-8e373931-9a8b-4252-b7aa-1f808f895622 tempest-ProjectMemberTests-1866302072 None] Created reservations ['e0e4b2f6-a461-43a2-bf40-68f3ef9d1158', '2cde6fd0-8ad9-4ead-8b08-042be1faee82', '5dbd3224-6768-4eef-88ee-9258968b97fe', 'c2d6e8e0-155e-4b8f-ba84-f71904bb594e'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:34:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-8e373931-9a8b-4252-b7aa-1f808f895622 tempest-ProjectMemberTests-1866302072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:34:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-8e373931-9a8b-4252-b7aa-1f808f895622 tempest-ProjectMemberTests-1866302072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:34:16 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-8e373931-9a8b-4252-b7aa-1f808f895622 tempest-ProjectMemberTests-1866302072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:34:16 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-8e373931-9a8b-4252-b7aa-1f808f895622 tempest-ProjectMemberTests-1866302072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:34:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-8e373931-9a8b-4252-b7aa-1f808f895622 tempest-ProjectMemberTests-1866302072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:34:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8e373931-9a8b-4252-b7aa-1f808f895622 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:16 devstack sudo[108070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:34:16 devstack sudo[108070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:16 devstack sudo[108070]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:16 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-8e373931-9a8b-4252-b7aa-1f808f895622 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.639s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:16 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-8e373931-9a8b-4252-b7aa-1f808f895622 tempest-ProjectMemberTests-1866302072 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:34:16 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-8e373931-9a8b-4252-b7aa-1f808f895622 tempest-ProjectMemberTests-1866302072 None] Deleted volume successfully.
Jul 03 01:34:16 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-8e373931-9a8b-4252-b7aa-1f808f895622 tempest-ProjectMemberTests-1866302072 None] Lock "cinder-1a71ea0b-de2b-456c-8e5e-102141bfc676-delete_volume" released by "delete_volume" :: held 2.215s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:34:17 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-430cfabb-d979-42bb-92da-da9f3a1a3e35 tempest-ProjectMemberTests-1866302072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:34:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-430cfabb-d979-42bb-92da-da9f3a1a3e35 tempest-ProjectMemberTests-1866302072 None] Flow 'volume_create_manager' (b3b2ce0a-b2f6-42d5-98e5-ab525dfbe652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:34:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-430cfabb-d979-42bb-92da-da9f3a1a3e35 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8d89590-7bcb-46c1-a2a4-1726b4b1a4b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:34:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-430cfabb-d979-42bb-92da-da9f3a1a3e35 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8d89590-7bcb-46c1-a2a4-1726b4b1a4b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:34:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-696157471',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31d5b00c-b45e-46c5-b913-5e6d9e4c515a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16429f2745354b0591f4044f3a99b9fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:34:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:34:17Z,use_quota=True,user_id='31dd51f2dcdd4724a4c6b78cb80e6d8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:34:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-430cfabb-d979-42bb-92da-da9f3a1a3e35 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cb57173-5ef7-46ae-97b9-eb0d7b5ceb00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:34:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-430cfabb-d979-42bb-92da-da9f3a1a3e35 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cb57173-5ef7-46ae-97b9-eb0d7b5ceb00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:34:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-430cfabb-d979-42bb-92da-da9f3a1a3e35 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14bdd605-4055-44a7-a3c7-2bde5bccf713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:34:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-430cfabb-d979-42bb-92da-da9f3a1a3e35 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14bdd605-4055-44a7-a3c7-2bde5bccf713) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31d5b00c-b45e-46c5-b913-5e6d9e4c515a', 'volume_name': 'volume-31d5b00c-b45e-46c5-b913-5e6d9e4c515a', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:34:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-430cfabb-d979-42bb-92da-da9f3a1a3e35 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaef2e11-e0f7-482e-be83-eac6827199cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:34:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-430cfabb-d979-42bb-92da-da9f3a1a3e35 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaef2e11-e0f7-482e-be83-eac6827199cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:34:17 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-430cfabb-d979-42bb-92da-da9f3a1a3e35 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c355fc7a-d3a2-4ff3-9e8d-5ebc33cc7adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:34:17 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-430cfabb-d979-42bb-92da-da9f3a1a3e35 tempest-ProjectMemberTests-1866302072 None] Volume 31d5b00c-b45e-46c5-b913-5e6d9e4c515a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31d5b00c-b45e-46c5-b913-5e6d9e4c515a', 'volume_size': 1}
Jul 03 01:34:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-430cfabb-d979-42bb-92da-da9f3a1a3e35 tempest-ProjectMemberTests-1866302072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:34:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-430cfabb-d979-42bb-92da-da9f3a1a3e35 tempest-ProjectMemberTests-1866302072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:34:17 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-430cfabb-d979-42bb-92da-da9f3a1a3e35 tempest-ProjectMemberTests-1866302072 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:34:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-696157471',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31d5b00c-b45e-46c5-b913-5e6d9e4c515a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16429f2745354b0591f4044f3a99b9fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:34:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:34:17Z,use_quota=True,user_id='31dd51f2dcdd4724a4c6b78cb80e6d8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:34:17 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-430cfabb-d979-42bb-92da-da9f3a1a3e35 tempest-ProjectMemberTests-1866302072 None] Creating volume 31d5b00c-b45e-46c5-b913-5e6d9e4c515a {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:34:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-430cfabb-d979-42bb-92da-da9f3a1a3e35 tempest-ProjectMemberTests-1866302072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:34:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-430cfabb-d979-42bb-92da-da9f3a1a3e35 tempest-ProjectMemberTests-1866302072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:34:17 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-430cfabb-d979-42bb-92da-da9f3a1a3e35 tempest-ProjectMemberTests-1866302072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:34:17 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-430cfabb-d979-42bb-92da-da9f3a1a3e35 tempest-ProjectMemberTests-1866302072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:34:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-430cfabb-d979-42bb-92da-da9f3a1a3e35 tempest-ProjectMemberTests-1866302072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:34:17 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-430cfabb-d979-42bb-92da-da9f3a1a3e35 tempest-ProjectMemberTests-1866302072 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:34:17 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-430cfabb-d979-42bb-92da-da9f3a1a3e35 tempest-ProjectMemberTests-1866302072 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:34:17 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-430cfabb-d979-42bb-92da-da9f3a1a3e35 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-31d5b00c-b45e-46c5-b913-5e6d9e4c515a 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:17 devstack sudo[108073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-31d5b00c-b45e-46c5-b913-5e6d9e4c515a 1073741824
Jul 03 01:34:17 devstack sudo[108073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:18 devstack sudo[108073]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-430cfabb-d979-42bb-92da-da9f3a1a3e35 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-31d5b00c-b45e-46c5-b913-5e6d9e4c515a 1073741824" returned: 0 in 0.802s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-430cfabb-d979-42bb-92da-da9f3a1a3e35 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-31d5b00c-b45e-46c5-b913-5e6d9e4c515a {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:18 devstack sudo[108081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-31d5b00c-b45e-46c5-b913-5e6d9e4c515a
Jul 03 01:34:18 devstack sudo[108081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:18 devstack sudo[108081]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-430cfabb-d979-42bb-92da-da9f3a1a3e35 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-31d5b00c-b45e-46c5-b913-5e6d9e4c515a" returned: 0 in 0.611s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:18 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-430cfabb-d979-42bb-92da-da9f3a1a3e35 tempest-ProjectMemberTests-1866302072 None] <== create_volume: return (1463ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:34:18 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-430cfabb-d979-42bb-92da-da9f3a1a3e35 tempest-ProjectMemberTests-1866302072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.465s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:34:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-430cfabb-d979-42bb-92da-da9f3a1a3e35 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c355fc7a-d3a2-4ff3-9e8d-5ebc33cc7adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31d5b00c-b45e-46c5-b913-5e6d9e4c515a', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:34:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-430cfabb-d979-42bb-92da-da9f3a1a3e35 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e70e7bc-1802-445f-b726-165fa5b63dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:34:18 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-430cfabb-d979-42bb-92da-da9f3a1a3e35 tempest-ProjectMemberTests-1866302072 None] Volume volume-31d5b00c-b45e-46c5-b913-5e6d9e4c515a (31d5b00c-b45e-46c5-b913-5e6d9e4c515a): created successfully
Jul 03 01:34:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-430cfabb-d979-42bb-92da-da9f3a1a3e35 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e70e7bc-1802-445f-b726-165fa5b63dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:34:18 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-430cfabb-d979-42bb-92da-da9f3a1a3e35 tempest-ProjectMemberTests-1866302072 None] Flow 'volume_create_manager' (b3b2ce0a-b2f6-42d5-98e5-ab525dfbe652) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:34:18 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-430cfabb-d979-42bb-92da-da9f3a1a3e35 tempest-ProjectMemberTests-1866302072 None] Created volume successfully.
Jul 03 01:34:19 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-73b1e100-e48c-4d01-abd0-5f9aa664378c tempest-ProjectMemberTests-1866302072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:34:19 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-73b1e100-e48c-4d01-abd0-5f9aa664378c tempest-ProjectMemberTests-1866302072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:34:19 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-73b1e100-e48c-4d01-abd0-5f9aa664378c tempest-ProjectMemberTests-1866302072 None] Creating offline snapshot 2ce9d4ee-70bd-4cb6-93e4-0cf13bbcff4e of volume 31d5b00c-b45e-46c5-b913-5e6d9e4c515a {{(pid=86891) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 01:34:19 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d5a9d8-5fb9-49cd-84f6-128e407b9187]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:34:19 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-73b1e100-e48c-4d01-abd0-5f9aa664378c tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-31d5b00c-b45e-46c5-b913-5e6d9e4c515a {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:19 devstack sudo[108085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-31d5b00c-b45e-46c5-b913-5e6d9e4c515a
Jul 03 01:34:19 devstack sudo[108085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:20 devstack sudo[108085]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-73b1e100-e48c-4d01-abd0-5f9aa664378c tempest-ProjectMemberTests-1866302072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-31d5b00c-b45e-46c5-b913-5e6d9e4c515a" returned: 0 in 0.728s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:20 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-73b1e100-e48c-4d01-abd0-5f9aa664378c tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-31d5b00c-b45e-46c5-b913-5e6d9e4c515a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-31d5b00c-b45e-46c5-b913-5e6d9e4c515a.2ce9d4ee-70bd-4cb6-93e4-0cf13bbcff4e 1G {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:20 devstack sudo[108090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-31d5b00c-b45e-46c5-b913-5e6d9e4c515a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-31d5b00c-b45e-46c5-b913-5e6d9e4c515a.2ce9d4ee-70bd-4cb6-93e4-0cf13bbcff4e 1G
Jul 03 01:34:20 devstack sudo[108090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:21 devstack sudo[108090]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-73b1e100-e48c-4d01-abd0-5f9aa664378c tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-31d5b00c-b45e-46c5-b913-5e6d9e4c515a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-31d5b00c-b45e-46c5-b913-5e6d9e4c515a.2ce9d4ee-70bd-4cb6-93e4-0cf13bbcff4e 1G" returned: 0 in 0.754s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-73b1e100-e48c-4d01-abd0-5f9aa664378c tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31d5b00c-b45e-46c5-b913-5e6d9e4c515a -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-31d5b00c-b45e-46c5-b913-5e6d9e4c515a.2ce9d4ee-70bd-4cb6-93e4-0cf13bbcff4e {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:21 devstack sudo[108097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31d5b00c-b45e-46c5-b913-5e6d9e4c515a -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-31d5b00c-b45e-46c5-b913-5e6d9e4c515a.2ce9d4ee-70bd-4cb6-93e4-0cf13bbcff4e
Jul 03 01:34:21 devstack sudo[108097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:21 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-994ac3bf-982b-41a9-b52a-2a7de168f779 tempest-ProjectReaderTests-812849349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:34:21 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-994ac3bf-982b-41a9-b52a-2a7de168f779 tempest-ProjectReaderTests-812849349 None] Flow 'volume_create_manager' (0dc567f2-f70a-49ee-9259-48bf25aa3e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:34:21 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-994ac3bf-982b-41a9-b52a-2a7de168f779 tempest-ProjectReaderTests-812849349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10b1c630-7c5a-4994-a7f3-f0338d77a723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:34:21 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-994ac3bf-982b-41a9-b52a-2a7de168f779 tempest-ProjectReaderTests-812849349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10b1c630-7c5a-4994-a7f3-f0338d77a723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:34:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1506623943',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2acb82a-c3d5-4f17-b2dc-c6f2619ea682,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5434f12e1ba472a853c0eeeee49097f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:34:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:34:22Z,use_quota=True,user_id='8473987273274ccf818181429aafb11a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:34:21 devstack sudo[108097]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:21 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-994ac3bf-982b-41a9-b52a-2a7de168f779 tempest-ProjectReaderTests-812849349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7039c0d2-312c-452c-a696-57f4de4f602c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:34:21 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-994ac3bf-982b-41a9-b52a-2a7de168f779 tempest-ProjectReaderTests-812849349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7039c0d2-312c-452c-a696-57f4de4f602c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:34:21 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-994ac3bf-982b-41a9-b52a-2a7de168f779 tempest-ProjectReaderTests-812849349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d28f24cc-ffc5-4ac7-91de-fc0b0c644b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:34:21 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-994ac3bf-982b-41a9-b52a-2a7de168f779 tempest-ProjectReaderTests-812849349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d28f24cc-ffc5-4ac7-91de-fc0b0c644b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2acb82a-c3d5-4f17-b2dc-c6f2619ea682', 'volume_name': 'volume-e2acb82a-c3d5-4f17-b2dc-c6f2619ea682', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:34:21 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-994ac3bf-982b-41a9-b52a-2a7de168f779 tempest-ProjectReaderTests-812849349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d3a3163-8563-4138-9879-35c346138d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:34:21 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-994ac3bf-982b-41a9-b52a-2a7de168f779 tempest-ProjectReaderTests-812849349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d3a3163-8563-4138-9879-35c346138d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:34:21 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-994ac3bf-982b-41a9-b52a-2a7de168f779 tempest-ProjectReaderTests-812849349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a85e416-ef2a-4b8d-a00d-7ddd05526d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:34:21 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-994ac3bf-982b-41a9-b52a-2a7de168f779 tempest-ProjectReaderTests-812849349 None] Volume e2acb82a-c3d5-4f17-b2dc-c6f2619ea682: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2acb82a-c3d5-4f17-b2dc-c6f2619ea682', 'volume_size': 1}
Jul 03 01:34:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-994ac3bf-982b-41a9-b52a-2a7de168f779 tempest-ProjectReaderTests-812849349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:34:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-73b1e100-e48c-4d01-abd0-5f9aa664378c tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31d5b00c-b45e-46c5-b913-5e6d9e4c515a -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-31d5b00c-b45e-46c5-b913-5e6d9e4c515a.2ce9d4ee-70bd-4cb6-93e4-0cf13bbcff4e" returned: 0 in 0.766s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:21 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-73b1e100-e48c-4d01-abd0-5f9aa664378c tempest-ProjectMemberTests-1866302072 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-31d5b00c-b45e-46c5-b913-5e6d9e4c515a.2ce9d4ee-70bd-4cb6-93e4-0cf13bbcff4e is being set with open permissions: ugo+rw
Jul 03 01:34:21 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-73b1e100-e48c-4d01-abd0-5f9aa664378c tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-31d5b00c-b45e-46c5-b913-5e6d9e4c515a.2ce9d4ee-70bd-4cb6-93e4-0cf13bbcff4e {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:21 devstack sudo[108103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-31d5b00c-b45e-46c5-b913-5e6d9e4c515a.2ce9d4ee-70bd-4cb6-93e4-0cf13bbcff4e
Jul 03 01:34:21 devstack sudo[108103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:22 devstack sudo[108103]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:22 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-73b1e100-e48c-4d01-abd0-5f9aa664378c tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-31d5b00c-b45e-46c5-b913-5e6d9e4c515a.2ce9d4ee-70bd-4cb6-93e4-0cf13bbcff4e" returned: 0 in 0.617s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:22 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-73b1e100-e48c-4d01-abd0-5f9aa664378c tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-31d5b00c-b45e-46c5-b913-5e6d9e4c515a.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:22 devstack sudo[108106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-31d5b00c-b45e-46c5-b913-5e6d9e4c515a.info
Jul 03 01:34:22 devstack sudo[108106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:23 devstack sudo[108106]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-73b1e100-e48c-4d01-abd0-5f9aa664378c tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-31d5b00c-b45e-46c5-b913-5e6d9e4c515a.info" returned: 0 in 0.633s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:23 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-73b1e100-e48c-4d01-abd0-5f9aa664378c tempest-ProjectMemberTests-1866302072 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-31d5b00c-b45e-46c5-b913-5e6d9e4c515a.info is being set with open permissions: ugo+rw
Jul 03 01:34:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-73b1e100-e48c-4d01-abd0-5f9aa664378c tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-31d5b00c-b45e-46c5-b913-5e6d9e4c515a.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:23 devstack sudo[108110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-31d5b00c-b45e-46c5-b913-5e6d9e4c515a.info
Jul 03 01:34:23 devstack sudo[108110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:23 devstack sudo[108110]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-73b1e100-e48c-4d01-abd0-5f9aa664378c tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-31d5b00c-b45e-46c5-b913-5e6d9e4c515a.info" returned: 0 in 0.629s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-73b1e100-e48c-4d01-abd0-5f9aa664378c tempest-ProjectMemberTests-1866302072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.197s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:34:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-994ac3bf-982b-41a9-b52a-2a7de168f779 tempest-ProjectReaderTests-812849349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.925s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:34:23 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-994ac3bf-982b-41a9-b52a-2a7de168f779 tempest-ProjectReaderTests-812849349 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:34:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1506623943',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2acb82a-c3d5-4f17-b2dc-c6f2619ea682,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5434f12e1ba472a853c0eeeee49097f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:34:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:34:22Z,use_quota=True,user_id='8473987273274ccf818181429aafb11a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:34:23 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-994ac3bf-982b-41a9-b52a-2a7de168f779 tempest-ProjectReaderTests-812849349 None] Creating volume e2acb82a-c3d5-4f17-b2dc-c6f2619ea682 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:34:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-994ac3bf-982b-41a9-b52a-2a7de168f779 tempest-ProjectReaderTests-812849349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:34:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-994ac3bf-982b-41a9-b52a-2a7de168f779 tempest-ProjectReaderTests-812849349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:34:23 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-994ac3bf-982b-41a9-b52a-2a7de168f779 tempest-ProjectReaderTests-812849349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:34:23 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-994ac3bf-982b-41a9-b52a-2a7de168f779 tempest-ProjectReaderTests-812849349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:34:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-994ac3bf-982b-41a9-b52a-2a7de168f779 tempest-ProjectReaderTests-812849349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:34:23 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-994ac3bf-982b-41a9-b52a-2a7de168f779 tempest-ProjectReaderTests-812849349 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:34:23 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-994ac3bf-982b-41a9-b52a-2a7de168f779 tempest-ProjectReaderTests-812849349 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:34:23 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-994ac3bf-982b-41a9-b52a-2a7de168f779 tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2acb82a-c3d5-4f17-b2dc-c6f2619ea682 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:23 devstack sudo[108113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2acb82a-c3d5-4f17-b2dc-c6f2619ea682 1073741824
Jul 03 01:34:23 devstack sudo[108113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:23 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-73b1e100-e48c-4d01-abd0-5f9aa664378c tempest-ProjectMemberTests-1866302072 None] Create snapshot completed successfully
Jul 03 01:34:24 devstack sudo[108113]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-994ac3bf-982b-41a9-b52a-2a7de168f779 tempest-ProjectReaderTests-812849349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2acb82a-c3d5-4f17-b2dc-c6f2619ea682 1073741824" returned: 0 in 0.802s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-994ac3bf-982b-41a9-b52a-2a7de168f779 tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2acb82a-c3d5-4f17-b2dc-c6f2619ea682 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:24 devstack sudo[108118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2acb82a-c3d5-4f17-b2dc-c6f2619ea682
Jul 03 01:34:24 devstack sudo[108118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:24 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d5cd9a8c-dfb7-472f-ae3c-16a485fd1bac tempest-ProjectMemberTests-1866302072 None] Acquiring lock "cinder-2ce9d4ee-70bd-4cb6-93e4-0cf13bbcff4e-delete_snapshot" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:34:24 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d5cd9a8c-dfb7-472f-ae3c-16a485fd1bac tempest-ProjectMemberTests-1866302072 None] Lock "cinder-2ce9d4ee-70bd-4cb6-93e4-0cf13bbcff4e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:34:24 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d5cd9a8c-dfb7-472f-ae3c-16a485fd1bac tempest-ProjectMemberTests-1866302072 None] Acquiring lock "cinder-quobyte-31d5b00c-b45e-46c5-b913-5e6d9e4c515a" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:34:24 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d5cd9a8c-dfb7-472f-ae3c-16a485fd1bac tempest-ProjectMemberTests-1866302072 None] Lock "cinder-quobyte-31d5b00c-b45e-46c5-b913-5e6d9e4c515a" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:34:24 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d5cd9a8c-dfb7-472f-ae3c-16a485fd1bac tempest-ProjectMemberTests-1866302072 None] Acquiring lock "cinder-quobyte-2ce9d4ee-70bd-4cb6-93e4-0cf13bbcff4e" by "_delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:34:24 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d5cd9a8c-dfb7-472f-ae3c-16a485fd1bac tempest-ProjectMemberTests-1866302072 None] Lock "cinder-quobyte-2ce9d4ee-70bd-4cb6-93e4-0cf13bbcff4e" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:34:24 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-d5cd9a8c-dfb7-472f-ae3c-16a485fd1bac tempest-ProjectMemberTests-1866302072 None] Deleting offline snapshot 2ce9d4ee-70bd-4cb6-93e4-0cf13bbcff4e of volume 31d5b00c-b45e-46c5-b913-5e6d9e4c515a {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 01:34:24 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-d5cd9a8c-dfb7-472f-ae3c-16a485fd1bac tempest-ProjectMemberTests-1866302072 None] snapshot_file for this snap is: volume-31d5b00c-b45e-46c5-b913-5e6d9e4c515a.2ce9d4ee-70bd-4cb6-93e4-0cf13bbcff4e {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 01:34:24 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[83555ad5-d13b-482b-af8a-1c3734576b42]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:34:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d5cd9a8c-dfb7-472f-ae3c-16a485fd1bac tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-31d5b00c-b45e-46c5-b913-5e6d9e4c515a.2ce9d4ee-70bd-4cb6-93e4-0cf13bbcff4e {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:24 devstack sudo[108120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-31d5b00c-b45e-46c5-b913-5e6d9e4c515a.2ce9d4ee-70bd-4cb6-93e4-0cf13bbcff4e
Jul 03 01:34:24 devstack sudo[108120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:25 devstack sudo[108118]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-994ac3bf-982b-41a9-b52a-2a7de168f779 tempest-ProjectReaderTests-812849349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2acb82a-c3d5-4f17-b2dc-c6f2619ea682" returned: 0 in 0.643s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:25 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-994ac3bf-982b-41a9-b52a-2a7de168f779 tempest-ProjectReaderTests-812849349 None] <== create_volume: return (1485ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:34:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-994ac3bf-982b-41a9-b52a-2a7de168f779 tempest-ProjectReaderTests-812849349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.488s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:34:25 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-994ac3bf-982b-41a9-b52a-2a7de168f779 tempest-ProjectReaderTests-812849349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a85e416-ef2a-4b8d-a00d-7ddd05526d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2acb82a-c3d5-4f17-b2dc-c6f2619ea682', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:34:25 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-994ac3bf-982b-41a9-b52a-2a7de168f779 tempest-ProjectReaderTests-812849349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b2cbce0-0299-4a55-a5a8-5a07817e1d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:34:25 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-994ac3bf-982b-41a9-b52a-2a7de168f779 tempest-ProjectReaderTests-812849349 None] Volume volume-e2acb82a-c3d5-4f17-b2dc-c6f2619ea682 (e2acb82a-c3d5-4f17-b2dc-c6f2619ea682): created successfully
Jul 03 01:34:25 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-994ac3bf-982b-41a9-b52a-2a7de168f779 tempest-ProjectReaderTests-812849349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b2cbce0-0299-4a55-a5a8-5a07817e1d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:34:25 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-994ac3bf-982b-41a9-b52a-2a7de168f779 tempest-ProjectReaderTests-812849349 None] Flow 'volume_create_manager' (0dc567f2-f70a-49ee-9259-48bf25aa3e02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:34:25 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-994ac3bf-982b-41a9-b52a-2a7de168f779 tempest-ProjectReaderTests-812849349 None] Created volume successfully.
Jul 03 01:34:25 devstack sudo[108120]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d5cd9a8c-dfb7-472f-ae3c-16a485fd1bac tempest-ProjectMemberTests-1866302072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-31d5b00c-b45e-46c5-b913-5e6d9e4c515a.2ce9d4ee-70bd-4cb6-93e4-0cf13bbcff4e" returned: 0 in 0.742s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:25 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-d5cd9a8c-dfb7-472f-ae3c-16a485fd1bac tempest-ProjectMemberTests-1866302072 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31d5b00c-b45e-46c5-b913-5e6d9e4c515a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:34:25 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6670af-7384-4d38-844b-dfae62752c79]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:34:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d5cd9a8c-dfb7-472f-ae3c-16a485fd1bac tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-31d5b00c-b45e-46c5-b913-5e6d9e4c515a {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:25 devstack sudo[108126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-31d5b00c-b45e-46c5-b913-5e6d9e4c515a
Jul 03 01:34:25 devstack sudo[108126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:26 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b66bedc0-389a-4c41-9c05-6f03c1dba74f tempest-ProjectReaderTests-812849349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:34:26 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b66bedc0-389a-4c41-9c05-6f03c1dba74f tempest-ProjectReaderTests-812849349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:34:26 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-b66bedc0-389a-4c41-9c05-6f03c1dba74f tempest-ProjectReaderTests-812849349 None] Creating offline snapshot 800031a7-0d64-4013-91b3-4a8fde255862 of volume e2acb82a-c3d5-4f17-b2dc-c6f2619ea682 {{(pid=86891) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 01:34:26 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[107a5ed8-f2f6-43a0-9417-ac29d52b9b7e]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:34:26 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b66bedc0-389a-4c41-9c05-6f03c1dba74f tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2acb82a-c3d5-4f17-b2dc-c6f2619ea682 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:26 devstack sudo[108128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2acb82a-c3d5-4f17-b2dc-c6f2619ea682
Jul 03 01:34:26 devstack sudo[108128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:26 devstack sudo[108126]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:26 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d5cd9a8c-dfb7-472f-ae3c-16a485fd1bac tempest-ProjectMemberTests-1866302072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-31d5b00c-b45e-46c5-b913-5e6d9e4c515a" returned: 0 in 0.742s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:26 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d5cd9a8c-dfb7-472f-ae3c-16a485fd1bac tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-31d5b00c-b45e-46c5-b913-5e6d9e4c515a.2ce9d4ee-70bd-4cb6-93e4-0cf13bbcff4e {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:26 devstack sudo[108133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-31d5b00c-b45e-46c5-b913-5e6d9e4c515a.2ce9d4ee-70bd-4cb6-93e4-0cf13bbcff4e
Jul 03 01:34:26 devstack sudo[108133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:26 devstack sudo[108128]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:26 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b66bedc0-389a-4c41-9c05-6f03c1dba74f tempest-ProjectReaderTests-812849349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2acb82a-c3d5-4f17-b2dc-c6f2619ea682" returned: 0 in 0.753s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:26 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b66bedc0-389a-4c41-9c05-6f03c1dba74f tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2acb82a-c3d5-4f17-b2dc-c6f2619ea682,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2acb82a-c3d5-4f17-b2dc-c6f2619ea682.800031a7-0d64-4013-91b3-4a8fde255862 1G {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:26 devstack sudo[108138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2acb82a-c3d5-4f17-b2dc-c6f2619ea682,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2acb82a-c3d5-4f17-b2dc-c6f2619ea682.800031a7-0d64-4013-91b3-4a8fde255862 1G
Jul 03 01:34:26 devstack sudo[108138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:27 devstack sudo[108133]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d5cd9a8c-dfb7-472f-ae3c-16a485fd1bac tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-31d5b00c-b45e-46c5-b913-5e6d9e4c515a.2ce9d4ee-70bd-4cb6-93e4-0cf13bbcff4e" returned: 0 in 0.697s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d5cd9a8c-dfb7-472f-ae3c-16a485fd1bac tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-31d5b00c-b45e-46c5-b913-5e6d9e4c515a.2ce9d4ee-70bd-4cb6-93e4-0cf13bbcff4e {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:27 devstack sudo[108143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-31d5b00c-b45e-46c5-b913-5e6d9e4c515a.2ce9d4ee-70bd-4cb6-93e4-0cf13bbcff4e
Jul 03 01:34:27 devstack sudo[108143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:27 devstack sudo[108138]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b66bedc0-389a-4c41-9c05-6f03c1dba74f tempest-ProjectReaderTests-812849349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2acb82a-c3d5-4f17-b2dc-c6f2619ea682,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2acb82a-c3d5-4f17-b2dc-c6f2619ea682.800031a7-0d64-4013-91b3-4a8fde255862 1G" returned: 0 in 0.783s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b66bedc0-389a-4c41-9c05-6f03c1dba74f tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2acb82a-c3d5-4f17-b2dc-c6f2619ea682 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2acb82a-c3d5-4f17-b2dc-c6f2619ea682.800031a7-0d64-4013-91b3-4a8fde255862 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:27 devstack sudo[108149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2acb82a-c3d5-4f17-b2dc-c6f2619ea682 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2acb82a-c3d5-4f17-b2dc-c6f2619ea682.800031a7-0d64-4013-91b3-4a8fde255862
Jul 03 01:34:27 devstack sudo[108149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:27 devstack sudo[108143]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d5cd9a8c-dfb7-472f-ae3c-16a485fd1bac tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-31d5b00c-b45e-46c5-b913-5e6d9e4c515a.2ce9d4ee-70bd-4cb6-93e4-0cf13bbcff4e" returned: 0 in 0.625s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:27 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d5cd9a8c-dfb7-472f-ae3c-16a485fd1bac tempest-ProjectMemberTests-1866302072 None] Lock "cinder-quobyte-2ce9d4ee-70bd-4cb6-93e4-0cf13bbcff4e" released by "_delete_snapshot" :: held 2.894s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:34:27 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d5cd9a8c-dfb7-472f-ae3c-16a485fd1bac tempest-ProjectMemberTests-1866302072 None] Lock "cinder-quobyte-31d5b00c-b45e-46c5-b913-5e6d9e4c515a" released by "delete_snapshot" :: held 2.919s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:34:27 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-d5cd9a8c-dfb7-472f-ae3c-16a485fd1bac tempest-ProjectMemberTests-1866302072 None] Created reservations ['ad9ab78a-6bd6-4cc1-99b1-231a8dba80cd', '59127613-2141-4e9d-8aa4-8be295e1d291', '89046650-8a50-43da-a84a-80ac5435e7f5', '0f0648fd-dea5-4428-8617-22a58d498abf'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:34:27 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-d5cd9a8c-dfb7-472f-ae3c-16a485fd1bac tempest-ProjectMemberTests-1866302072 None] Delete snapshot completed successfully.
Jul 03 01:34:27 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-d5cd9a8c-dfb7-472f-ae3c-16a485fd1bac tempest-ProjectMemberTests-1866302072 None] Lock "cinder-2ce9d4ee-70bd-4cb6-93e4-0cf13bbcff4e-delete_snapshot" released by "delete_snapshot" :: held 3.056s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:34:27 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-cab82375-7778-422a-ad4e-76da14ed62fa tempest-ProjectMemberTests-1866302072 None] Acquiring lock "cinder-31d5b00c-b45e-46c5-b913-5e6d9e4c515a-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:34:27 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-cab82375-7778-422a-ad4e-76da14ed62fa tempest-ProjectMemberTests-1866302072 None] Lock "cinder-31d5b00c-b45e-46c5-b913-5e6d9e4c515a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:34:28 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-cab82375-7778-422a-ad4e-76da14ed62fa tempest-ProjectMemberTests-1866302072 None] Acquiring lock "cinder-quobyte-31d5b00c-b45e-46c5-b913-5e6d9e4c515a" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:34:28 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-cab82375-7778-422a-ad4e-76da14ed62fa tempest-ProjectMemberTests-1866302072 None] Lock "cinder-quobyte-31d5b00c-b45e-46c5-b913-5e6d9e4c515a" acquired by "delete_volume" :: waited 0.024s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:34:28 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[901fc1ae-865b-435d-a175-20335be79960]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:34:28 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-cab82375-7778-422a-ad4e-76da14ed62fa tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-31d5b00c-b45e-46c5-b913-5e6d9e4c515a {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:28 devstack sudo[108151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-31d5b00c-b45e-46c5-b913-5e6d9e4c515a
Jul 03 01:34:28 devstack sudo[108151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:28 devstack sudo[108149]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:28 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b66bedc0-389a-4c41-9c05-6f03c1dba74f tempest-ProjectReaderTests-812849349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2acb82a-c3d5-4f17-b2dc-c6f2619ea682 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2acb82a-c3d5-4f17-b2dc-c6f2619ea682.800031a7-0d64-4013-91b3-4a8fde255862" returned: 0 in 0.745s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:28 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-b66bedc0-389a-4c41-9c05-6f03c1dba74f tempest-ProjectReaderTests-812849349 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2acb82a-c3d5-4f17-b2dc-c6f2619ea682.800031a7-0d64-4013-91b3-4a8fde255862 is being set with open permissions: ugo+rw
Jul 03 01:34:28 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b66bedc0-389a-4c41-9c05-6f03c1dba74f tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2acb82a-c3d5-4f17-b2dc-c6f2619ea682.800031a7-0d64-4013-91b3-4a8fde255862 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:28 devstack sudo[108156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2acb82a-c3d5-4f17-b2dc-c6f2619ea682.800031a7-0d64-4013-91b3-4a8fde255862
Jul 03 01:34:28 devstack sudo[108156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:28 devstack sudo[108151]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:28 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-cab82375-7778-422a-ad4e-76da14ed62fa tempest-ProjectMemberTests-1866302072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-31d5b00c-b45e-46c5-b913-5e6d9e4c515a" returned: 0 in 0.771s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:28 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-cab82375-7778-422a-ad4e-76da14ed62fa tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-31d5b00c-b45e-46c5-b913-5e6d9e4c515a {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:28 devstack sudo[108162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-31d5b00c-b45e-46c5-b913-5e6d9e4c515a
Jul 03 01:34:28 devstack sudo[108162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:28 devstack sudo[108156]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:28 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b66bedc0-389a-4c41-9c05-6f03c1dba74f tempest-ProjectReaderTests-812849349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2acb82a-c3d5-4f17-b2dc-c6f2619ea682.800031a7-0d64-4013-91b3-4a8fde255862" returned: 0 in 0.627s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:28 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:SELECT=65,cinder:UPDATE=71,cinder:DELETE=5,cinder:INSERT=19 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:34:28 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b66bedc0-389a-4c41-9c05-6f03c1dba74f tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2acb82a-c3d5-4f17-b2dc-c6f2619ea682.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:29 devstack sudo[108165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2acb82a-c3d5-4f17-b2dc-c6f2619ea682.info
Jul 03 01:34:29 devstack sudo[108165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:29 devstack sudo[108162]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-cab82375-7778-422a-ad4e-76da14ed62fa tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-31d5b00c-b45e-46c5-b913-5e6d9e4c515a" returned: 0 in 0.629s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:29 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-cab82375-7778-422a-ad4e-76da14ed62fa tempest-ProjectMemberTests-1866302072 None] Lock "cinder-quobyte-31d5b00c-b45e-46c5-b913-5e6d9e4c515a" released by "delete_volume" :: held 1.464s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:34:29 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-cab82375-7778-422a-ad4e-76da14ed62fa tempest-ProjectMemberTests-1866302072 None] Created reservations ['7e0dc2ab-d924-407a-9021-ca5be1046626', '9849e678-b7bd-4995-9a6c-7be5a4eb353f', '89f9a2b9-cd58-4573-a252-44487d274f6c', '888166ed-be9e-4fc1-85cb-5beddb77be3d'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:34:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-cab82375-7778-422a-ad4e-76da14ed62fa tempest-ProjectMemberTests-1866302072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:34:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-cab82375-7778-422a-ad4e-76da14ed62fa tempest-ProjectMemberTests-1866302072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:34:29 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-cab82375-7778-422a-ad4e-76da14ed62fa tempest-ProjectMemberTests-1866302072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:34:29 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-cab82375-7778-422a-ad4e-76da14ed62fa tempest-ProjectMemberTests-1866302072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:34:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-cab82375-7778-422a-ad4e-76da14ed62fa tempest-ProjectMemberTests-1866302072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:34:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-cab82375-7778-422a-ad4e-76da14ed62fa tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:29 devstack sudo[108169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:34:29 devstack sudo[108169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:29 devstack sudo[108165]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b66bedc0-389a-4c41-9c05-6f03c1dba74f tempest-ProjectReaderTests-812849349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2acb82a-c3d5-4f17-b2dc-c6f2619ea682.info" returned: 0 in 0.662s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:29 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-b66bedc0-389a-4c41-9c05-6f03c1dba74f tempest-ProjectReaderTests-812849349 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2acb82a-c3d5-4f17-b2dc-c6f2619ea682.info is being set with open permissions: ugo+rw
Jul 03 01:34:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b66bedc0-389a-4c41-9c05-6f03c1dba74f tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2acb82a-c3d5-4f17-b2dc-c6f2619ea682.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:29 devstack sudo[108171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2acb82a-c3d5-4f17-b2dc-c6f2619ea682.info
Jul 03 01:34:29 devstack sudo[108171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:30 devstack sudo[108169]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-cab82375-7778-422a-ad4e-76da14ed62fa tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.650s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:30 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-cab82375-7778-422a-ad4e-76da14ed62fa tempest-ProjectMemberTests-1866302072 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:34:30 devstack sudo[108171]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:30 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-cab82375-7778-422a-ad4e-76da14ed62fa tempest-ProjectMemberTests-1866302072 None] Deleted volume successfully.
Jul 03 01:34:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b66bedc0-389a-4c41-9c05-6f03c1dba74f tempest-ProjectReaderTests-812849349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2acb82a-c3d5-4f17-b2dc-c6f2619ea682.info" returned: 0 in 0.636s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b66bedc0-389a-4c41-9c05-6f03c1dba74f tempest-ProjectReaderTests-812849349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.298s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:34:30 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-cab82375-7778-422a-ad4e-76da14ed62fa tempest-ProjectMemberTests-1866302072 None] Lock "cinder-31d5b00c-b45e-46c5-b913-5e6d9e4c515a-delete_volume" released by "delete_volume" :: held 2.366s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:34:30 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-b66bedc0-389a-4c41-9c05-6f03c1dba74f tempest-ProjectReaderTests-812849349 None] Create snapshot completed successfully
Jul 03 01:34:30 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-da638d06-df64-464c-9015-202d98216e10 tempest-ProjectMemberTests-1866302072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:34:30 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-da638d06-df64-464c-9015-202d98216e10 tempest-ProjectMemberTests-1866302072 None] Flow 'volume_create_manager' (f9cf3253-e581-4b27-8e66-c48fa87430e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:34:30 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-da638d06-df64-464c-9015-202d98216e10 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cba1adb1-011c-4f6e-a9fe-611659bdea91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:34:30 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-da638d06-df64-464c-9015-202d98216e10 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cba1adb1-011c-4f6e-a9fe-611659bdea91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:34:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1306448639',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d34396da-c8e6-4ebf-9559-afdfbae565ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16429f2745354b0591f4044f3a99b9fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:34:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:34:31Z,use_quota=True,user_id='31dd51f2dcdd4724a4c6b78cb80e6d8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:34:30 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-da638d06-df64-464c-9015-202d98216e10 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc46cbfb-2fc4-467d-8517-767ae36826c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:34:30 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-da638d06-df64-464c-9015-202d98216e10 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc46cbfb-2fc4-467d-8517-767ae36826c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:34:30 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-da638d06-df64-464c-9015-202d98216e10 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54d7142e-2f55-4ed3-948a-ffb28afc365d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:34:30 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-da638d06-df64-464c-9015-202d98216e10 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54d7142e-2f55-4ed3-948a-ffb28afc365d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd34396da-c8e6-4ebf-9559-afdfbae565ff', 'volume_name': 'volume-d34396da-c8e6-4ebf-9559-afdfbae565ff', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:34:30 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-da638d06-df64-464c-9015-202d98216e10 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d19fb4b7-e179-41c9-8472-10055761fcd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:34:30 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-da638d06-df64-464c-9015-202d98216e10 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d19fb4b7-e179-41c9-8472-10055761fcd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:34:30 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-da638d06-df64-464c-9015-202d98216e10 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01c9e81e-0440-4f8c-a9ca-91a73af546bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:34:30 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-da638d06-df64-464c-9015-202d98216e10 tempest-ProjectMemberTests-1866302072 None] Volume d34396da-c8e6-4ebf-9559-afdfbae565ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d34396da-c8e6-4ebf-9559-afdfbae565ff', 'volume_size': 1}
Jul 03 01:34:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-da638d06-df64-464c-9015-202d98216e10 tempest-ProjectMemberTests-1866302072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:34:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-da638d06-df64-464c-9015-202d98216e10 tempest-ProjectMemberTests-1866302072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:34:30 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-da638d06-df64-464c-9015-202d98216e10 tempest-ProjectMemberTests-1866302072 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:34:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1306448639',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d34396da-c8e6-4ebf-9559-afdfbae565ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16429f2745354b0591f4044f3a99b9fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:34:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:34:31Z,use_quota=True,user_id='31dd51f2dcdd4724a4c6b78cb80e6d8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:34:30 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-da638d06-df64-464c-9015-202d98216e10 tempest-ProjectMemberTests-1866302072 None] Creating volume d34396da-c8e6-4ebf-9559-afdfbae565ff {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:34:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-da638d06-df64-464c-9015-202d98216e10 tempest-ProjectMemberTests-1866302072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:34:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-da638d06-df64-464c-9015-202d98216e10 tempest-ProjectMemberTests-1866302072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:34:30 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-da638d06-df64-464c-9015-202d98216e10 tempest-ProjectMemberTests-1866302072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:34:30 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-da638d06-df64-464c-9015-202d98216e10 tempest-ProjectMemberTests-1866302072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:34:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-da638d06-df64-464c-9015-202d98216e10 tempest-ProjectMemberTests-1866302072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:34:30 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-da638d06-df64-464c-9015-202d98216e10 tempest-ProjectMemberTests-1866302072 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:34:30 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-da638d06-df64-464c-9015-202d98216e10 tempest-ProjectMemberTests-1866302072 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:34:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-da638d06-df64-464c-9015-202d98216e10 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d34396da-c8e6-4ebf-9559-afdfbae565ff 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:30 devstack sudo[108175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d34396da-c8e6-4ebf-9559-afdfbae565ff 1073741824
Jul 03 01:34:30 devstack sudo[108175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:31 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-9c0e6e0d-84ce-4a34-a82a-d55d15f8cf6b tempest-ProjectReaderTests-812849349 None] Acquiring lock "cinder-800031a7-0d64-4013-91b3-4a8fde255862-delete_snapshot" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:34:31 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-9c0e6e0d-84ce-4a34-a82a-d55d15f8cf6b tempest-ProjectReaderTests-812849349 None] Lock "cinder-800031a7-0d64-4013-91b3-4a8fde255862-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:34:31 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-9c0e6e0d-84ce-4a34-a82a-d55d15f8cf6b tempest-ProjectReaderTests-812849349 None] Acquiring lock "cinder-quobyte-e2acb82a-c3d5-4f17-b2dc-c6f2619ea682" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:34:31 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-9c0e6e0d-84ce-4a34-a82a-d55d15f8cf6b tempest-ProjectReaderTests-812849349 None] Lock "cinder-quobyte-e2acb82a-c3d5-4f17-b2dc-c6f2619ea682" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:34:31 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-9c0e6e0d-84ce-4a34-a82a-d55d15f8cf6b tempest-ProjectReaderTests-812849349 None] Acquiring lock "cinder-quobyte-800031a7-0d64-4013-91b3-4a8fde255862" by "_delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:34:31 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-9c0e6e0d-84ce-4a34-a82a-d55d15f8cf6b tempest-ProjectReaderTests-812849349 None] Lock "cinder-quobyte-800031a7-0d64-4013-91b3-4a8fde255862" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:34:31 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-9c0e6e0d-84ce-4a34-a82a-d55d15f8cf6b tempest-ProjectReaderTests-812849349 None] Deleting offline snapshot 800031a7-0d64-4013-91b3-4a8fde255862 of volume e2acb82a-c3d5-4f17-b2dc-c6f2619ea682 {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 01:34:31 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-9c0e6e0d-84ce-4a34-a82a-d55d15f8cf6b tempest-ProjectReaderTests-812849349 None] snapshot_file for this snap is: volume-e2acb82a-c3d5-4f17-b2dc-c6f2619ea682.800031a7-0d64-4013-91b3-4a8fde255862 {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 01:34:31 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[66610d8f-a58a-4d52-881b-bc53fb805f63]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:34:31 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9c0e6e0d-84ce-4a34-a82a-d55d15f8cf6b tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2acb82a-c3d5-4f17-b2dc-c6f2619ea682.800031a7-0d64-4013-91b3-4a8fde255862 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:31 devstack sudo[108180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2acb82a-c3d5-4f17-b2dc-c6f2619ea682.800031a7-0d64-4013-91b3-4a8fde255862
Jul 03 01:34:31 devstack sudo[108180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:31 devstack sudo[108175]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:31 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-da638d06-df64-464c-9015-202d98216e10 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d34396da-c8e6-4ebf-9559-afdfbae565ff 1073741824" returned: 0 in 0.839s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:31 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-da638d06-df64-464c-9015-202d98216e10 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d34396da-c8e6-4ebf-9559-afdfbae565ff {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:31 devstack sudo[108183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d34396da-c8e6-4ebf-9559-afdfbae565ff
Jul 03 01:34:31 devstack sudo[108183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:32 devstack sudo[108180]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9c0e6e0d-84ce-4a34-a82a-d55d15f8cf6b tempest-ProjectReaderTests-812849349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2acb82a-c3d5-4f17-b2dc-c6f2619ea682.800031a7-0d64-4013-91b3-4a8fde255862" returned: 0 in 0.775s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:32 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-9c0e6e0d-84ce-4a34-a82a-d55d15f8cf6b tempest-ProjectReaderTests-812849349 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2acb82a-c3d5-4f17-b2dc-c6f2619ea682(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:34:32 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[4853ae88-e8ce-4541-a9e8-ba88d91dd998]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:34:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9c0e6e0d-84ce-4a34-a82a-d55d15f8cf6b tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2acb82a-c3d5-4f17-b2dc-c6f2619ea682 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:32 devstack sudo[108183]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-da638d06-df64-464c-9015-202d98216e10 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d34396da-c8e6-4ebf-9559-afdfbae565ff" returned: 0 in 0.629s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:32 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-da638d06-df64-464c-9015-202d98216e10 tempest-ProjectMemberTests-1866302072 None] <== create_volume: return (1512ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:34:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-da638d06-df64-464c-9015-202d98216e10 tempest-ProjectMemberTests-1866302072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.514s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:34:32 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-da638d06-df64-464c-9015-202d98216e10 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01c9e81e-0440-4f8c-a9ca-91a73af546bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d34396da-c8e6-4ebf-9559-afdfbae565ff', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:34:32 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-da638d06-df64-464c-9015-202d98216e10 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da78d470-0d50-4be5-b34d-9af0343a2150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:34:32 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-da638d06-df64-464c-9015-202d98216e10 tempest-ProjectMemberTests-1866302072 None] Volume volume-d34396da-c8e6-4ebf-9559-afdfbae565ff (d34396da-c8e6-4ebf-9559-afdfbae565ff): created successfully
Jul 03 01:34:32 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-da638d06-df64-464c-9015-202d98216e10 tempest-ProjectMemberTests-1866302072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da78d470-0d50-4be5-b34d-9af0343a2150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:34:32 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-da638d06-df64-464c-9015-202d98216e10 tempest-ProjectMemberTests-1866302072 None] Flow 'volume_create_manager' (f9cf3253-e581-4b27-8e66-c48fa87430e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:34:32 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-da638d06-df64-464c-9015-202d98216e10 tempest-ProjectMemberTests-1866302072 None] Created volume successfully.
Jul 03 01:34:32 devstack sudo[108189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2acb82a-c3d5-4f17-b2dc-c6f2619ea682
Jul 03 01:34:32 devstack sudo[108189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-c47a9777-5ddb-408b-95ce-89cb5f80b74e tempest-ProjectMemberTests-1866302072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:34:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-c47a9777-5ddb-408b-95ce-89cb5f80b74e tempest-ProjectMemberTests-1866302072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:34:32 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-c47a9777-5ddb-408b-95ce-89cb5f80b74e tempest-ProjectMemberTests-1866302072 None] Creating offline snapshot 863ecf4f-f9a1-48fa-b5b2-37bd18761c88 of volume d34396da-c8e6-4ebf-9559-afdfbae565ff {{(pid=86891) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 01:34:32 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcdefeb6-f610-48f7-b82f-ddd05016ffff]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:34:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c47a9777-5ddb-408b-95ce-89cb5f80b74e tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d34396da-c8e6-4ebf-9559-afdfbae565ff {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:33 devstack sudo[108189]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9c0e6e0d-84ce-4a34-a82a-d55d15f8cf6b tempest-ProjectReaderTests-812849349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2acb82a-c3d5-4f17-b2dc-c6f2619ea682" returned: 0 in 0.798s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9c0e6e0d-84ce-4a34-a82a-d55d15f8cf6b tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2acb82a-c3d5-4f17-b2dc-c6f2619ea682.800031a7-0d64-4013-91b3-4a8fde255862 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:33 devstack sudo[108195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2acb82a-c3d5-4f17-b2dc-c6f2619ea682.800031a7-0d64-4013-91b3-4a8fde255862
Jul 03 01:34:33 devstack sudo[108194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d34396da-c8e6-4ebf-9559-afdfbae565ff
Jul 03 01:34:33 devstack sudo[108195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:33 devstack sudo[108194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:33 devstack sudo[108194]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c47a9777-5ddb-408b-95ce-89cb5f80b74e tempest-ProjectMemberTests-1866302072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d34396da-c8e6-4ebf-9559-afdfbae565ff" returned: 0 in 0.750s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c47a9777-5ddb-408b-95ce-89cb5f80b74e tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d34396da-c8e6-4ebf-9559-afdfbae565ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d34396da-c8e6-4ebf-9559-afdfbae565ff.863ecf4f-f9a1-48fa-b5b2-37bd18761c88 1G {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:33 devstack sudo[108204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d34396da-c8e6-4ebf-9559-afdfbae565ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d34396da-c8e6-4ebf-9559-afdfbae565ff.863ecf4f-f9a1-48fa-b5b2-37bd18761c88 1G
Jul 03 01:34:33 devstack sudo[108204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:33 devstack sudo[108195]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9c0e6e0d-84ce-4a34-a82a-d55d15f8cf6b tempest-ProjectReaderTests-812849349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2acb82a-c3d5-4f17-b2dc-c6f2619ea682.800031a7-0d64-4013-91b3-4a8fde255862" returned: 0 in 0.709s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9c0e6e0d-84ce-4a34-a82a-d55d15f8cf6b tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2acb82a-c3d5-4f17-b2dc-c6f2619ea682.800031a7-0d64-4013-91b3-4a8fde255862 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:33 devstack sudo[108206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2acb82a-c3d5-4f17-b2dc-c6f2619ea682.800031a7-0d64-4013-91b3-4a8fde255862
Jul 03 01:34:33 devstack sudo[108206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:34 devstack sudo[108206]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9c0e6e0d-84ce-4a34-a82a-d55d15f8cf6b tempest-ProjectReaderTests-812849349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2acb82a-c3d5-4f17-b2dc-c6f2619ea682.800031a7-0d64-4013-91b3-4a8fde255862" returned: 0 in 0.662s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:34 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-9c0e6e0d-84ce-4a34-a82a-d55d15f8cf6b tempest-ProjectReaderTests-812849349 None] Lock "cinder-quobyte-800031a7-0d64-4013-91b3-4a8fde255862" released by "_delete_snapshot" :: held 3.035s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:34:34 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-9c0e6e0d-84ce-4a34-a82a-d55d15f8cf6b tempest-ProjectReaderTests-812849349 None] Lock "cinder-quobyte-e2acb82a-c3d5-4f17-b2dc-c6f2619ea682" released by "delete_snapshot" :: held 3.059s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:34:34 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-9c0e6e0d-84ce-4a34-a82a-d55d15f8cf6b tempest-ProjectReaderTests-812849349 None] Created reservations ['b142e77c-495d-45c4-95c8-39ec99835e39', '198d456c-1eca-45e5-9a57-ed6e1f77b355', '6ede12d8-a93f-44d1-b464-aabf5f7bc9ea', '1bf9846c-0cbb-4b93-b24f-927e5cc4b27b'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:34:34 devstack sudo[108204]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c47a9777-5ddb-408b-95ce-89cb5f80b74e tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d34396da-c8e6-4ebf-9559-afdfbae565ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d34396da-c8e6-4ebf-9559-afdfbae565ff.863ecf4f-f9a1-48fa-b5b2-37bd18761c88 1G" returned: 0 in 0.808s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c47a9777-5ddb-408b-95ce-89cb5f80b74e tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d34396da-c8e6-4ebf-9559-afdfbae565ff -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d34396da-c8e6-4ebf-9559-afdfbae565ff.863ecf4f-f9a1-48fa-b5b2-37bd18761c88 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:34 devstack sudo[108212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d34396da-c8e6-4ebf-9559-afdfbae565ff -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d34396da-c8e6-4ebf-9559-afdfbae565ff.863ecf4f-f9a1-48fa-b5b2-37bd18761c88
Jul 03 01:34:34 devstack sudo[108212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:34 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-9c0e6e0d-84ce-4a34-a82a-d55d15f8cf6b tempest-ProjectReaderTests-812849349 None] Delete snapshot completed successfully.
Jul 03 01:34:34 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-9c0e6e0d-84ce-4a34-a82a-d55d15f8cf6b tempest-ProjectReaderTests-812849349 None] Lock "cinder-800031a7-0d64-4013-91b3-4a8fde255862-delete_snapshot" released by "delete_snapshot" :: held 3.212s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:34:35 devstack sudo[108212]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c47a9777-5ddb-408b-95ce-89cb5f80b74e tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d34396da-c8e6-4ebf-9559-afdfbae565ff -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d34396da-c8e6-4ebf-9559-afdfbae565ff.863ecf4f-f9a1-48fa-b5b2-37bd18761c88" returned: 0 in 0.682s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:35 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-c47a9777-5ddb-408b-95ce-89cb5f80b74e tempest-ProjectMemberTests-1866302072 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d34396da-c8e6-4ebf-9559-afdfbae565ff.863ecf4f-f9a1-48fa-b5b2-37bd18761c88 is being set with open permissions: ugo+rw
Jul 03 01:34:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c47a9777-5ddb-408b-95ce-89cb5f80b74e tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d34396da-c8e6-4ebf-9559-afdfbae565ff.863ecf4f-f9a1-48fa-b5b2-37bd18761c88 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:35 devstack sudo[108217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d34396da-c8e6-4ebf-9559-afdfbae565ff.863ecf4f-f9a1-48fa-b5b2-37bd18761c88
Jul 03 01:34:35 devstack sudo[108217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:35 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-ff29d30e-bf5c-4489-8505-793a9f57fec9 tempest-ProjectReaderTests-812849349 None] Acquiring lock "cinder-e2acb82a-c3d5-4f17-b2dc-c6f2619ea682-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:34:35 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-ff29d30e-bf5c-4489-8505-793a9f57fec9 tempest-ProjectReaderTests-812849349 None] Lock "cinder-e2acb82a-c3d5-4f17-b2dc-c6f2619ea682-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:34:35 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-ff29d30e-bf5c-4489-8505-793a9f57fec9 tempest-ProjectReaderTests-812849349 None] Acquiring lock "cinder-quobyte-e2acb82a-c3d5-4f17-b2dc-c6f2619ea682" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:34:35 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-ff29d30e-bf5c-4489-8505-793a9f57fec9 tempest-ProjectReaderTests-812849349 None] Lock "cinder-quobyte-e2acb82a-c3d5-4f17-b2dc-c6f2619ea682" acquired by "delete_volume" :: waited 0.016s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:34:35 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba876903-7090-498a-9097-81d0c42fd270]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:34:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-ff29d30e-bf5c-4489-8505-793a9f57fec9 tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2acb82a-c3d5-4f17-b2dc-c6f2619ea682 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:35 devstack sudo[108219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2acb82a-c3d5-4f17-b2dc-c6f2619ea682
Jul 03 01:34:35 devstack sudo[108219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:35 devstack sudo[108217]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c47a9777-5ddb-408b-95ce-89cb5f80b74e tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d34396da-c8e6-4ebf-9559-afdfbae565ff.863ecf4f-f9a1-48fa-b5b2-37bd18761c88" returned: 0 in 0.629s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:35 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:UPDATE=83,cinder:SELECT=62,cinder:INSERT=22,cinder:DELETE=7 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:34:35 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c47a9777-5ddb-408b-95ce-89cb5f80b74e tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d34396da-c8e6-4ebf-9559-afdfbae565ff.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:35 devstack sudo[108222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d34396da-c8e6-4ebf-9559-afdfbae565ff.info
Jul 03 01:34:35 devstack sudo[108222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:36 devstack sudo[108222]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c47a9777-5ddb-408b-95ce-89cb5f80b74e tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d34396da-c8e6-4ebf-9559-afdfbae565ff.info" returned: 0 in 0.651s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:36 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-c47a9777-5ddb-408b-95ce-89cb5f80b74e tempest-ProjectMemberTests-1866302072 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d34396da-c8e6-4ebf-9559-afdfbae565ff.info is being set with open permissions: ugo+rw
Jul 03 01:34:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c47a9777-5ddb-408b-95ce-89cb5f80b74e tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d34396da-c8e6-4ebf-9559-afdfbae565ff.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:36 devstack sudo[108219]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-ff29d30e-bf5c-4489-8505-793a9f57fec9 tempest-ProjectReaderTests-812849349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2acb82a-c3d5-4f17-b2dc-c6f2619ea682" returned: 0 in 0.821s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:36 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-ff29d30e-bf5c-4489-8505-793a9f57fec9 tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2acb82a-c3d5-4f17-b2dc-c6f2619ea682 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:36 devstack sudo[108263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d34396da-c8e6-4ebf-9559-afdfbae565ff.info
Jul 03 01:34:36 devstack sudo[108263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:36 devstack sudo[108264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2acb82a-c3d5-4f17-b2dc-c6f2619ea682
Jul 03 01:34:36 devstack sudo[108264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:37 devstack sudo[108263]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c47a9777-5ddb-408b-95ce-89cb5f80b74e tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d34396da-c8e6-4ebf-9559-afdfbae565ff.info" returned: 0 in 0.657s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-c47a9777-5ddb-408b-95ce-89cb5f80b74e tempest-ProjectMemberTests-1866302072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.259s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:34:37 devstack sudo[108264]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-ff29d30e-bf5c-4489-8505-793a9f57fec9 tempest-ProjectReaderTests-812849349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-e2acb82a-c3d5-4f17-b2dc-c6f2619ea682" returned: 0 in 0.672s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:37 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-ff29d30e-bf5c-4489-8505-793a9f57fec9 tempest-ProjectReaderTests-812849349 None] Lock "cinder-quobyte-e2acb82a-c3d5-4f17-b2dc-c6f2619ea682" released by "delete_volume" :: held 1.555s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:34:37 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-c47a9777-5ddb-408b-95ce-89cb5f80b74e tempest-ProjectMemberTests-1866302072 None] Create snapshot completed successfully
Jul 03 01:34:37 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-ff29d30e-bf5c-4489-8505-793a9f57fec9 tempest-ProjectReaderTests-812849349 None] Created reservations ['2a0469ee-618e-4216-9ecb-ca7fd24538a5', '5a1be359-3e97-4312-9eee-b366046f917a', '7f4e513a-c69b-4abb-ae09-6357397161dd', 'c425fb60-e5ee-49d8-b2c1-91b76757ddb0'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:34:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-ff29d30e-bf5c-4489-8505-793a9f57fec9 tempest-ProjectReaderTests-812849349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:34:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-ff29d30e-bf5c-4489-8505-793a9f57fec9 tempest-ProjectReaderTests-812849349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:34:37 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-ff29d30e-bf5c-4489-8505-793a9f57fec9 tempest-ProjectReaderTests-812849349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:34:37 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-ff29d30e-bf5c-4489-8505-793a9f57fec9 tempest-ProjectReaderTests-812849349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:34:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-ff29d30e-bf5c-4489-8505-793a9f57fec9 tempest-ProjectReaderTests-812849349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:34:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-ff29d30e-bf5c-4489-8505-793a9f57fec9 tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:37 devstack sudo[108271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:34:37 devstack sudo[108271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:37 devstack sudo[108271]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:37 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-ff29d30e-bf5c-4489-8505-793a9f57fec9 tempest-ProjectReaderTests-812849349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.641s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:37 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-ff29d30e-bf5c-4489-8505-793a9f57fec9 tempest-ProjectReaderTests-812849349 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:34:37 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-ff29d30e-bf5c-4489-8505-793a9f57fec9 tempest-ProjectReaderTests-812849349 None] Deleted volume successfully.
Jul 03 01:34:37 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-ff29d30e-bf5c-4489-8505-793a9f57fec9 tempest-ProjectReaderTests-812849349 None] Lock "cinder-e2acb82a-c3d5-4f17-b2dc-c6f2619ea682-delete_volume" released by "delete_volume" :: held 2.390s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:34:38 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5069f06f-d6e5-4c8f-bbf4-8ec0e00d44e9 tempest-ProjectMemberTests-1866302072 None] Acquiring lock "cinder-863ecf4f-f9a1-48fa-b5b2-37bd18761c88-delete_snapshot" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:34:38 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5069f06f-d6e5-4c8f-bbf4-8ec0e00d44e9 tempest-ProjectMemberTests-1866302072 None] Lock "cinder-863ecf4f-f9a1-48fa-b5b2-37bd18761c88-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:34:38 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5069f06f-d6e5-4c8f-bbf4-8ec0e00d44e9 tempest-ProjectMemberTests-1866302072 None] Acquiring lock "cinder-quobyte-d34396da-c8e6-4ebf-9559-afdfbae565ff" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:34:38 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9b2b27a-64f2-43c8-8297-8cfa5ff8bc2f tempest-ProjectReaderTests-812849349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:34:38 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-d9b2b27a-64f2-43c8-8297-8cfa5ff8bc2f tempest-ProjectReaderTests-812849349 None] Flow 'volume_create_manager' (a6bda95b-5f90-4f5a-983b-159743b081a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:34:38 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-d9b2b27a-64f2-43c8-8297-8cfa5ff8bc2f tempest-ProjectReaderTests-812849349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bea49d9e-0eec-46e3-a29f-bbe519062e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:34:38 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-d9b2b27a-64f2-43c8-8297-8cfa5ff8bc2f tempest-ProjectReaderTests-812849349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bea49d9e-0eec-46e3-a29f-bbe519062e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:34:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2075689528',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f3e9190-ecaa-40de-9266-f6f4b2c24724,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5434f12e1ba472a853c0eeeee49097f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:34:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:34:38Z,use_quota=True,user_id='8473987273274ccf818181429aafb11a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:34:38 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-d9b2b27a-64f2-43c8-8297-8cfa5ff8bc2f tempest-ProjectReaderTests-812849349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07328f4f-89b3-411e-a535-c1ceff20f500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:34:38 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-d9b2b27a-64f2-43c8-8297-8cfa5ff8bc2f tempest-ProjectReaderTests-812849349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07328f4f-89b3-411e-a535-c1ceff20f500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:34:38 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-d9b2b27a-64f2-43c8-8297-8cfa5ff8bc2f tempest-ProjectReaderTests-812849349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d896f79f-6dfa-48ba-9e72-09a9382e9ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:34:38 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-d9b2b27a-64f2-43c8-8297-8cfa5ff8bc2f tempest-ProjectReaderTests-812849349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d896f79f-6dfa-48ba-9e72-09a9382e9ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f3e9190-ecaa-40de-9266-f6f4b2c24724', 'volume_name': 'volume-0f3e9190-ecaa-40de-9266-f6f4b2c24724', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:34:38 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-d9b2b27a-64f2-43c8-8297-8cfa5ff8bc2f tempest-ProjectReaderTests-812849349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d019c040-1696-413f-879e-6621f7ebd2a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:34:38 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-d9b2b27a-64f2-43c8-8297-8cfa5ff8bc2f tempest-ProjectReaderTests-812849349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d019c040-1696-413f-879e-6621f7ebd2a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:34:38 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-d9b2b27a-64f2-43c8-8297-8cfa5ff8bc2f tempest-ProjectReaderTests-812849349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (568299fb-d9e7-49a1-a0d6-1afec8590ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:34:38 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-d9b2b27a-64f2-43c8-8297-8cfa5ff8bc2f tempest-ProjectReaderTests-812849349 None] Volume 0f3e9190-ecaa-40de-9266-f6f4b2c24724: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f3e9190-ecaa-40de-9266-f6f4b2c24724', 'volume_size': 1}
Jul 03 01:34:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-d9b2b27a-64f2-43c8-8297-8cfa5ff8bc2f tempest-ProjectReaderTests-812849349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:34:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-d9b2b27a-64f2-43c8-8297-8cfa5ff8bc2f tempest-ProjectReaderTests-812849349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:34:38 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-d9b2b27a-64f2-43c8-8297-8cfa5ff8bc2f tempest-ProjectReaderTests-812849349 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:34:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2075689528',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f3e9190-ecaa-40de-9266-f6f4b2c24724,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5434f12e1ba472a853c0eeeee49097f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:34:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:34:38Z,use_quota=True,user_id='8473987273274ccf818181429aafb11a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:34:38 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-d9b2b27a-64f2-43c8-8297-8cfa5ff8bc2f tempest-ProjectReaderTests-812849349 None] Creating volume 0f3e9190-ecaa-40de-9266-f6f4b2c24724 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:34:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-d9b2b27a-64f2-43c8-8297-8cfa5ff8bc2f tempest-ProjectReaderTests-812849349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:34:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-d9b2b27a-64f2-43c8-8297-8cfa5ff8bc2f tempest-ProjectReaderTests-812849349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:34:38 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-d9b2b27a-64f2-43c8-8297-8cfa5ff8bc2f tempest-ProjectReaderTests-812849349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:34:38 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-d9b2b27a-64f2-43c8-8297-8cfa5ff8bc2f tempest-ProjectReaderTests-812849349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:34:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-d9b2b27a-64f2-43c8-8297-8cfa5ff8bc2f tempest-ProjectReaderTests-812849349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:34:38 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-d9b2b27a-64f2-43c8-8297-8cfa5ff8bc2f tempest-ProjectReaderTests-812849349 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:34:38 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-d9b2b27a-64f2-43c8-8297-8cfa5ff8bc2f tempest-ProjectReaderTests-812849349 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:34:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d9b2b27a-64f2-43c8-8297-8cfa5ff8bc2f tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0f3e9190-ecaa-40de-9266-f6f4b2c24724 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:38 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5069f06f-d6e5-4c8f-bbf4-8ec0e00d44e9 tempest-ProjectMemberTests-1866302072 None] Lock "cinder-quobyte-d34396da-c8e6-4ebf-9559-afdfbae565ff" acquired by "delete_snapshot" :: waited 0.109s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:34:38 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5069f06f-d6e5-4c8f-bbf4-8ec0e00d44e9 tempest-ProjectMemberTests-1866302072 None] Acquiring lock "cinder-quobyte-863ecf4f-f9a1-48fa-b5b2-37bd18761c88" by "_delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:34:38 devstack sudo[108274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0f3e9190-ecaa-40de-9266-f6f4b2c24724 1073741824
Jul 03 01:34:38 devstack sudo[108274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:38 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5069f06f-d6e5-4c8f-bbf4-8ec0e00d44e9 tempest-ProjectMemberTests-1866302072 None] Lock "cinder-quobyte-863ecf4f-f9a1-48fa-b5b2-37bd18761c88" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:34:38 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-5069f06f-d6e5-4c8f-bbf4-8ec0e00d44e9 tempest-ProjectMemberTests-1866302072 None] Deleting offline snapshot 863ecf4f-f9a1-48fa-b5b2-37bd18761c88 of volume d34396da-c8e6-4ebf-9559-afdfbae565ff {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 01:34:38 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-5069f06f-d6e5-4c8f-bbf4-8ec0e00d44e9 tempest-ProjectMemberTests-1866302072 None] snapshot_file for this snap is: volume-d34396da-c8e6-4ebf-9559-afdfbae565ff.863ecf4f-f9a1-48fa-b5b2-37bd18761c88 {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 01:34:38 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[baafe107-9372-489b-a5b1-996a5d3f3143]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:34:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5069f06f-d6e5-4c8f-bbf4-8ec0e00d44e9 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d34396da-c8e6-4ebf-9559-afdfbae565ff.863ecf4f-f9a1-48fa-b5b2-37bd18761c88 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:38 devstack sudo[108276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d34396da-c8e6-4ebf-9559-afdfbae565ff.863ecf4f-f9a1-48fa-b5b2-37bd18761c88
Jul 03 01:34:38 devstack sudo[108276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:39 devstack sudo[108274]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d9b2b27a-64f2-43c8-8297-8cfa5ff8bc2f tempest-ProjectReaderTests-812849349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0f3e9190-ecaa-40de-9266-f6f4b2c24724 1073741824" returned: 0 in 0.804s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:39 devstack sudo[108276]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5069f06f-d6e5-4c8f-bbf4-8ec0e00d44e9 tempest-ProjectMemberTests-1866302072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d34396da-c8e6-4ebf-9559-afdfbae565ff.863ecf4f-f9a1-48fa-b5b2-37bd18761c88" returned: 0 in 0.767s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:39 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-5069f06f-d6e5-4c8f-bbf4-8ec0e00d44e9 tempest-ProjectMemberTests-1866302072 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d34396da-c8e6-4ebf-9559-afdfbae565ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:34:39 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ddce59c-74df-4c02-bb2e-56bfe0cd14ee]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:34:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5069f06f-d6e5-4c8f-bbf4-8ec0e00d44e9 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d34396da-c8e6-4ebf-9559-afdfbae565ff {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d9b2b27a-64f2-43c8-8297-8cfa5ff8bc2f tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0f3e9190-ecaa-40de-9266-f6f4b2c24724 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:39 devstack sudo[108287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0f3e9190-ecaa-40de-9266-f6f4b2c24724
Jul 03 01:34:39 devstack sudo[108287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:39 devstack sudo[108286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d34396da-c8e6-4ebf-9559-afdfbae565ff
Jul 03 01:34:39 devstack sudo[108286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:39 devstack sudo[108287]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d9b2b27a-64f2-43c8-8297-8cfa5ff8bc2f tempest-ProjectReaderTests-812849349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0f3e9190-ecaa-40de-9266-f6f4b2c24724" returned: 0 in 0.675s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:39 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-d9b2b27a-64f2-43c8-8297-8cfa5ff8bc2f tempest-ProjectReaderTests-812849349 None] <== create_volume: return (1556ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:34:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-d9b2b27a-64f2-43c8-8297-8cfa5ff8bc2f tempest-ProjectReaderTests-812849349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.559s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:34:39 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-d9b2b27a-64f2-43c8-8297-8cfa5ff8bc2f tempest-ProjectReaderTests-812849349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (568299fb-d9e7-49a1-a0d6-1afec8590ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f3e9190-ecaa-40de-9266-f6f4b2c24724', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:34:39 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-d9b2b27a-64f2-43c8-8297-8cfa5ff8bc2f tempest-ProjectReaderTests-812849349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03e7b17d-0589-4902-814a-e798f878bbc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:34:39 devstack sudo[108286]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5069f06f-d6e5-4c8f-bbf4-8ec0e00d44e9 tempest-ProjectMemberTests-1866302072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d34396da-c8e6-4ebf-9559-afdfbae565ff" returned: 0 in 0.735s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5069f06f-d6e5-4c8f-bbf4-8ec0e00d44e9 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d34396da-c8e6-4ebf-9559-afdfbae565ff.863ecf4f-f9a1-48fa-b5b2-37bd18761c88 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:39 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-d9b2b27a-64f2-43c8-8297-8cfa5ff8bc2f tempest-ProjectReaderTests-812849349 None] Volume volume-0f3e9190-ecaa-40de-9266-f6f4b2c24724 (0f3e9190-ecaa-40de-9266-f6f4b2c24724): created successfully
Jul 03 01:34:39 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-d9b2b27a-64f2-43c8-8297-8cfa5ff8bc2f tempest-ProjectReaderTests-812849349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03e7b17d-0589-4902-814a-e798f878bbc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:34:39 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-d9b2b27a-64f2-43c8-8297-8cfa5ff8bc2f tempest-ProjectReaderTests-812849349 None] Flow 'volume_create_manager' (a6bda95b-5f90-4f5a-983b-159743b081a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:34:39 devstack sudo[108294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d34396da-c8e6-4ebf-9559-afdfbae565ff.863ecf4f-f9a1-48fa-b5b2-37bd18761c88
Jul 03 01:34:39 devstack sudo[108294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:39 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-d9b2b27a-64f2-43c8-8297-8cfa5ff8bc2f tempest-ProjectReaderTests-812849349 None] Created volume successfully.
Jul 03 01:34:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-bdd23274-f9f3-4dd4-9427-245209fcc4a3 tempest-ProjectReaderTests-812849349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:34:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-bdd23274-f9f3-4dd4-9427-245209fcc4a3 tempest-ProjectReaderTests-812849349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:34:40 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-bdd23274-f9f3-4dd4-9427-245209fcc4a3 tempest-ProjectReaderTests-812849349 None] Creating offline snapshot 3c16383d-3e08-41a0-8d2a-8367932bcff6 of volume 0f3e9190-ecaa-40de-9266-f6f4b2c24724 {{(pid=86891) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 01:34:40 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bda3575-8d30-49bc-bb84-bf8dcaeff51a]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:34:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bdd23274-f9f3-4dd4-9427-245209fcc4a3 tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0f3e9190-ecaa-40de-9266-f6f4b2c24724 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:40 devstack sudo[108298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0f3e9190-ecaa-40de-9266-f6f4b2c24724
Jul 03 01:34:40 devstack sudo[108298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:40 devstack sudo[108294]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5069f06f-d6e5-4c8f-bbf4-8ec0e00d44e9 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d34396da-c8e6-4ebf-9559-afdfbae565ff.863ecf4f-f9a1-48fa-b5b2-37bd18761c88" returned: 0 in 0.734s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5069f06f-d6e5-4c8f-bbf4-8ec0e00d44e9 tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d34396da-c8e6-4ebf-9559-afdfbae565ff.863ecf4f-f9a1-48fa-b5b2-37bd18761c88 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:40 devstack sudo[108301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d34396da-c8e6-4ebf-9559-afdfbae565ff.863ecf4f-f9a1-48fa-b5b2-37bd18761c88
Jul 03 01:34:40 devstack sudo[108301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:41 devstack sudo[108298]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bdd23274-f9f3-4dd4-9427-245209fcc4a3 tempest-ProjectReaderTests-812849349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0f3e9190-ecaa-40de-9266-f6f4b2c24724" returned: 0 in 0.741s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bdd23274-f9f3-4dd4-9427-245209fcc4a3 tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0f3e9190-ecaa-40de-9266-f6f4b2c24724,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0f3e9190-ecaa-40de-9266-f6f4b2c24724.3c16383d-3e08-41a0-8d2a-8367932bcff6 1G {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:41 devstack sudo[108307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0f3e9190-ecaa-40de-9266-f6f4b2c24724,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0f3e9190-ecaa-40de-9266-f6f4b2c24724.3c16383d-3e08-41a0-8d2a-8367932bcff6 1G
Jul 03 01:34:41 devstack sudo[108307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:41 devstack sudo[108301]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5069f06f-d6e5-4c8f-bbf4-8ec0e00d44e9 tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d34396da-c8e6-4ebf-9559-afdfbae565ff.863ecf4f-f9a1-48fa-b5b2-37bd18761c88" returned: 0 in 0.669s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:41 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5069f06f-d6e5-4c8f-bbf4-8ec0e00d44e9 tempest-ProjectMemberTests-1866302072 None] Lock "cinder-quobyte-863ecf4f-f9a1-48fa-b5b2-37bd18761c88" released by "_delete_snapshot" :: held 3.025s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:34:41 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5069f06f-d6e5-4c8f-bbf4-8ec0e00d44e9 tempest-ProjectMemberTests-1866302072 None] Lock "cinder-quobyte-d34396da-c8e6-4ebf-9559-afdfbae565ff" released by "delete_snapshot" :: held 3.057s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:34:41 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-5069f06f-d6e5-4c8f-bbf4-8ec0e00d44e9 tempest-ProjectMemberTests-1866302072 None] Created reservations ['b7304071-e7fd-4bca-bbbf-fb29e53248d7', 'bbee48b0-8915-4e9d-b6a1-dd9f4c4869b3', '0660f772-b2e7-4b33-afe7-b68c5effface', '2c3ea348-6483-4a80-9be7-b965f1724816'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:34:41 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-5069f06f-d6e5-4c8f-bbf4-8ec0e00d44e9 tempest-ProjectMemberTests-1866302072 None] Delete snapshot completed successfully.
Jul 03 01:34:41 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5069f06f-d6e5-4c8f-bbf4-8ec0e00d44e9 tempest-ProjectMemberTests-1866302072 None] Lock "cinder-863ecf4f-f9a1-48fa-b5b2-37bd18761c88-delete_snapshot" released by "delete_snapshot" :: held 3.317s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:34:42 devstack sudo[108307]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bdd23274-f9f3-4dd4-9427-245209fcc4a3 tempest-ProjectReaderTests-812849349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0f3e9190-ecaa-40de-9266-f6f4b2c24724,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0f3e9190-ecaa-40de-9266-f6f4b2c24724.3c16383d-3e08-41a0-8d2a-8367932bcff6 1G" returned: 0 in 0.809s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bdd23274-f9f3-4dd4-9427-245209fcc4a3 tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f3e9190-ecaa-40de-9266-f6f4b2c24724 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0f3e9190-ecaa-40de-9266-f6f4b2c24724.3c16383d-3e08-41a0-8d2a-8367932bcff6 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:42 devstack sudo[108319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f3e9190-ecaa-40de-9266-f6f4b2c24724 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0f3e9190-ecaa-40de-9266-f6f4b2c24724.3c16383d-3e08-41a0-8d2a-8367932bcff6
Jul 03 01:34:42 devstack sudo[108319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:42 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-dbb050ad-24d6-4f9d-911b-c5a3153da96b tempest-ProjectMemberTests-1866302072 None] Acquiring lock "cinder-d34396da-c8e6-4ebf-9559-afdfbae565ff-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:34:42 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-dbb050ad-24d6-4f9d-911b-c5a3153da96b tempest-ProjectMemberTests-1866302072 None] Lock "cinder-d34396da-c8e6-4ebf-9559-afdfbae565ff-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:34:42 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-dbb050ad-24d6-4f9d-911b-c5a3153da96b tempest-ProjectMemberTests-1866302072 None] Acquiring lock "cinder-quobyte-d34396da-c8e6-4ebf-9559-afdfbae565ff" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:34:42 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-dbb050ad-24d6-4f9d-911b-c5a3153da96b tempest-ProjectMemberTests-1866302072 None] Lock "cinder-quobyte-d34396da-c8e6-4ebf-9559-afdfbae565ff" acquired by "delete_volume" :: waited 0.015s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:34:42 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4d027f-e62f-4d49-a7bb-9d80a64802d7]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:34:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-dbb050ad-24d6-4f9d-911b-c5a3153da96b tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d34396da-c8e6-4ebf-9559-afdfbae565ff {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:42 devstack sudo[108321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d34396da-c8e6-4ebf-9559-afdfbae565ff
Jul 03 01:34:42 devstack sudo[108321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:42 devstack sudo[108319]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bdd23274-f9f3-4dd4-9427-245209fcc4a3 tempest-ProjectReaderTests-812849349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f3e9190-ecaa-40de-9266-f6f4b2c24724 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0f3e9190-ecaa-40de-9266-f6f4b2c24724.3c16383d-3e08-41a0-8d2a-8367932bcff6" returned: 0 in 0.711s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:42 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-bdd23274-f9f3-4dd4-9427-245209fcc4a3 tempest-ProjectReaderTests-812849349 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0f3e9190-ecaa-40de-9266-f6f4b2c24724.3c16383d-3e08-41a0-8d2a-8367932bcff6 is being set with open permissions: ugo+rw
Jul 03 01:34:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bdd23274-f9f3-4dd4-9427-245209fcc4a3 tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0f3e9190-ecaa-40de-9266-f6f4b2c24724.3c16383d-3e08-41a0-8d2a-8367932bcff6 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:42 devstack sudo[108326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0f3e9190-ecaa-40de-9266-f6f4b2c24724.3c16383d-3e08-41a0-8d2a-8367932bcff6
Jul 03 01:34:42 devstack sudo[108326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:43 devstack sudo[108321]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-dbb050ad-24d6-4f9d-911b-c5a3153da96b tempest-ProjectMemberTests-1866302072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d34396da-c8e6-4ebf-9559-afdfbae565ff" returned: 0 in 0.747s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-dbb050ad-24d6-4f9d-911b-c5a3153da96b tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d34396da-c8e6-4ebf-9559-afdfbae565ff {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:43 devstack sudo[108332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d34396da-c8e6-4ebf-9559-afdfbae565ff
Jul 03 01:34:43 devstack sudo[108332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:43 devstack sudo[108326]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bdd23274-f9f3-4dd4-9427-245209fcc4a3 tempest-ProjectReaderTests-812849349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0f3e9190-ecaa-40de-9266-f6f4b2c24724.3c16383d-3e08-41a0-8d2a-8367932bcff6" returned: 0 in 0.634s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bdd23274-f9f3-4dd4-9427-245209fcc4a3 tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0f3e9190-ecaa-40de-9266-f6f4b2c24724.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:43 devstack sudo[108334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0f3e9190-ecaa-40de-9266-f6f4b2c24724.info
Jul 03 01:34:43 devstack sudo[108334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:43 devstack sudo[108332]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-dbb050ad-24d6-4f9d-911b-c5a3153da96b tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d34396da-c8e6-4ebf-9559-afdfbae565ff" returned: 0 in 0.641s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:43 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-dbb050ad-24d6-4f9d-911b-c5a3153da96b tempest-ProjectMemberTests-1866302072 None] Lock "cinder-quobyte-d34396da-c8e6-4ebf-9559-afdfbae565ff" released by "delete_volume" :: held 1.446s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:34:44 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-dbb050ad-24d6-4f9d-911b-c5a3153da96b tempest-ProjectMemberTests-1866302072 None] Created reservations ['ccc54e53-a02d-4594-9de7-a7581cd30a45', '31432e2b-e508-47e0-b5ac-417957582dae', '15d27490-c3d6-41d8-a4bb-00cdcf8c059c', 'a50421be-152c-44e1-accb-f569e648de64'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:34:44 devstack sudo[108334]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-dbb050ad-24d6-4f9d-911b-c5a3153da96b tempest-ProjectMemberTests-1866302072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:34:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-dbb050ad-24d6-4f9d-911b-c5a3153da96b tempest-ProjectMemberTests-1866302072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:34:44 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-dbb050ad-24d6-4f9d-911b-c5a3153da96b tempest-ProjectMemberTests-1866302072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:34:44 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-dbb050ad-24d6-4f9d-911b-c5a3153da96b tempest-ProjectMemberTests-1866302072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:34:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-dbb050ad-24d6-4f9d-911b-c5a3153da96b tempest-ProjectMemberTests-1866302072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:34:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-dbb050ad-24d6-4f9d-911b-c5a3153da96b tempest-ProjectMemberTests-1866302072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bdd23274-f9f3-4dd4-9427-245209fcc4a3 tempest-ProjectReaderTests-812849349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0f3e9190-ecaa-40de-9266-f6f4b2c24724.info" returned: 0 in 0.692s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:44 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-bdd23274-f9f3-4dd4-9427-245209fcc4a3 tempest-ProjectReaderTests-812849349 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0f3e9190-ecaa-40de-9266-f6f4b2c24724.info is being set with open permissions: ugo+rw
Jul 03 01:34:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bdd23274-f9f3-4dd4-9427-245209fcc4a3 tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0f3e9190-ecaa-40de-9266-f6f4b2c24724.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:44 devstack sudo[108338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:34:44 devstack sudo[108338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:44 devstack sudo[108339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0f3e9190-ecaa-40de-9266-f6f4b2c24724.info
Jul 03 01:34:44 devstack sudo[108339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:44 devstack sudo[108338]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-dbb050ad-24d6-4f9d-911b-c5a3153da96b tempest-ProjectMemberTests-1866302072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.655s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:44 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-dbb050ad-24d6-4f9d-911b-c5a3153da96b tempest-ProjectMemberTests-1866302072 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:34:44 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-dbb050ad-24d6-4f9d-911b-c5a3153da96b tempest-ProjectMemberTests-1866302072 None] Deleted volume successfully.
Jul 03 01:34:44 devstack sudo[108339]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-bdd23274-f9f3-4dd4-9427-245209fcc4a3 tempest-ProjectReaderTests-812849349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0f3e9190-ecaa-40de-9266-f6f4b2c24724.info" returned: 0 in 0.679s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-bdd23274-f9f3-4dd4-9427-245209fcc4a3 tempest-ProjectReaderTests-812849349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.352s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:34:44 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-dbb050ad-24d6-4f9d-911b-c5a3153da96b tempest-ProjectMemberTests-1866302072 None] Lock "cinder-d34396da-c8e6-4ebf-9559-afdfbae565ff-delete_volume" released by "delete_volume" :: held 2.353s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:34:44 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-bdd23274-f9f3-4dd4-9427-245209fcc4a3 tempest-ProjectReaderTests-812849349 None] Create snapshot completed successfully
Jul 03 01:34:45 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-09da6981-09ae-4459-a624-d451fc7ad85e tempest-ProjectReaderTests-812849349 None] Acquiring lock "cinder-3c16383d-3e08-41a0-8d2a-8367932bcff6-delete_snapshot" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:34:45 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-09da6981-09ae-4459-a624-d451fc7ad85e tempest-ProjectReaderTests-812849349 None] Lock "cinder-3c16383d-3e08-41a0-8d2a-8367932bcff6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:34:45 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-09da6981-09ae-4459-a624-d451fc7ad85e tempest-ProjectReaderTests-812849349 None] Acquiring lock "cinder-quobyte-0f3e9190-ecaa-40de-9266-f6f4b2c24724" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:34:45 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-09da6981-09ae-4459-a624-d451fc7ad85e tempest-ProjectReaderTests-812849349 None] Lock "cinder-quobyte-0f3e9190-ecaa-40de-9266-f6f4b2c24724" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:34:45 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-09da6981-09ae-4459-a624-d451fc7ad85e tempest-ProjectReaderTests-812849349 None] Acquiring lock "cinder-quobyte-3c16383d-3e08-41a0-8d2a-8367932bcff6" by "_delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:34:45 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-09da6981-09ae-4459-a624-d451fc7ad85e tempest-ProjectReaderTests-812849349 None] Lock "cinder-quobyte-3c16383d-3e08-41a0-8d2a-8367932bcff6" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:34:45 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-09da6981-09ae-4459-a624-d451fc7ad85e tempest-ProjectReaderTests-812849349 None] Deleting offline snapshot 3c16383d-3e08-41a0-8d2a-8367932bcff6 of volume 0f3e9190-ecaa-40de-9266-f6f4b2c24724 {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 01:34:45 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-09da6981-09ae-4459-a624-d451fc7ad85e tempest-ProjectReaderTests-812849349 None] snapshot_file for this snap is: volume-0f3e9190-ecaa-40de-9266-f6f4b2c24724.3c16383d-3e08-41a0-8d2a-8367932bcff6 {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 01:34:45 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[244cad5e-402c-47e9-b556-68c5ede8ed06]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:34:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-09da6981-09ae-4459-a624-d451fc7ad85e tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0f3e9190-ecaa-40de-9266-f6f4b2c24724.3c16383d-3e08-41a0-8d2a-8367932bcff6 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:45 devstack sudo[108345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0f3e9190-ecaa-40de-9266-f6f4b2c24724.3c16383d-3e08-41a0-8d2a-8367932bcff6
Jul 03 01:34:45 devstack sudo[108345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:46 devstack sudo[108345]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-09da6981-09ae-4459-a624-d451fc7ad85e tempest-ProjectReaderTests-812849349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0f3e9190-ecaa-40de-9266-f6f4b2c24724.3c16383d-3e08-41a0-8d2a-8367932bcff6" returned: 0 in 0.772s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:46 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-09da6981-09ae-4459-a624-d451fc7ad85e tempest-ProjectReaderTests-812849349 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f3e9190-ecaa-40de-9266-f6f4b2c24724(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:34:46 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff8b503-8237-4560-8fae-936f959591cc]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:34:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-09da6981-09ae-4459-a624-d451fc7ad85e tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0f3e9190-ecaa-40de-9266-f6f4b2c24724 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:46 devstack sudo[108350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0f3e9190-ecaa-40de-9266-f6f4b2c24724
Jul 03 01:34:46 devstack sudo[108350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:47 devstack sudo[108350]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-09da6981-09ae-4459-a624-d451fc7ad85e tempest-ProjectReaderTests-812849349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0f3e9190-ecaa-40de-9266-f6f4b2c24724" returned: 0 in 0.763s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-09da6981-09ae-4459-a624-d451fc7ad85e tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0f3e9190-ecaa-40de-9266-f6f4b2c24724.3c16383d-3e08-41a0-8d2a-8367932bcff6 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:47 devstack sudo[108355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0f3e9190-ecaa-40de-9266-f6f4b2c24724.3c16383d-3e08-41a0-8d2a-8367932bcff6
Jul 03 01:34:47 devstack sudo[108355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:48 devstack sudo[108355]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-09da6981-09ae-4459-a624-d451fc7ad85e tempest-ProjectReaderTests-812849349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0f3e9190-ecaa-40de-9266-f6f4b2c24724.3c16383d-3e08-41a0-8d2a-8367932bcff6" returned: 0 in 0.777s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-09da6981-09ae-4459-a624-d451fc7ad85e tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0f3e9190-ecaa-40de-9266-f6f4b2c24724.3c16383d-3e08-41a0-8d2a-8367932bcff6 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:48 devstack sudo[108361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0f3e9190-ecaa-40de-9266-f6f4b2c24724.3c16383d-3e08-41a0-8d2a-8367932bcff6
Jul 03 01:34:48 devstack sudo[108361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:48 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-740bc13e-a945-4a92-a898-f896d1e9cf11 tempest-ProjectReaderTests-1240934792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:34:48 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-740bc13e-a945-4a92-a898-f896d1e9cf11 tempest-ProjectReaderTests-1240934792 None] Flow 'volume_create_manager' (93dd3c87-7394-4711-82e5-fd8bf09a2760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:34:48 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-740bc13e-a945-4a92-a898-f896d1e9cf11 tempest-ProjectReaderTests-1240934792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (471d1e60-fa12-4d22-a6a6-2d352ac89b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:34:48 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-740bc13e-a945-4a92-a898-f896d1e9cf11 tempest-ProjectReaderTests-1240934792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (471d1e60-fa12-4d22-a6a6-2d352ac89b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:34:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-568207323',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af07ab5d-8aa0-41c6-9f84-3a6261f606ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffc4ee389a2b474ca731cc046abf8796',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:34:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:34:48Z,use_quota=True,user_id='33a87daf39d04ee99138b9fa3efd4d37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:34:48 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-740bc13e-a945-4a92-a898-f896d1e9cf11 tempest-ProjectReaderTests-1240934792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd1e66f5-d0aa-4b25-ad50-24851ee189ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:34:48 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-740bc13e-a945-4a92-a898-f896d1e9cf11 tempest-ProjectReaderTests-1240934792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd1e66f5-d0aa-4b25-ad50-24851ee189ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:34:48 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-740bc13e-a945-4a92-a898-f896d1e9cf11 tempest-ProjectReaderTests-1240934792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1543e5c0-edad-4eee-9037-0808508520e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:34:48 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-740bc13e-a945-4a92-a898-f896d1e9cf11 tempest-ProjectReaderTests-1240934792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1543e5c0-edad-4eee-9037-0808508520e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af07ab5d-8aa0-41c6-9f84-3a6261f606ee', 'volume_name': 'volume-af07ab5d-8aa0-41c6-9f84-3a6261f606ee', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:34:48 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-740bc13e-a945-4a92-a898-f896d1e9cf11 tempest-ProjectReaderTests-1240934792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bbb32f1-5803-4665-b8b0-96a2ac1b86fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:34:48 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-740bc13e-a945-4a92-a898-f896d1e9cf11 tempest-ProjectReaderTests-1240934792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bbb32f1-5803-4665-b8b0-96a2ac1b86fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:34:48 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-740bc13e-a945-4a92-a898-f896d1e9cf11 tempest-ProjectReaderTests-1240934792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f57d9322-c0c7-453b-ba1e-8fb4ddbc057e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:34:48 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-740bc13e-a945-4a92-a898-f896d1e9cf11 tempest-ProjectReaderTests-1240934792 None] Volume af07ab5d-8aa0-41c6-9f84-3a6261f606ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af07ab5d-8aa0-41c6-9f84-3a6261f606ee', 'volume_size': 1}
Jul 03 01:34:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-740bc13e-a945-4a92-a898-f896d1e9cf11 tempest-ProjectReaderTests-1240934792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:34:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-740bc13e-a945-4a92-a898-f896d1e9cf11 tempest-ProjectReaderTests-1240934792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:34:48 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-740bc13e-a945-4a92-a898-f896d1e9cf11 tempest-ProjectReaderTests-1240934792 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:34:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-568207323',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af07ab5d-8aa0-41c6-9f84-3a6261f606ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffc4ee389a2b474ca731cc046abf8796',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:34:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:34:48Z,use_quota=True,user_id='33a87daf39d04ee99138b9fa3efd4d37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:34:48 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-740bc13e-a945-4a92-a898-f896d1e9cf11 tempest-ProjectReaderTests-1240934792 None] Creating volume af07ab5d-8aa0-41c6-9f84-3a6261f606ee {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:34:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-740bc13e-a945-4a92-a898-f896d1e9cf11 tempest-ProjectReaderTests-1240934792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:34:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-740bc13e-a945-4a92-a898-f896d1e9cf11 tempest-ProjectReaderTests-1240934792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:34:48 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-740bc13e-a945-4a92-a898-f896d1e9cf11 tempest-ProjectReaderTests-1240934792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:34:48 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-740bc13e-a945-4a92-a898-f896d1e9cf11 tempest-ProjectReaderTests-1240934792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:34:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-740bc13e-a945-4a92-a898-f896d1e9cf11 tempest-ProjectReaderTests-1240934792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:34:48 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-740bc13e-a945-4a92-a898-f896d1e9cf11 tempest-ProjectReaderTests-1240934792 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:34:48 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-740bc13e-a945-4a92-a898-f896d1e9cf11 tempest-ProjectReaderTests-1240934792 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:34:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-740bc13e-a945-4a92-a898-f896d1e9cf11 tempest-ProjectReaderTests-1240934792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-af07ab5d-8aa0-41c6-9f84-3a6261f606ee 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:48 devstack sudo[108363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-af07ab5d-8aa0-41c6-9f84-3a6261f606ee 1073741824
Jul 03 01:34:48 devstack sudo[108363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:48 devstack sudo[108361]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-09da6981-09ae-4459-a624-d451fc7ad85e tempest-ProjectReaderTests-812849349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0f3e9190-ecaa-40de-9266-f6f4b2c24724.3c16383d-3e08-41a0-8d2a-8367932bcff6" returned: 0 in 0.642s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:48 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-09da6981-09ae-4459-a624-d451fc7ad85e tempest-ProjectReaderTests-812849349 None] Lock "cinder-quobyte-3c16383d-3e08-41a0-8d2a-8367932bcff6" released by "_delete_snapshot" :: held 3.077s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:34:48 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-09da6981-09ae-4459-a624-d451fc7ad85e tempest-ProjectReaderTests-812849349 None] Lock "cinder-quobyte-0f3e9190-ecaa-40de-9266-f6f4b2c24724" released by "delete_snapshot" :: held 3.104s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:34:48 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-09da6981-09ae-4459-a624-d451fc7ad85e tempest-ProjectReaderTests-812849349 None] Created reservations ['3a965735-f32c-4ae0-bedc-65b4f02f08e2', '628aa530-dd03-486b-b809-26807059a76f', '06cd9b3a-9771-4c72-8155-a5b54246fa0e', 'd192dbb5-38ae-41c4-8177-924e39d881dc'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:34:48 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-09da6981-09ae-4459-a624-d451fc7ad85e tempest-ProjectReaderTests-812849349 None] Delete snapshot completed successfully.
Jul 03 01:34:49 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-09da6981-09ae-4459-a624-d451fc7ad85e tempest-ProjectReaderTests-812849349 None] Lock "cinder-3c16383d-3e08-41a0-8d2a-8367932bcff6-delete_snapshot" released by "delete_snapshot" :: held 3.232s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:34:49 devstack sudo[108363]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-740bc13e-a945-4a92-a898-f896d1e9cf11 tempest-ProjectReaderTests-1240934792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-af07ab5d-8aa0-41c6-9f84-3a6261f606ee 1073741824" returned: 0 in 0.823s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:49 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-740bc13e-a945-4a92-a898-f896d1e9cf11 tempest-ProjectReaderTests-1240934792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-af07ab5d-8aa0-41c6-9f84-3a6261f606ee {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:49 devstack sudo[108371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-af07ab5d-8aa0-41c6-9f84-3a6261f606ee
Jul 03 01:34:49 devstack sudo[108371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:49 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-4c3d8c5b-fdbd-4d9a-af1a-3c2369408f26 tempest-ProjectReaderTests-812849349 None] Acquiring lock "cinder-0f3e9190-ecaa-40de-9266-f6f4b2c24724-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:34:50 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-4c3d8c5b-fdbd-4d9a-af1a-3c2369408f26 tempest-ProjectReaderTests-812849349 None] Lock "cinder-0f3e9190-ecaa-40de-9266-f6f4b2c24724-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:34:50 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-4c3d8c5b-fdbd-4d9a-af1a-3c2369408f26 tempest-ProjectReaderTests-812849349 None] Acquiring lock "cinder-quobyte-0f3e9190-ecaa-40de-9266-f6f4b2c24724" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:34:50 devstack sudo[108371]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-740bc13e-a945-4a92-a898-f896d1e9cf11 tempest-ProjectReaderTests-1240934792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-af07ab5d-8aa0-41c6-9f84-3a6261f606ee" returned: 0 in 0.699s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:50 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-740bc13e-a945-4a92-a898-f896d1e9cf11 tempest-ProjectReaderTests-1240934792 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:34:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-740bc13e-a945-4a92-a898-f896d1e9cf11 tempest-ProjectReaderTests-1240934792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.565s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:34:50 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-4c3d8c5b-fdbd-4d9a-af1a-3c2369408f26 tempest-ProjectReaderTests-812849349 None] Lock "cinder-quobyte-0f3e9190-ecaa-40de-9266-f6f4b2c24724" acquired by "delete_volume" :: waited 0.021s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:34:50 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-740bc13e-a945-4a92-a898-f896d1e9cf11 tempest-ProjectReaderTests-1240934792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f57d9322-c0c7-453b-ba1e-8fb4ddbc057e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af07ab5d-8aa0-41c6-9f84-3a6261f606ee', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:34:50 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-740bc13e-a945-4a92-a898-f896d1e9cf11 tempest-ProjectReaderTests-1240934792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d19f793-7bea-4bee-b1a2-e862348e40c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:34:50 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[b380d1e2-7a9a-4660-bb0c-406a36caaa83]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:34:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-4c3d8c5b-fdbd-4d9a-af1a-3c2369408f26 tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0f3e9190-ecaa-40de-9266-f6f4b2c24724 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:50 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-740bc13e-a945-4a92-a898-f896d1e9cf11 tempest-ProjectReaderTests-1240934792 None] Volume volume-af07ab5d-8aa0-41c6-9f84-3a6261f606ee (af07ab5d-8aa0-41c6-9f84-3a6261f606ee): created successfully
Jul 03 01:34:50 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-740bc13e-a945-4a92-a898-f896d1e9cf11 tempest-ProjectReaderTests-1240934792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d19f793-7bea-4bee-b1a2-e862348e40c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:34:50 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-740bc13e-a945-4a92-a898-f896d1e9cf11 tempest-ProjectReaderTests-1240934792 None] Flow 'volume_create_manager' (93dd3c87-7394-4711-82e5-fd8bf09a2760) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:34:50 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-740bc13e-a945-4a92-a898-f896d1e9cf11 tempest-ProjectReaderTests-1240934792 None] Created volume successfully.
Jul 03 01:34:50 devstack sudo[108374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0f3e9190-ecaa-40de-9266-f6f4b2c24724
Jul 03 01:34:50 devstack sudo[108374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:50 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-c0c09154-2473-4a5b-bf26-6d976ae92ec4 tempest-ProjectReaderTests-1240934792 None] Acquiring lock "cinder-af07ab5d-8aa0-41c6-9f84-3a6261f606ee-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:34:50 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-c0c09154-2473-4a5b-bf26-6d976ae92ec4 tempest-ProjectReaderTests-1240934792 None] Lock "cinder-af07ab5d-8aa0-41c6-9f84-3a6261f606ee-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:34:50 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-c0c09154-2473-4a5b-bf26-6d976ae92ec4 tempest-ProjectReaderTests-1240934792 None] Acquiring lock "cinder-quobyte-af07ab5d-8aa0-41c6-9f84-3a6261f606ee" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:34:50 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-c0c09154-2473-4a5b-bf26-6d976ae92ec4 tempest-ProjectReaderTests-1240934792 None] Lock "cinder-quobyte-af07ab5d-8aa0-41c6-9f84-3a6261f606ee" acquired by "delete_volume" :: waited 0.019s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:34:50 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b89fa8-d4e4-4744-9565-3164ce1e7e71]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:34:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c0c09154-2473-4a5b-bf26-6d976ae92ec4 tempest-ProjectReaderTests-1240934792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-af07ab5d-8aa0-41c6-9f84-3a6261f606ee {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:50 devstack sudo[108377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-af07ab5d-8aa0-41c6-9f84-3a6261f606ee
Jul 03 01:34:50 devstack sudo[108377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:50 devstack sudo[108374]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-4c3d8c5b-fdbd-4d9a-af1a-3c2369408f26 tempest-ProjectReaderTests-812849349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0f3e9190-ecaa-40de-9266-f6f4b2c24724" returned: 0 in 0.774s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:50 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-4c3d8c5b-fdbd-4d9a-af1a-3c2369408f26 tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0f3e9190-ecaa-40de-9266-f6f4b2c24724 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:50 devstack sudo[108381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0f3e9190-ecaa-40de-9266-f6f4b2c24724
Jul 03 01:34:50 devstack sudo[108381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:51 devstack sudo[108377]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:51 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c0c09154-2473-4a5b-bf26-6d976ae92ec4 tempest-ProjectReaderTests-1240934792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-af07ab5d-8aa0-41c6-9f84-3a6261f606ee" returned: 0 in 0.773s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:51 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c0c09154-2473-4a5b-bf26-6d976ae92ec4 tempest-ProjectReaderTests-1240934792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-af07ab5d-8aa0-41c6-9f84-3a6261f606ee {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:51 devstack sudo[108387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-af07ab5d-8aa0-41c6-9f84-3a6261f606ee
Jul 03 01:34:51 devstack sudo[108387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:51 devstack sudo[108381]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:51 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-4c3d8c5b-fdbd-4d9a-af1a-3c2369408f26 tempest-ProjectReaderTests-812849349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-0f3e9190-ecaa-40de-9266-f6f4b2c24724" returned: 0 in 0.666s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:51 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-4c3d8c5b-fdbd-4d9a-af1a-3c2369408f26 tempest-ProjectReaderTests-812849349 None] Lock "cinder-quobyte-0f3e9190-ecaa-40de-9266-f6f4b2c24724" released by "delete_volume" :: held 1.512s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:34:51 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-4c3d8c5b-fdbd-4d9a-af1a-3c2369408f26 tempest-ProjectReaderTests-812849349 None] Created reservations ['8b97e078-0210-480c-ad79-2f9b9ae1d468', '1f0cefa9-46ab-47fa-b148-c4b1a343eeaa', 'd7054006-5218-4767-8deb-b8602ccaf3b1', 'ba12a20c-ead8-45d5-b61c-1c952a23ca31'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:34:51 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-4c3d8c5b-fdbd-4d9a-af1a-3c2369408f26 tempest-ProjectReaderTests-812849349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:34:51 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-4c3d8c5b-fdbd-4d9a-af1a-3c2369408f26 tempest-ProjectReaderTests-812849349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:34:51 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-4c3d8c5b-fdbd-4d9a-af1a-3c2369408f26 tempest-ProjectReaderTests-812849349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:34:51 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-4c3d8c5b-fdbd-4d9a-af1a-3c2369408f26 tempest-ProjectReaderTests-812849349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:34:51 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-4c3d8c5b-fdbd-4d9a-af1a-3c2369408f26 tempest-ProjectReaderTests-812849349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:34:51 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-4c3d8c5b-fdbd-4d9a-af1a-3c2369408f26 tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:51 devstack sudo[108389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:34:51 devstack sudo[108389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:52 devstack sudo[108387]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c0c09154-2473-4a5b-bf26-6d976ae92ec4 tempest-ProjectReaderTests-1240934792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-af07ab5d-8aa0-41c6-9f84-3a6261f606ee" returned: 0 in 0.653s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:52 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-c0c09154-2473-4a5b-bf26-6d976ae92ec4 tempest-ProjectReaderTests-1240934792 None] Lock "cinder-quobyte-af07ab5d-8aa0-41c6-9f84-3a6261f606ee" released by "delete_volume" :: held 1.478s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:34:52 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-c0c09154-2473-4a5b-bf26-6d976ae92ec4 tempest-ProjectReaderTests-1240934792 None] Created reservations ['e1e7a5e2-b279-4646-929b-7b64c4c1600f', '228084e6-b515-4a35-9cbc-ef2d397f83ab', '88e78040-8627-4e97-a6e9-ac7e699e8d34', '6d6d1d94-c6a2-4f6e-bcfb-0bc92ccb6369'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:34:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-c0c09154-2473-4a5b-bf26-6d976ae92ec4 tempest-ProjectReaderTests-1240934792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:34:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-c0c09154-2473-4a5b-bf26-6d976ae92ec4 tempest-ProjectReaderTests-1240934792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:34:52 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-c0c09154-2473-4a5b-bf26-6d976ae92ec4 tempest-ProjectReaderTests-1240934792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:34:52 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-c0c09154-2473-4a5b-bf26-6d976ae92ec4 tempest-ProjectReaderTests-1240934792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:34:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-c0c09154-2473-4a5b-bf26-6d976ae92ec4 tempest-ProjectReaderTests-1240934792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:34:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c0c09154-2473-4a5b-bf26-6d976ae92ec4 tempest-ProjectReaderTests-1240934792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:52 devstack sudo[108393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:34:52 devstack sudo[108393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:52 devstack sudo[108389]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-4c3d8c5b-fdbd-4d9a-af1a-3c2369408f26 tempest-ProjectReaderTests-812849349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.681s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:52 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-4c3d8c5b-fdbd-4d9a-af1a-3c2369408f26 tempest-ProjectReaderTests-812849349 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:34:52 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-4c3d8c5b-fdbd-4d9a-af1a-3c2369408f26 tempest-ProjectReaderTests-812849349 None] Deleted volume successfully.
Jul 03 01:34:52 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-4c3d8c5b-fdbd-4d9a-af1a-3c2369408f26 tempest-ProjectReaderTests-812849349 None] Lock "cinder-0f3e9190-ecaa-40de-9266-f6f4b2c24724-delete_volume" released by "delete_volume" :: held 2.418s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:34:52 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e712a2e-5fb4-4f4b-8a4b-c8fe51124687 tempest-ProjectReaderTests-812849349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:34:52 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-9e712a2e-5fb4-4f4b-8a4b-c8fe51124687 tempest-ProjectReaderTests-812849349 None] Flow 'volume_create_manager' (1fd1d4fa-1253-45dc-a14f-ea25f8bee765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:34:52 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-9e712a2e-5fb4-4f4b-8a4b-c8fe51124687 tempest-ProjectReaderTests-812849349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cc2c831-ce6e-4114-88d4-c4a5b624937f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:34:52 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-9e712a2e-5fb4-4f4b-8a4b-c8fe51124687 tempest-ProjectReaderTests-812849349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cc2c831-ce6e-4114-88d4-c4a5b624937f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:34:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-370392339',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d14325e8-b123-41cd-a579-9058080879f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5434f12e1ba472a853c0eeeee49097f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:34:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:34:53Z,use_quota=True,user_id='8473987273274ccf818181429aafb11a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:34:52 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-9e712a2e-5fb4-4f4b-8a4b-c8fe51124687 tempest-ProjectReaderTests-812849349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c69ae7f-a3f2-41c6-beb3-cec19576a45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:34:52 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-9e712a2e-5fb4-4f4b-8a4b-c8fe51124687 tempest-ProjectReaderTests-812849349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c69ae7f-a3f2-41c6-beb3-cec19576a45c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:34:52 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-9e712a2e-5fb4-4f4b-8a4b-c8fe51124687 tempest-ProjectReaderTests-812849349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3bdc81e-b4a2-44ed-aa74-9e77e0c93be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:34:52 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-9e712a2e-5fb4-4f4b-8a4b-c8fe51124687 tempest-ProjectReaderTests-812849349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3bdc81e-b4a2-44ed-aa74-9e77e0c93be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd14325e8-b123-41cd-a579-9058080879f9', 'volume_name': 'volume-d14325e8-b123-41cd-a579-9058080879f9', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:34:52 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-9e712a2e-5fb4-4f4b-8a4b-c8fe51124687 tempest-ProjectReaderTests-812849349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc178958-a7d8-4be6-8d55-6f91fc4892be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:34:52 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-9e712a2e-5fb4-4f4b-8a4b-c8fe51124687 tempest-ProjectReaderTests-812849349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc178958-a7d8-4be6-8d55-6f91fc4892be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:34:52 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-9e712a2e-5fb4-4f4b-8a4b-c8fe51124687 tempest-ProjectReaderTests-812849349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d97b3a8-953e-4ad6-9ad0-a46c6c4c0e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:34:52 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-9e712a2e-5fb4-4f4b-8a4b-c8fe51124687 tempest-ProjectReaderTests-812849349 None] Volume d14325e8-b123-41cd-a579-9058080879f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d14325e8-b123-41cd-a579-9058080879f9', 'volume_size': 1}
Jul 03 01:34:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-9e712a2e-5fb4-4f4b-8a4b-c8fe51124687 tempest-ProjectReaderTests-812849349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:34:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-9e712a2e-5fb4-4f4b-8a4b-c8fe51124687 tempest-ProjectReaderTests-812849349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:34:52 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-9e712a2e-5fb4-4f4b-8a4b-c8fe51124687 tempest-ProjectReaderTests-812849349 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:34:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-370392339',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d14325e8-b123-41cd-a579-9058080879f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5434f12e1ba472a853c0eeeee49097f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:34:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:34:53Z,use_quota=True,user_id='8473987273274ccf818181429aafb11a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:34:52 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-9e712a2e-5fb4-4f4b-8a4b-c8fe51124687 tempest-ProjectReaderTests-812849349 None] Creating volume d14325e8-b123-41cd-a579-9058080879f9 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:34:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-9e712a2e-5fb4-4f4b-8a4b-c8fe51124687 tempest-ProjectReaderTests-812849349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:34:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-9e712a2e-5fb4-4f4b-8a4b-c8fe51124687 tempest-ProjectReaderTests-812849349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:34:52 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-9e712a2e-5fb4-4f4b-8a4b-c8fe51124687 tempest-ProjectReaderTests-812849349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:34:52 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-9e712a2e-5fb4-4f4b-8a4b-c8fe51124687 tempest-ProjectReaderTests-812849349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:34:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-9e712a2e-5fb4-4f4b-8a4b-c8fe51124687 tempest-ProjectReaderTests-812849349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:34:52 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-9e712a2e-5fb4-4f4b-8a4b-c8fe51124687 tempest-ProjectReaderTests-812849349 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:34:52 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-9e712a2e-5fb4-4f4b-8a4b-c8fe51124687 tempest-ProjectReaderTests-812849349 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:34:52 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9e712a2e-5fb4-4f4b-8a4b-c8fe51124687 tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d14325e8-b123-41cd-a579-9058080879f9 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:52 devstack sudo[108395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d14325e8-b123-41cd-a579-9058080879f9 1073741824
Jul 03 01:34:52 devstack sudo[108395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:53 devstack sudo[108393]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-c0c09154-2473-4a5b-bf26-6d976ae92ec4 tempest-ProjectReaderTests-1240934792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.702s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:53 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-c0c09154-2473-4a5b-bf26-6d976ae92ec4 tempest-ProjectReaderTests-1240934792 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:34:53 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-c0c09154-2473-4a5b-bf26-6d976ae92ec4 tempest-ProjectReaderTests-1240934792 None] Deleted volume successfully.
Jul 03 01:34:53 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-c0c09154-2473-4a5b-bf26-6d976ae92ec4 tempest-ProjectReaderTests-1240934792 None] Lock "cinder-af07ab5d-8aa0-41c6-9f84-3a6261f606ee-delete_volume" released by "delete_volume" :: held 2.420s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:34:53 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8ef47c5-7cbf-4d17-b118-ea8adebfa90e tempest-ProjectReaderTests-1240934792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:34:53 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b8ef47c5-7cbf-4d17-b118-ea8adebfa90e tempest-ProjectReaderTests-1240934792 None] Flow 'volume_create_manager' (a75a25a3-b5bb-4341-8c4d-0b5d9af8b44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:34:53 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b8ef47c5-7cbf-4d17-b118-ea8adebfa90e tempest-ProjectReaderTests-1240934792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd83ec08-2e26-4971-a9f7-f9dbd401812c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:34:53 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b8ef47c5-7cbf-4d17-b118-ea8adebfa90e tempest-ProjectReaderTests-1240934792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd83ec08-2e26-4971-a9f7-f9dbd401812c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:34:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2079189588',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c315f4f-9c74-43f5-bb3e-fc0f2ca9daf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffc4ee389a2b474ca731cc046abf8796',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:34:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:34:53Z,use_quota=True,user_id='33a87daf39d04ee99138b9fa3efd4d37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:34:53 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b8ef47c5-7cbf-4d17-b118-ea8adebfa90e tempest-ProjectReaderTests-1240934792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40ec00fa-0abe-47bb-adea-18dc10f72650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:34:53 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b8ef47c5-7cbf-4d17-b118-ea8adebfa90e tempest-ProjectReaderTests-1240934792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40ec00fa-0abe-47bb-adea-18dc10f72650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:34:53 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b8ef47c5-7cbf-4d17-b118-ea8adebfa90e tempest-ProjectReaderTests-1240934792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b422a35a-1389-43b8-b30b-99c6c2ff778d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:34:53 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b8ef47c5-7cbf-4d17-b118-ea8adebfa90e tempest-ProjectReaderTests-1240934792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b422a35a-1389-43b8-b30b-99c6c2ff778d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c315f4f-9c74-43f5-bb3e-fc0f2ca9daf6', 'volume_name': 'volume-1c315f4f-9c74-43f5-bb3e-fc0f2ca9daf6', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:34:53 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b8ef47c5-7cbf-4d17-b118-ea8adebfa90e tempest-ProjectReaderTests-1240934792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0fc25c7-5775-437b-8b9f-f2de1a17b63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:34:53 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b8ef47c5-7cbf-4d17-b118-ea8adebfa90e tempest-ProjectReaderTests-1240934792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0fc25c7-5775-437b-8b9f-f2de1a17b63c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:34:53 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b8ef47c5-7cbf-4d17-b118-ea8adebfa90e tempest-ProjectReaderTests-1240934792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17eb0049-92ef-47af-bf2b-a26311ed3b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:34:53 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-b8ef47c5-7cbf-4d17-b118-ea8adebfa90e tempest-ProjectReaderTests-1240934792 None] Volume 1c315f4f-9c74-43f5-bb3e-fc0f2ca9daf6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c315f4f-9c74-43f5-bb3e-fc0f2ca9daf6', 'volume_size': 1}
Jul 03 01:34:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b8ef47c5-7cbf-4d17-b118-ea8adebfa90e tempest-ProjectReaderTests-1240934792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:34:53 devstack sudo[108395]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9e712a2e-5fb4-4f4b-8a4b-c8fe51124687 tempest-ProjectReaderTests-812849349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d14325e8-b123-41cd-a579-9058080879f9 1073741824" returned: 0 in 0.858s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:53 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9e712a2e-5fb4-4f4b-8a4b-c8fe51124687 tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d14325e8-b123-41cd-a579-9058080879f9 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:53 devstack sudo[108402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d14325e8-b123-41cd-a579-9058080879f9
Jul 03 01:34:53 devstack sudo[108402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:54 devstack sudo[108402]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:54 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9e712a2e-5fb4-4f4b-8a4b-c8fe51124687 tempest-ProjectReaderTests-812849349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d14325e8-b123-41cd-a579-9058080879f9" returned: 0 in 0.642s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:54 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-9e712a2e-5fb4-4f4b-8a4b-c8fe51124687 tempest-ProjectReaderTests-812849349 None] <== create_volume: return (1543ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:34:54 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-9e712a2e-5fb4-4f4b-8a4b-c8fe51124687 tempest-ProjectReaderTests-812849349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.545s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:34:54 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b8ef47c5-7cbf-4d17-b118-ea8adebfa90e tempest-ProjectReaderTests-1240934792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.927s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:34:54 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-b8ef47c5-7cbf-4d17-b118-ea8adebfa90e tempest-ProjectReaderTests-1240934792 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:34:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2079189588',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c315f4f-9c74-43f5-bb3e-fc0f2ca9daf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffc4ee389a2b474ca731cc046abf8796',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:34:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:34:53Z,use_quota=True,user_id='33a87daf39d04ee99138b9fa3efd4d37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:34:54 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-b8ef47c5-7cbf-4d17-b118-ea8adebfa90e tempest-ProjectReaderTests-1240934792 None] Creating volume 1c315f4f-9c74-43f5-bb3e-fc0f2ca9daf6 {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:34:54 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b8ef47c5-7cbf-4d17-b118-ea8adebfa90e tempest-ProjectReaderTests-1240934792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:34:54 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b8ef47c5-7cbf-4d17-b118-ea8adebfa90e tempest-ProjectReaderTests-1240934792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:34:54 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-b8ef47c5-7cbf-4d17-b118-ea8adebfa90e tempest-ProjectReaderTests-1240934792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:34:54 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-b8ef47c5-7cbf-4d17-b118-ea8adebfa90e tempest-ProjectReaderTests-1240934792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:34:54 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b8ef47c5-7cbf-4d17-b118-ea8adebfa90e tempest-ProjectReaderTests-1240934792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:34:54 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-b8ef47c5-7cbf-4d17-b118-ea8adebfa90e tempest-ProjectReaderTests-1240934792 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:34:54 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-b8ef47c5-7cbf-4d17-b118-ea8adebfa90e tempest-ProjectReaderTests-1240934792 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:34:54 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b8ef47c5-7cbf-4d17-b118-ea8adebfa90e tempest-ProjectReaderTests-1240934792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1c315f4f-9c74-43f5-bb3e-fc0f2ca9daf6 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:54 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-9e712a2e-5fb4-4f4b-8a4b-c8fe51124687 tempest-ProjectReaderTests-812849349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d97b3a8-953e-4ad6-9ad0-a46c6c4c0e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d14325e8-b123-41cd-a579-9058080879f9', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:34:54 devstack sudo[108405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1c315f4f-9c74-43f5-bb3e-fc0f2ca9daf6 1073741824
Jul 03 01:34:54 devstack sudo[108405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:54 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-9e712a2e-5fb4-4f4b-8a4b-c8fe51124687 tempest-ProjectReaderTests-812849349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5df02694-0ba2-46da-8c7c-2cb9f499a307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:34:54 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-9e712a2e-5fb4-4f4b-8a4b-c8fe51124687 tempest-ProjectReaderTests-812849349 None] Volume volume-d14325e8-b123-41cd-a579-9058080879f9 (d14325e8-b123-41cd-a579-9058080879f9): created successfully
Jul 03 01:34:54 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-9e712a2e-5fb4-4f4b-8a4b-c8fe51124687 tempest-ProjectReaderTests-812849349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5df02694-0ba2-46da-8c7c-2cb9f499a307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:34:54 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-9e712a2e-5fb4-4f4b-8a4b-c8fe51124687 tempest-ProjectReaderTests-812849349 None] Flow 'volume_create_manager' (1fd1d4fa-1253-45dc-a14f-ea25f8bee765) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:34:54 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-9e712a2e-5fb4-4f4b-8a4b-c8fe51124687 tempest-ProjectReaderTests-812849349 None] Created volume successfully.
Jul 03 01:34:54 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-d8d839d4-d6c0-4b67-bbcf-3e2d95009047 tempest-ProjectReaderTests-812849349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:34:55 devstack sudo[108405]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b8ef47c5-7cbf-4d17-b118-ea8adebfa90e tempest-ProjectReaderTests-1240934792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1c315f4f-9c74-43f5-bb3e-fc0f2ca9daf6 1073741824" returned: 0 in 0.848s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b8ef47c5-7cbf-4d17-b118-ea8adebfa90e tempest-ProjectReaderTests-1240934792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1c315f4f-9c74-43f5-bb3e-fc0f2ca9daf6 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:55 devstack sudo[108410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1c315f4f-9c74-43f5-bb3e-fc0f2ca9daf6
Jul 03 01:34:55 devstack sudo[108410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:55 devstack sudo[108410]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-b8ef47c5-7cbf-4d17-b118-ea8adebfa90e tempest-ProjectReaderTests-1240934792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1c315f4f-9c74-43f5-bb3e-fc0f2ca9daf6" returned: 0 in 0.649s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:55 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-b8ef47c5-7cbf-4d17-b118-ea8adebfa90e tempest-ProjectReaderTests-1240934792 None] <== create_volume: return (1531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:34:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-b8ef47c5-7cbf-4d17-b118-ea8adebfa90e tempest-ProjectReaderTests-1240934792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.534s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:34:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-d8d839d4-d6c0-4b67-bbcf-3e2d95009047 tempest-ProjectReaderTests-812849349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.956s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:34:55 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-d8d839d4-d6c0-4b67-bbcf-3e2d95009047 tempest-ProjectReaderTests-812849349 None] Creating offline snapshot cd6a0365-8ef6-4807-a8af-bc1d52b6289d of volume d14325e8-b123-41cd-a579-9058080879f9 {{(pid=86891) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 01:34:55 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b8ef47c5-7cbf-4d17-b118-ea8adebfa90e tempest-ProjectReaderTests-1240934792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17eb0049-92ef-47af-bf2b-a26311ed3b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c315f4f-9c74-43f5-bb3e-fc0f2ca9daf6', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:34:55 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b8ef47c5-7cbf-4d17-b118-ea8adebfa90e tempest-ProjectReaderTests-1240934792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e0f6808-b89e-4b9b-a0e6-45567324fa70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:34:55 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd249cc-0504-4cb6-917b-453cfe7593ed]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:34:55 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d8d839d4-d6c0-4b67-bbcf-3e2d95009047 tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d14325e8-b123-41cd-a579-9058080879f9 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:55 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-b8ef47c5-7cbf-4d17-b118-ea8adebfa90e tempest-ProjectReaderTests-1240934792 None] Volume volume-1c315f4f-9c74-43f5-bb3e-fc0f2ca9daf6 (1c315f4f-9c74-43f5-bb3e-fc0f2ca9daf6): created successfully
Jul 03 01:34:55 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b8ef47c5-7cbf-4d17-b118-ea8adebfa90e tempest-ProjectReaderTests-1240934792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e0f6808-b89e-4b9b-a0e6-45567324fa70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:34:55 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-b8ef47c5-7cbf-4d17-b118-ea8adebfa90e tempest-ProjectReaderTests-1240934792 None] Flow 'volume_create_manager' (a75a25a3-b5bb-4341-8c4d-0b5d9af8b44c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:34:55 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-b8ef47c5-7cbf-4d17-b118-ea8adebfa90e tempest-ProjectReaderTests-1240934792 None] Created volume successfully.
Jul 03 01:34:56 devstack sudo[108413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d14325e8-b123-41cd-a579-9058080879f9
Jul 03 01:34:56 devstack sudo[108413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:56 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-46075e7f-682b-4134-9f66-91c95f0c8244 tempest-ProjectReaderTests-1240934792 None] Acquiring lock "cinder-1c315f4f-9c74-43f5-bb3e-fc0f2ca9daf6-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:34:56 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-46075e7f-682b-4134-9f66-91c95f0c8244 tempest-ProjectReaderTests-1240934792 None] Lock "cinder-1c315f4f-9c74-43f5-bb3e-fc0f2ca9daf6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:34:56 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-46075e7f-682b-4134-9f66-91c95f0c8244 tempest-ProjectReaderTests-1240934792 None] Acquiring lock "cinder-quobyte-1c315f4f-9c74-43f5-bb3e-fc0f2ca9daf6" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:34:56 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-46075e7f-682b-4134-9f66-91c95f0c8244 tempest-ProjectReaderTests-1240934792 None] Lock "cinder-quobyte-1c315f4f-9c74-43f5-bb3e-fc0f2ca9daf6" acquired by "delete_volume" :: waited 0.022s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:34:56 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06cdcbf-b73b-4283-b84b-c22c33fd0b12]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:34:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-46075e7f-682b-4134-9f66-91c95f0c8244 tempest-ProjectReaderTests-1240934792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1c315f4f-9c74-43f5-bb3e-fc0f2ca9daf6 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:56 devstack sudo[108413]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d8d839d4-d6c0-4b67-bbcf-3e2d95009047 tempest-ProjectReaderTests-812849349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d14325e8-b123-41cd-a579-9058080879f9" returned: 0 in 0.760s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:56 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d8d839d4-d6c0-4b67-bbcf-3e2d95009047 tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d14325e8-b123-41cd-a579-9058080879f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d14325e8-b123-41cd-a579-9058080879f9.cd6a0365-8ef6-4807-a8af-bc1d52b6289d 1G {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:56 devstack sudo[108420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d14325e8-b123-41cd-a579-9058080879f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d14325e8-b123-41cd-a579-9058080879f9.cd6a0365-8ef6-4807-a8af-bc1d52b6289d 1G
Jul 03 01:34:56 devstack sudo[108420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:56 devstack sudo[108419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1c315f4f-9c74-43f5-bb3e-fc0f2ca9daf6
Jul 03 01:34:56 devstack sudo[108419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:57 devstack sudo[108419]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-46075e7f-682b-4134-9f66-91c95f0c8244 tempest-ProjectReaderTests-1240934792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1c315f4f-9c74-43f5-bb3e-fc0f2ca9daf6" returned: 0 in 0.762s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-46075e7f-682b-4134-9f66-91c95f0c8244 tempest-ProjectReaderTests-1240934792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1c315f4f-9c74-43f5-bb3e-fc0f2ca9daf6 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:57 devstack sudo[108429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1c315f4f-9c74-43f5-bb3e-fc0f2ca9daf6
Jul 03 01:34:57 devstack sudo[108429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:57 devstack sudo[108420]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d8d839d4-d6c0-4b67-bbcf-3e2d95009047 tempest-ProjectReaderTests-812849349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d14325e8-b123-41cd-a579-9058080879f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d14325e8-b123-41cd-a579-9058080879f9.cd6a0365-8ef6-4807-a8af-bc1d52b6289d 1G" returned: 0 in 0.823s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:57 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d8d839d4-d6c0-4b67-bbcf-3e2d95009047 tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d14325e8-b123-41cd-a579-9058080879f9 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d14325e8-b123-41cd-a579-9058080879f9.cd6a0365-8ef6-4807-a8af-bc1d52b6289d {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:57 devstack sudo[108432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d14325e8-b123-41cd-a579-9058080879f9 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d14325e8-b123-41cd-a579-9058080879f9.cd6a0365-8ef6-4807-a8af-bc1d52b6289d
Jul 03 01:34:57 devstack sudo[108432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:58 devstack sudo[108429]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-46075e7f-682b-4134-9f66-91c95f0c8244 tempest-ProjectReaderTests-1240934792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-1c315f4f-9c74-43f5-bb3e-fc0f2ca9daf6" returned: 0 in 0.662s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:58 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-46075e7f-682b-4134-9f66-91c95f0c8244 tempest-ProjectReaderTests-1240934792 None] Lock "cinder-quobyte-1c315f4f-9c74-43f5-bb3e-fc0f2ca9daf6" released by "delete_volume" :: held 1.468s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:34:58 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-46075e7f-682b-4134-9f66-91c95f0c8244 tempest-ProjectReaderTests-1240934792 None] Created reservations ['fdc02c0a-2134-49e3-b490-e38632bcae36', '440ae666-2f23-4064-b6e8-147297316ae8', '3058f4d7-db38-49d5-975e-d786371bc8b7', '6342dee5-5746-4d7f-a665-f57e1bee74e7'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:34:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-46075e7f-682b-4134-9f66-91c95f0c8244 tempest-ProjectReaderTests-1240934792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:34:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-46075e7f-682b-4134-9f66-91c95f0c8244 tempest-ProjectReaderTests-1240934792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:34:58 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-46075e7f-682b-4134-9f66-91c95f0c8244 tempest-ProjectReaderTests-1240934792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:34:58 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-46075e7f-682b-4134-9f66-91c95f0c8244 tempest-ProjectReaderTests-1240934792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:34:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-46075e7f-682b-4134-9f66-91c95f0c8244 tempest-ProjectReaderTests-1240934792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:34:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-46075e7f-682b-4134-9f66-91c95f0c8244 tempest-ProjectReaderTests-1240934792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:58 devstack sudo[108438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:34:58 devstack sudo[108438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:58 devstack sudo[108432]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d8d839d4-d6c0-4b67-bbcf-3e2d95009047 tempest-ProjectReaderTests-812849349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d14325e8-b123-41cd-a579-9058080879f9 -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d14325e8-b123-41cd-a579-9058080879f9.cd6a0365-8ef6-4807-a8af-bc1d52b6289d" returned: 0 in 0.709s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:58 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-d8d839d4-d6c0-4b67-bbcf-3e2d95009047 tempest-ProjectReaderTests-812849349 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d14325e8-b123-41cd-a579-9058080879f9.cd6a0365-8ef6-4807-a8af-bc1d52b6289d is being set with open permissions: ugo+rw
Jul 03 01:34:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d8d839d4-d6c0-4b67-bbcf-3e2d95009047 tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d14325e8-b123-41cd-a579-9058080879f9.cd6a0365-8ef6-4807-a8af-bc1d52b6289d {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:58 devstack sudo[108440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d14325e8-b123-41cd-a579-9058080879f9.cd6a0365-8ef6-4807-a8af-bc1d52b6289d
Jul 03 01:34:58 devstack sudo[108440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:58 devstack sudo[108438]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-46075e7f-682b-4134-9f66-91c95f0c8244 tempest-ProjectReaderTests-1240934792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.663s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:58 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-46075e7f-682b-4134-9f66-91c95f0c8244 tempest-ProjectReaderTests-1240934792 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:34:58 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-46075e7f-682b-4134-9f66-91c95f0c8244 tempest-ProjectReaderTests-1240934792 None] Deleted volume successfully.
Jul 03 01:34:58 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-46075e7f-682b-4134-9f66-91c95f0c8244 tempest-ProjectReaderTests-1240934792 None] Lock "cinder-1c315f4f-9c74-43f5-bb3e-fc0f2ca9daf6-delete_volume" released by "delete_volume" :: held 2.348s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:34:58 devstack sudo[108440]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d8d839d4-d6c0-4b67-bbcf-3e2d95009047 tempest-ProjectReaderTests-812849349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d14325e8-b123-41cd-a579-9058080879f9.cd6a0365-8ef6-4807-a8af-bc1d52b6289d" returned: 0 in 0.662s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:58 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d8d839d4-d6c0-4b67-bbcf-3e2d95009047 tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d14325e8-b123-41cd-a579-9058080879f9.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:58 devstack sudo[108444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d14325e8-b123-41cd-a579-9058080879f9.info
Jul 03 01:34:58 devstack sudo[108444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:34:59 devstack sudo[108444]: pam_unix(sudo:session): session closed for user root
Jul 03 01:34:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d8d839d4-d6c0-4b67-bbcf-3e2d95009047 tempest-ProjectReaderTests-812849349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d14325e8-b123-41cd-a579-9058080879f9.info" returned: 0 in 0.663s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:34:59 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-d8d839d4-d6c0-4b67-bbcf-3e2d95009047 tempest-ProjectReaderTests-812849349 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d14325e8-b123-41cd-a579-9058080879f9.info is being set with open permissions: ugo+rw
Jul 03 01:34:59 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d8d839d4-d6c0-4b67-bbcf-3e2d95009047 tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d14325e8-b123-41cd-a579-9058080879f9.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:34:59 devstack sudo[108448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d14325e8-b123-41cd-a579-9058080879f9.info
Jul 03 01:34:59 devstack sudo[108448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:35:00 devstack sudo[108448]: pam_unix(sudo:session): session closed for user root
Jul 03 01:35:00 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d8d839d4-d6c0-4b67-bbcf-3e2d95009047 tempest-ProjectReaderTests-812849349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d14325e8-b123-41cd-a579-9058080879f9.info" returned: 0 in 0.692s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:35:00 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-d8d839d4-d6c0-4b67-bbcf-3e2d95009047 tempest-ProjectReaderTests-812849349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.409s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:35:00 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-d8d839d4-d6c0-4b67-bbcf-3e2d95009047 tempest-ProjectReaderTests-812849349 None] Create snapshot completed successfully
Jul 03 01:35:01 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-9877f616-8240-41d9-877d-a770429fd069 tempest-ProjectReaderTests-812849349 None] Acquiring lock "cinder-cd6a0365-8ef6-4807-a8af-bc1d52b6289d-delete_snapshot" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:35:01 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-9877f616-8240-41d9-877d-a770429fd069 tempest-ProjectReaderTests-812849349 None] Lock "cinder-cd6a0365-8ef6-4807-a8af-bc1d52b6289d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:35:01 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-9877f616-8240-41d9-877d-a770429fd069 tempest-ProjectReaderTests-812849349 None] Acquiring lock "cinder-quobyte-d14325e8-b123-41cd-a579-9058080879f9" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:35:01 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-9877f616-8240-41d9-877d-a770429fd069 tempest-ProjectReaderTests-812849349 None] Lock "cinder-quobyte-d14325e8-b123-41cd-a579-9058080879f9" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:35:01 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-9877f616-8240-41d9-877d-a770429fd069 tempest-ProjectReaderTests-812849349 None] Acquiring lock "cinder-quobyte-cd6a0365-8ef6-4807-a8af-bc1d52b6289d" by "_delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:35:01 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-9877f616-8240-41d9-877d-a770429fd069 tempest-ProjectReaderTests-812849349 None] Lock "cinder-quobyte-cd6a0365-8ef6-4807-a8af-bc1d52b6289d" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:35:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-9877f616-8240-41d9-877d-a770429fd069 tempest-ProjectReaderTests-812849349 None] Deleting offline snapshot cd6a0365-8ef6-4807-a8af-bc1d52b6289d of volume d14325e8-b123-41cd-a579-9058080879f9 {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 01:35:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-9877f616-8240-41d9-877d-a770429fd069 tempest-ProjectReaderTests-812849349 None] snapshot_file for this snap is: volume-d14325e8-b123-41cd-a579-9058080879f9.cd6a0365-8ef6-4807-a8af-bc1d52b6289d {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 01:35:01 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de631f6-7c22-48e5-9ff6-101968e47773]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:35:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9877f616-8240-41d9-877d-a770429fd069 tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d14325e8-b123-41cd-a579-9058080879f9.cd6a0365-8ef6-4807-a8af-bc1d52b6289d {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:35:01 devstack sudo[108454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d14325e8-b123-41cd-a579-9058080879f9.cd6a0365-8ef6-4807-a8af-bc1d52b6289d
Jul 03 01:35:01 devstack sudo[108454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:35:01 devstack cinder-volume[86891]: DEBUG oslo_service.periodic_task [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86891) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 01:35:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:35:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:35:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:35:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:35:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:35:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:35:01 devstack sudo[108458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:35:01 devstack sudo[108458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:35:02 devstack sudo[108454]: pam_unix(sudo:session): session closed for user root
Jul 03 01:35:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9877f616-8240-41d9-877d-a770429fd069 tempest-ProjectReaderTests-812849349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d14325e8-b123-41cd-a579-9058080879f9.cd6a0365-8ef6-4807-a8af-bc1d52b6289d" returned: 0 in 0.787s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:35:02 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-9877f616-8240-41d9-877d-a770429fd069 tempest-ProjectReaderTests-812849349 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d14325e8-b123-41cd-a579-9058080879f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:35:02 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb32cee6-51bb-4c54-9da2-64f3c3b39078]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:35:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9877f616-8240-41d9-877d-a770429fd069 tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d14325e8-b123-41cd-a579-9058080879f9 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:35:02 devstack sudo[108461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d14325e8-b123-41cd-a579-9058080879f9
Jul 03 01:35:02 devstack sudo[108461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:35:02 devstack sudo[108458]: pam_unix(sudo:session): session closed for user root
Jul 03 01:35:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.699s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:35:02 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:35:02 devstack cinder-volume[86891]: DEBUG oslo_service.periodic_task [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running periodic task VolumeManager._thread_info {{(pid=86891) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 01:35:02 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] thread count: 28 {{(pid=86891) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 01:35:02 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] thread info: [<_MainThread(MainThread, started 136731296534656)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136731184953280)>, <Thread(Thread-3 (stat_writer), started daemon 136731184058816)>, <Thread(Rabbit-heartbeat, started daemon 136731184846080)>, <Thread(Thread-5 (_runner), started daemon 136731182936576)>, <Thread(Thread-7 (_runner), started daemon 136731182954944)>, <Thread(fd_logger, started daemon 136731181916416)>, <Thread(privsep_reader, started daemon 136731180942208)>, <Thread(tpool_thread_0, started daemon 136731172161216)>, <Thread(tpool_thread_1, started daemon 136731163768512)>, <Thread(tpool_thread_2, started daemon 136731155375808)>, <Thread(tpool_thread_3, started daemon 136731146983104)>, <Thread(tpool_thread_4, started daemon 136731138590400)>, <Thread(tpool_thread_5, started daemon 136731130197696)>, <Thread(tpool_thread_6, started daemon 136731121804992)>, <Thread(tpool_thread_7, started daemon 136731113412288)>, <Thread(tpool_thread_8, started daemon 136731105003200)>, <Thread(tpool_thread_9, started daemon 136731096594112)>, <Thread(tpool_thread_10, started daemon 136731088185024)>, <Thread(tpool_thread_11, started daemon 136731079775936)>, <Thread(tpool_thread_12, started daemon 136731071366848)>, <Thread(tpool_thread_13, started daemon 136731062957760)>, <Thread(tpool_thread_14, started daemon 136731054548672)>, <Thread(tpool_thread_15, started daemon 136731046139584)>, <Thread(tpool_thread_16, started daemon 136731037730496)>, <Thread(tpool_thread_17, started daemon 136731029321408)>, <Thread(tpool_thread_18, started daemon 136731020912320)>, <Thread(tpool_thread_19, started daemon 136731012503232)>] {{(pid=86891) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 01:35:02 devstack sudo[108461]: pam_unix(sudo:session): session closed for user root
Jul 03 01:35:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9877f616-8240-41d9-877d-a770429fd069 tempest-ProjectReaderTests-812849349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d14325e8-b123-41cd-a579-9058080879f9" returned: 0 in 0.846s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:35:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9877f616-8240-41d9-877d-a770429fd069 tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d14325e8-b123-41cd-a579-9058080879f9.cd6a0365-8ef6-4807-a8af-bc1d52b6289d {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:35:03 devstack sudo[108469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d14325e8-b123-41cd-a579-9058080879f9.cd6a0365-8ef6-4807-a8af-bc1d52b6289d
Jul 03 01:35:03 devstack sudo[108469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:35:03 devstack sudo[108469]: pam_unix(sudo:session): session closed for user root
Jul 03 01:35:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9877f616-8240-41d9-877d-a770429fd069 tempest-ProjectReaderTests-812849349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d14325e8-b123-41cd-a579-9058080879f9.cd6a0365-8ef6-4807-a8af-bc1d52b6289d" returned: 0 in 0.750s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:35:03 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9877f616-8240-41d9-877d-a770429fd069 tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d14325e8-b123-41cd-a579-9058080879f9.cd6a0365-8ef6-4807-a8af-bc1d52b6289d {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:35:03 devstack sudo[108474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d14325e8-b123-41cd-a579-9058080879f9.cd6a0365-8ef6-4807-a8af-bc1d52b6289d
Jul 03 01:35:03 devstack sudo[108474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:35:04 devstack sudo[108474]: pam_unix(sudo:session): session closed for user root
Jul 03 01:35:04 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-9877f616-8240-41d9-877d-a770429fd069 tempest-ProjectReaderTests-812849349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d14325e8-b123-41cd-a579-9058080879f9.cd6a0365-8ef6-4807-a8af-bc1d52b6289d" returned: 0 in 0.695s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:35:04 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-9877f616-8240-41d9-877d-a770429fd069 tempest-ProjectReaderTests-812849349 None] Lock "cinder-quobyte-cd6a0365-8ef6-4807-a8af-bc1d52b6289d" released by "_delete_snapshot" :: held 3.182s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:35:04 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-9877f616-8240-41d9-877d-a770429fd069 tempest-ProjectReaderTests-812849349 None] Lock "cinder-quobyte-d14325e8-b123-41cd-a579-9058080879f9" released by "delete_snapshot" :: held 3.203s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:35:04 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-9877f616-8240-41d9-877d-a770429fd069 tempest-ProjectReaderTests-812849349 None] Created reservations ['2e19cae2-8004-44e8-93aa-7bb17a793257', 'f9b4104d-e032-4ebd-9354-b3583026928a', '9e9dff44-4b9b-4841-a0c6-4b23d196119c', '3fc49ed4-fb14-4d64-ba7f-cb0dec6b89ea'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:35:04 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-9877f616-8240-41d9-877d-a770429fd069 tempest-ProjectReaderTests-812849349 None] Delete snapshot completed successfully.
Jul 03 01:35:04 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-9877f616-8240-41d9-877d-a770429fd069 tempest-ProjectReaderTests-812849349 None] Lock "cinder-cd6a0365-8ef6-4807-a8af-bc1d52b6289d-delete_snapshot" released by "delete_snapshot" :: held 3.374s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:35:05 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5743875f-a427-4054-bc09-fd4eb95ffcdf tempest-ProjectReaderTests-812849349 None] Acquiring lock "cinder-d14325e8-b123-41cd-a579-9058080879f9-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:35:05 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5743875f-a427-4054-bc09-fd4eb95ffcdf tempest-ProjectReaderTests-812849349 None] Lock "cinder-d14325e8-b123-41cd-a579-9058080879f9-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:35:05 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5743875f-a427-4054-bc09-fd4eb95ffcdf tempest-ProjectReaderTests-812849349 None] Acquiring lock "cinder-quobyte-d14325e8-b123-41cd-a579-9058080879f9" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:35:05 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5743875f-a427-4054-bc09-fd4eb95ffcdf tempest-ProjectReaderTests-812849349 None] Lock "cinder-quobyte-d14325e8-b123-41cd-a579-9058080879f9" acquired by "delete_volume" :: waited 0.019s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:35:05 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0806620-d85c-401b-89f4-3e76a5218d4c]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:35:05 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5743875f-a427-4054-bc09-fd4eb95ffcdf tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d14325e8-b123-41cd-a579-9058080879f9 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:35:05 devstack sudo[108477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d14325e8-b123-41cd-a579-9058080879f9
Jul 03 01:35:05 devstack sudo[108477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:35:06 devstack sudo[108477]: pam_unix(sudo:session): session closed for user root
Jul 03 01:35:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5743875f-a427-4054-bc09-fd4eb95ffcdf tempest-ProjectReaderTests-812849349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d14325e8-b123-41cd-a579-9058080879f9" returned: 0 in 0.800s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:35:06 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5743875f-a427-4054-bc09-fd4eb95ffcdf tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d14325e8-b123-41cd-a579-9058080879f9 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:35:06 devstack sudo[108482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d14325e8-b123-41cd-a579-9058080879f9
Jul 03 01:35:06 devstack sudo[108482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:35:07 devstack sudo[108482]: pam_unix(sudo:session): session closed for user root
Jul 03 01:35:07 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5743875f-a427-4054-bc09-fd4eb95ffcdf tempest-ProjectReaderTests-812849349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-d14325e8-b123-41cd-a579-9058080879f9" returned: 0 in 0.663s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:35:07 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5743875f-a427-4054-bc09-fd4eb95ffcdf tempest-ProjectReaderTests-812849349 None] Lock "cinder-quobyte-d14325e8-b123-41cd-a579-9058080879f9" released by "delete_volume" :: held 1.529s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:35:07 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-5743875f-a427-4054-bc09-fd4eb95ffcdf tempest-ProjectReaderTests-812849349 None] Created reservations ['1427885f-ef33-4a96-89d2-c555e75b6f8a', 'd1a41186-5943-48f4-87c9-1b12df11bb99', 'cff04887-bd6e-42e9-860b-9f97a1abae53', '032f06e2-0647-46fa-bfec-04663acc7205'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:35:07 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-5743875f-a427-4054-bc09-fd4eb95ffcdf tempest-ProjectReaderTests-812849349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:35:07 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-5743875f-a427-4054-bc09-fd4eb95ffcdf tempest-ProjectReaderTests-812849349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:35:07 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-5743875f-a427-4054-bc09-fd4eb95ffcdf tempest-ProjectReaderTests-812849349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:35:07 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-5743875f-a427-4054-bc09-fd4eb95ffcdf tempest-ProjectReaderTests-812849349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:35:07 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-5743875f-a427-4054-bc09-fd4eb95ffcdf tempest-ProjectReaderTests-812849349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:35:07 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5743875f-a427-4054-bc09-fd4eb95ffcdf tempest-ProjectReaderTests-812849349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:35:07 devstack sudo[108485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:35:07 devstack sudo[108485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:35:07 devstack sudo[108485]: pam_unix(sudo:session): session closed for user root
Jul 03 01:35:07 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5743875f-a427-4054-bc09-fd4eb95ffcdf tempest-ProjectReaderTests-812849349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.653s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:35:07 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-5743875f-a427-4054-bc09-fd4eb95ffcdf tempest-ProjectReaderTests-812849349 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:35:07 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-5743875f-a427-4054-bc09-fd4eb95ffcdf tempest-ProjectReaderTests-812849349 None] Deleted volume successfully.
Jul 03 01:35:07 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-5743875f-a427-4054-bc09-fd4eb95ffcdf tempest-ProjectReaderTests-812849349 None] Lock "cinder-d14325e8-b123-41cd-a579-9058080879f9-delete_volume" released by "delete_volume" :: held 2.487s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:35:17 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:SELECT=69,cinder:INSERT=28,cinder:UPDATE=94,cinder:DELETE=11 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:35:17 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:SELECT=57,cinder:DELETE=5,cinder:INSERT=21,cinder:UPDATE=85 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:35:24 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-5027f37a-1830-4034-b3bb-b44911c0f83e tempest-SnapshotDependencyTests-1272075077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:35:24 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-5027f37a-1830-4034-b3bb-b44911c0f83e tempest-SnapshotDependencyTests-1272075077 None] Flow 'volume_create_manager' (c9dfa325-acbc-4e24-b46c-7e25e77b6629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:35:24 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-5027f37a-1830-4034-b3bb-b44911c0f83e tempest-SnapshotDependencyTests-1272075077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbb7b3b7-1e07-4c65-9ec3-1afad33af666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:35:24 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-5027f37a-1830-4034-b3bb-b44911c0f83e tempest-SnapshotDependencyTests-1272075077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbb7b3b7-1e07-4c65-9ec3-1afad33af666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:35:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1837297247',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ae1ff83f54f4b08b0942ebd8bde5a63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:35:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:35:24Z,use_quota=True,user_id='3c5c7ea28ac34e72af465143b7a41aa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:35:24 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-5027f37a-1830-4034-b3bb-b44911c0f83e tempest-SnapshotDependencyTests-1272075077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (964ae9c1-6dfb-427c-92cd-0a82c65052f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:35:24 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-5027f37a-1830-4034-b3bb-b44911c0f83e tempest-SnapshotDependencyTests-1272075077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (964ae9c1-6dfb-427c-92cd-0a82c65052f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:35:24 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-5027f37a-1830-4034-b3bb-b44911c0f83e tempest-SnapshotDependencyTests-1272075077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf3ec7dc-8d23-4d0c-847f-9d4dabd42025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:35:24 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-5027f37a-1830-4034-b3bb-b44911c0f83e tempest-SnapshotDependencyTests-1272075077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf3ec7dc-8d23-4d0c-847f-9d4dabd42025) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a', 'volume_name': 'volume-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:35:24 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-5027f37a-1830-4034-b3bb-b44911c0f83e tempest-SnapshotDependencyTests-1272075077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96abe0b8-a91f-423b-9fd8-26527e7a035c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:35:24 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-5027f37a-1830-4034-b3bb-b44911c0f83e tempest-SnapshotDependencyTests-1272075077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96abe0b8-a91f-423b-9fd8-26527e7a035c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:35:24 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-5027f37a-1830-4034-b3bb-b44911c0f83e tempest-SnapshotDependencyTests-1272075077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (200f24ad-c80f-4696-8acf-cc8025f4d635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:35:24 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-5027f37a-1830-4034-b3bb-b44911c0f83e tempest-SnapshotDependencyTests-1272075077 None] Volume 7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a', 'volume_size': 1}
Jul 03 01:35:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-5027f37a-1830-4034-b3bb-b44911c0f83e tempest-SnapshotDependencyTests-1272075077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:35:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-5027f37a-1830-4034-b3bb-b44911c0f83e tempest-SnapshotDependencyTests-1272075077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:35:24 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-5027f37a-1830-4034-b3bb-b44911c0f83e tempest-SnapshotDependencyTests-1272075077 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c5b35cc92b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:35:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1837297247',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ae1ff83f54f4b08b0942ebd8bde5a63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:35:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:35:24Z,use_quota=True,user_id='3c5c7ea28ac34e72af465143b7a41aa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)}" {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 01:35:24 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-5027f37a-1830-4034-b3bb-b44911c0f83e tempest-SnapshotDependencyTests-1272075077 None] Creating volume 7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a {{(pid=86891) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 01:35:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-5027f37a-1830-4034-b3bb-b44911c0f83e tempest-SnapshotDependencyTests-1272075077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:35:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-5027f37a-1830-4034-b3bb-b44911c0f83e tempest-SnapshotDependencyTests-1272075077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:35:24 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-5027f37a-1830-4034-b3bb-b44911c0f83e tempest-SnapshotDependencyTests-1272075077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:35:24 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-5027f37a-1830-4034-b3bb-b44911c0f83e tempest-SnapshotDependencyTests-1272075077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:35:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-5027f37a-1830-4034-b3bb-b44911c0f83e tempest-SnapshotDependencyTests-1272075077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:35:24 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-5027f37a-1830-4034-b3bb-b44911c0f83e tempest-SnapshotDependencyTests-1272075077 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:35:24 devstack cinder-volume[86891]: INFO cinder.volume.drivers.remotefs [None req-5027f37a-1830-4034-b3bb-b44911c0f83e tempest-SnapshotDependencyTests-1272075077 None] casted to osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3
Jul 03 01:35:24 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5027f37a-1830-4034-b3bb-b44911c0f83e tempest-SnapshotDependencyTests-1272075077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a 1073741824 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:35:24 devstack sudo[108495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a 1073741824
Jul 03 01:35:24 devstack sudo[108495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:35:25 devstack sudo[108495]: pam_unix(sudo:session): session closed for user root
Jul 03 01:35:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5027f37a-1830-4034-b3bb-b44911c0f83e tempest-SnapshotDependencyTests-1272075077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a 1073741824" returned: 0 in 0.788s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:35:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5027f37a-1830-4034-b3bb-b44911c0f83e tempest-SnapshotDependencyTests-1272075077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:35:25 devstack sudo[108500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a
Jul 03 01:35:25 devstack sudo[108500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:35:25 devstack sudo[108500]: pam_unix(sudo:session): session closed for user root
Jul 03 01:35:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-5027f37a-1830-4034-b3bb-b44911c0f83e tempest-SnapshotDependencyTests-1272075077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a" returned: 0 in 0.630s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:35:25 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-5027f37a-1830-4034-b3bb-b44911c0f83e tempest-SnapshotDependencyTests-1272075077 None] <== create_volume: return (1459ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'} {{(pid=86891) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 01:35:25 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-5027f37a-1830-4034-b3bb-b44911c0f83e tempest-SnapshotDependencyTests-1272075077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.462s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:35:25 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-5027f37a-1830-4034-b3bb-b44911c0f83e tempest-SnapshotDependencyTests-1272075077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (200f24ad-c80f-4696-8acf-cc8025f4d635) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a', 'volume_size': 1}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:35:25 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-5027f37a-1830-4034-b3bb-b44911c0f83e tempest-SnapshotDependencyTests-1272075077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (672440fa-a8c6-4376-ada3-c46aaf4f1eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:35:25 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-5027f37a-1830-4034-b3bb-b44911c0f83e tempest-SnapshotDependencyTests-1272075077 None] Volume volume-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a (7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a): created successfully
Jul 03 01:35:25 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-5027f37a-1830-4034-b3bb-b44911c0f83e tempest-SnapshotDependencyTests-1272075077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (672440fa-a8c6-4376-ada3-c46aaf4f1eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:35:25 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-5027f37a-1830-4034-b3bb-b44911c0f83e tempest-SnapshotDependencyTests-1272075077 None] Flow 'volume_create_manager' (c9dfa325-acbc-4e24-b46c-7e25e77b6629) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:35:25 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-5027f37a-1830-4034-b3bb-b44911c0f83e tempest-SnapshotDependencyTests-1272075077 None] Created volume successfully.
Jul 03 01:35:26 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-d354b5c2-8f8b-41c5-9518-f55a2ebf4d46 tempest-SnapshotDependencyTests-1272075077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:35:26 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-d354b5c2-8f8b-41c5-9518-f55a2ebf4d46 tempest-SnapshotDependencyTests-1272075077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:35:26 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-d354b5c2-8f8b-41c5-9518-f55a2ebf4d46 tempest-SnapshotDependencyTests-1272075077 None] Creating offline snapshot 96956cb8-c988-4c15-b036-8d5931eb08e0 of volume 7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a {{(pid=86891) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 01:35:26 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[70171079-9d50-4483-a0f2-30fd104ea564]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:35:26 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d354b5c2-8f8b-41c5-9518-f55a2ebf4d46 tempest-SnapshotDependencyTests-1272075077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:35:26 devstack sudo[108503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a
Jul 03 01:35:26 devstack sudo[108503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:35:27 devstack sudo[108503]: pam_unix(sudo:session): session closed for user root
Jul 03 01:35:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d354b5c2-8f8b-41c5-9518-f55a2ebf4d46 tempest-SnapshotDependencyTests-1272075077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a" returned: 0 in 0.721s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:35:27 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d354b5c2-8f8b-41c5-9518-f55a2ebf4d46 tempest-SnapshotDependencyTests-1272075077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a.96956cb8-c988-4c15-b036-8d5931eb08e0 1G {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:35:27 devstack sudo[108508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a.96956cb8-c988-4c15-b036-8d5931eb08e0 1G
Jul 03 01:35:27 devstack sudo[108508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:35:28 devstack sudo[108508]: pam_unix(sudo:session): session closed for user root
Jul 03 01:35:28 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d354b5c2-8f8b-41c5-9518-f55a2ebf4d46 tempest-SnapshotDependencyTests-1272075077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a.96956cb8-c988-4c15-b036-8d5931eb08e0 1G" returned: 0 in 0.795s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:35:28 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d354b5c2-8f8b-41c5-9518-f55a2ebf4d46 tempest-SnapshotDependencyTests-1272075077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a.96956cb8-c988-4c15-b036-8d5931eb08e0 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:35:28 devstack sudo[108513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a.96956cb8-c988-4c15-b036-8d5931eb08e0
Jul 03 01:35:28 devstack sudo[108513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:35:28 devstack sudo[108513]: pam_unix(sudo:session): session closed for user root
Jul 03 01:35:28 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d354b5c2-8f8b-41c5-9518-f55a2ebf4d46 tempest-SnapshotDependencyTests-1272075077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a -F qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a.96956cb8-c988-4c15-b036-8d5931eb08e0" returned: 0 in 0.665s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:35:28 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-d354b5c2-8f8b-41c5-9518-f55a2ebf4d46 tempest-SnapshotDependencyTests-1272075077 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a.96956cb8-c988-4c15-b036-8d5931eb08e0 is being set with open permissions: ugo+rw
Jul 03 01:35:28 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d354b5c2-8f8b-41c5-9518-f55a2ebf4d46 tempest-SnapshotDependencyTests-1272075077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a.96956cb8-c988-4c15-b036-8d5931eb08e0 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:35:28 devstack sudo[108518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a.96956cb8-c988-4c15-b036-8d5931eb08e0
Jul 03 01:35:28 devstack sudo[108518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:35:29 devstack sudo[108518]: pam_unix(sudo:session): session closed for user root
Jul 03 01:35:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d354b5c2-8f8b-41c5-9518-f55a2ebf4d46 tempest-SnapshotDependencyTests-1272075077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a.96956cb8-c988-4c15-b036-8d5931eb08e0" returned: 0 in 0.610s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:35:29 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d354b5c2-8f8b-41c5-9518-f55a2ebf4d46 tempest-SnapshotDependencyTests-1272075077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:35:29 devstack sudo[108522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a.info
Jul 03 01:35:29 devstack sudo[108522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:35:30 devstack sudo[108522]: pam_unix(sudo:session): session closed for user root
Jul 03 01:35:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d354b5c2-8f8b-41c5-9518-f55a2ebf4d46 tempest-SnapshotDependencyTests-1272075077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a.info" returned: 0 in 0.627s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:35:30 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-d354b5c2-8f8b-41c5-9518-f55a2ebf4d46 tempest-SnapshotDependencyTests-1272075077 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a.info is being set with open permissions: ugo+rw
Jul 03 01:35:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d354b5c2-8f8b-41c5-9518-f55a2ebf4d46 tempest-SnapshotDependencyTests-1272075077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a.info {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:35:30 devstack sudo[108525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a.info
Jul 03 01:35:30 devstack sudo[108525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:35:30 devstack sudo[108525]: pam_unix(sudo:session): session closed for user root
Jul 03 01:35:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-d354b5c2-8f8b-41c5-9518-f55a2ebf4d46 tempest-SnapshotDependencyTests-1272075077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a.info" returned: 0 in 0.614s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:35:30 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-d354b5c2-8f8b-41c5-9518-f55a2ebf4d46 tempest-SnapshotDependencyTests-1272075077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.115s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:35:30 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-d354b5c2-8f8b-41c5-9518-f55a2ebf4d46 tempest-SnapshotDependencyTests-1272075077 None] Create snapshot completed successfully
Jul 03 01:35:32 devstack cinder-volume[86891]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b14a518-c20f-4d50-acd8-adb5d3558047 tempest-SnapshotDependencyTests-1272075077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86891) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 01:35:32 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1b14a518-c20f-4d50-acd8-adb5d3558047 tempest-SnapshotDependencyTests-1272075077 None] Flow 'volume_create_manager' (2a64a4d0-8b3c-4c84-b96c-9b85c34c7131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:35:32 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1b14a518-c20f-4d50-acd8-adb5d3558047 tempest-SnapshotDependencyTests-1272075077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ff2f968-39b4-4c44-b5ea-2e7d084d2d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:35:32 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1b14a518-c20f-4d50-acd8-adb5d3558047 tempest-SnapshotDependencyTests-1272075077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ff2f968-39b4-4c44-b5ea-2e7d084d2d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-02T23:35:32Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfa481a5-0383-40c0-bb70-db318abb5c9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ae1ff83f54f4b08b0942ebd8bde5a63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:35:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=96956cb8-c988-4c15-b036-8d5931eb08e0,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:35:32Z,use_quota=True,user_id='3c5c7ea28ac34e72af465143b7a41aa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3bfc925-31ef-46b7-ad4d-540ac98a61f2),volume_type_id=d3bfc925-31ef-46b7-ad4d-540ac98a61f2)' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:35:32 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1b14a518-c20f-4d50-acd8-adb5d3558047 tempest-SnapshotDependencyTests-1272075077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0700d463-f8c2-4488-8931-417d95954db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:35:32 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1b14a518-c20f-4d50-acd8-adb5d3558047 tempest-SnapshotDependencyTests-1272075077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0700d463-f8c2-4488-8931-417d95954db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:35:32 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1b14a518-c20f-4d50-acd8-adb5d3558047 tempest-SnapshotDependencyTests-1272075077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04af4403-a62d-48a2-be55-af40cf55faa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:35:32 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1b14a518-c20f-4d50-acd8-adb5d3558047 tempest-SnapshotDependencyTests-1272075077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04af4403-a62d-48a2-be55-af40cf55faa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'dfa481a5-0383-40c0-bb70-db318abb5c9f', 'volume_name': 'volume-dfa481a5-0383-40c0-bb70-db318abb5c9f', 'volume_size': 1, 'snapshot_id': '96956cb8-c988-4c15-b036-8d5931eb08e0'}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:35:32 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1b14a518-c20f-4d50-acd8-adb5d3558047 tempest-SnapshotDependencyTests-1272075077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e81f6140-0a89-49be-ac1c-8a90363fedd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:35:32 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1b14a518-c20f-4d50-acd8-adb5d3558047 tempest-SnapshotDependencyTests-1272075077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e81f6140-0a89-49be-ac1c-8a90363fedd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:35:32 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1b14a518-c20f-4d50-acd8-adb5d3558047 tempest-SnapshotDependencyTests-1272075077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f11b39d0-fca8-4eba-a96d-f4b8f1184dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:35:32 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-1b14a518-c20f-4d50-acd8-adb5d3558047 tempest-SnapshotDependencyTests-1272075077 None] Volume dfa481a5-0383-40c0-bb70-db318abb5c9f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-dfa481a5-0383-40c0-bb70-db318abb5c9f', 'volume_size': 1, 'snapshot_id': '96956cb8-c988-4c15-b036-8d5931eb08e0'}
Jul 03 01:35:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1b14a518-c20f-4d50-acd8-adb5d3558047 tempest-SnapshotDependencyTests-1272075077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:35:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1b14a518-c20f-4d50-acd8-adb5d3558047 tempest-SnapshotDependencyTests-1272075077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:35:32 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-1b14a518-c20f-4d50-acd8-adb5d3558047 tempest-SnapshotDependencyTests-1272075077 None] Acquiring lock "cinder-quobyte-96956cb8-c988-4c15-b036-8d5931eb08e0-dfa481a5-0383-40c0-bb70-db318abb5c9f" by "_create_volume_from_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:35:32 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-1b14a518-c20f-4d50-acd8-adb5d3558047 tempest-SnapshotDependencyTests-1272075077 None] Lock "cinder-quobyte-96956cb8-c988-4c15-b036-8d5931eb08e0-dfa481a5-0383-40c0-bb70-db318abb5c9f" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:35:32 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-1b14a518-c20f-4d50-acd8-adb5d3558047 tempest-SnapshotDependencyTests-1272075077 None] Creating volume dfa481a5-0383-40c0-bb70-db318abb5c9f from snapshot 96956cb8-c988-4c15-b036-8d5931eb08e0 {{(pid=86891) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 03 01:35:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1b14a518-c20f-4d50-acd8-adb5d3558047 tempest-SnapshotDependencyTests-1272075077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:35:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1b14a518-c20f-4d50-acd8-adb5d3558047 tempest-SnapshotDependencyTests-1272075077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:35:32 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-1b14a518-c20f-4d50-acd8-adb5d3558047 tempest-SnapshotDependencyTests-1272075077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:35:32 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-1b14a518-c20f-4d50-acd8-adb5d3558047 tempest-SnapshotDependencyTests-1272075077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:35:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1b14a518-c20f-4d50-acd8-adb5d3558047 tempest-SnapshotDependencyTests-1272075077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:35:32 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-1b14a518-c20f-4d50-acd8-adb5d3558047 tempest-SnapshotDependencyTests-1272075077 None] Selected osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3 as target Quobyte volume. {{(pid=86891) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 01:35:32 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-1b14a518-c20f-4d50-acd8-adb5d3558047 tempest-SnapshotDependencyTests-1272075077 None] Acquiring lock "cinder-quobyte-dfa481a5-0383-40c0-bb70-db318abb5c9f" by "_copy_volume_from_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:35:32 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-1b14a518-c20f-4d50-acd8-adb5d3558047 tempest-SnapshotDependencyTests-1272075077 None] Lock "cinder-quobyte-dfa481a5-0383-40c0-bb70-db318abb5c9f" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:35:32 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-1b14a518-c20f-4d50-acd8-adb5d3558047 tempest-SnapshotDependencyTests-1272075077 None] snapshot: 96956cb8-c988-4c15-b036-8d5931eb08e0, volume: dfa481a5-0383-40c0-bb70-db318abb5c9f,  {{(pid=86891) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 03 01:35:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1b14a518-c20f-4d50-acd8-adb5d3558047 tempest-SnapshotDependencyTests-1272075077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:35:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1b14a518-c20f-4d50-acd8-adb5d3558047 tempest-SnapshotDependencyTests-1272075077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:35:32 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-1b14a518-c20f-4d50-acd8-adb5d3558047 tempest-SnapshotDependencyTests-1272075077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:35:32 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-1b14a518-c20f-4d50-acd8-adb5d3558047 tempest-SnapshotDependencyTests-1272075077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:35:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1b14a518-c20f-4d50-acd8-adb5d3558047 tempest-SnapshotDependencyTests-1272075077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:35:32 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71cbd10-6212-4c52-aaff-9850bacc87d5]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:35:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1b14a518-c20f-4d50-acd8-adb5d3558047 tempest-SnapshotDependencyTests-1272075077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a.96956cb8-c988-4c15-b036-8d5931eb08e0 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:35:32 devstack sudo[108528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a.96956cb8-c988-4c15-b036-8d5931eb08e0
Jul 03 01:35:32 devstack sudo[108528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:35:33 devstack sudo[108528]: pam_unix(sudo:session): session closed for user root
Jul 03 01:35:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1b14a518-c20f-4d50-acd8-adb5d3558047 tempest-SnapshotDependencyTests-1272075077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a.96956cb8-c988-4c15-b036-8d5931eb08e0" returned: 0 in 0.734s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:35:33 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-1b14a518-c20f-4d50-acd8-adb5d3558047 tempest-SnapshotDependencyTests-1272075077 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:35:33 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-1b14a518-c20f-4d50-acd8-adb5d3558047 tempest-SnapshotDependencyTests-1272075077 None] will copy from snapshot at /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a {{(pid=86891) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 03 01:35:33 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-1b14a518-c20f-4d50-acd8-adb5d3558047 tempest-SnapshotDependencyTests-1272075077 None] Creating direct copy from snapshot {{(pid=86891) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 03 01:35:33 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[2671ecd2-5f15-4535-be0c-660442706f44]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:35:33 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1b14a518-c20f-4d50-acd8-adb5d3558047 tempest-SnapshotDependencyTests-1272075077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:35:33 devstack sudo[108533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a
Jul 03 01:35:33 devstack sudo[108533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:35:34 devstack sudo[108533]: pam_unix(sudo:session): session closed for user root
Jul 03 01:35:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1b14a518-c20f-4d50-acd8-adb5d3558047 tempest-SnapshotDependencyTests-1272075077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a" returned: 0 in 0.749s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:35:34 devstack cinder-volume[86891]: DEBUG cinder.utils [None req-1b14a518-c20f-4d50-acd8-adb5d3558047 tempest-SnapshotDependencyTests-1272075077 None] Path /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-dfa481a5-0383-40c0-bb70-db318abb5c9f not found in is_blk_device check {{(pid=86891) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 03 01:35:34 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1b14a518-c20f-4d50-acd8-adb5d3558047 tempest-SnapshotDependencyTests-1272075077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-dfa481a5-0383-40c0-bb70-db318abb5c9f {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:35:34 devstack sudo[108538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-dfa481a5-0383-40c0-bb70-db318abb5c9f
Jul 03 01:35:34 devstack sudo[108538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:35:38 devstack sudo[108538]: pam_unix(sudo:session): session closed for user root
Jul 03 01:35:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1b14a518-c20f-4d50-acd8-adb5d3558047 tempest-SnapshotDependencyTests-1272075077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-dfa481a5-0383-40c0-bb70-db318abb5c9f" returned: 0 in 4.424s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:35:38 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb80c34-3650-4b85-9c5f-843e46dd416f]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:35:38 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1b14a518-c20f-4d50-acd8-adb5d3558047 tempest-SnapshotDependencyTests-1272075077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:35:38 devstack sudo[108587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a
Jul 03 01:35:38 devstack sudo[108587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:35:39 devstack sudo[108587]: pam_unix(sudo:session): session closed for user root
Jul 03 01:35:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1b14a518-c20f-4d50-acd8-adb5d3558047 tempest-SnapshotDependencyTests-1272075077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a" returned: 0 in 0.903s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:35:39 devstack cinder-volume[86891]: DEBUG cinder.image.image_utils [None req-1b14a518-c20f-4d50-acd8-adb5d3558047 tempest-SnapshotDependencyTests-1272075077 None] Image conversion details: src /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a, size 1024.00 MB, duration 4.42 sec, destination /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-dfa481a5-0383-40c0-bb70-db318abb5c9f {{(pid=86891) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 03 01:35:39 devstack cinder-volume[86891]: INFO cinder.image.image_utils [None req-1b14a518-c20f-4d50-acd8-adb5d3558047 tempest-SnapshotDependencyTests-1272075077 None] Converted 1024.00 MB image at 231.42 MB/s
Jul 03 01:35:39 devstack cinder-volume[86891]: WARNING cinder.volume.drivers.remotefs [None req-1b14a518-c20f-4d50-acd8-adb5d3558047 tempest-SnapshotDependencyTests-1272075077 None] /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-dfa481a5-0383-40c0-bb70-db318abb5c9f is being set with open permissions: ugo+rw
Jul 03 01:35:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1b14a518-c20f-4d50-acd8-adb5d3558047 tempest-SnapshotDependencyTests-1272075077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-dfa481a5-0383-40c0-bb70-db318abb5c9f {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:35:39 devstack sudo[108593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-dfa481a5-0383-40c0-bb70-db318abb5c9f
Jul 03 01:35:39 devstack sudo[108593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:35:39 devstack sudo[108593]: pam_unix(sudo:session): session closed for user root
Jul 03 01:35:39 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-1b14a518-c20f-4d50-acd8-adb5d3558047 tempest-SnapshotDependencyTests-1272075077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-dfa481a5-0383-40c0-bb70-db318abb5c9f" returned: 0 in 0.607s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:35:39 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-1b14a518-c20f-4d50-acd8-adb5d3558047 tempest-SnapshotDependencyTests-1272075077 None] Lock "cinder-quobyte-dfa481a5-0383-40c0-bb70-db318abb5c9f" released by "_copy_volume_from_snapshot" :: held 7.508s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:35:40 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-1b14a518-c20f-4d50-acd8-adb5d3558047 tempest-SnapshotDependencyTests-1272075077 None] Lock "cinder-quobyte-96956cb8-c988-4c15-b036-8d5931eb08e0-dfa481a5-0383-40c0-bb70-db318abb5c9f" released by "_create_volume_from_snapshot" :: held 7.537s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:35:40 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-1b14a518-c20f-4d50-acd8-adb5d3558047 tempest-SnapshotDependencyTests-1272075077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.550s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:35:40 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1b14a518-c20f-4d50-acd8-adb5d3558047 tempest-SnapshotDependencyTests-1272075077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f11b39d0-fca8-4eba-a96d-f4b8f1184dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfa481a5-0383-40c0-bb70-db318abb5c9f', 'volume_size': 1, 'snapshot_id': '96956cb8-c988-4c15-b036-8d5931eb08e0'}' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:35:40 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1b14a518-c20f-4d50-acd8-adb5d3558047 tempest-SnapshotDependencyTests-1272075077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (829e7bcd-c01c-4288-b2ab-a7a227d223fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 01:35:40 devstack cinder-volume[86891]: INFO cinder.volume.flows.manager.create_volume [None req-1b14a518-c20f-4d50-acd8-adb5d3558047 tempest-SnapshotDependencyTests-1272075077 None] Volume volume-dfa481a5-0383-40c0-bb70-db318abb5c9f (dfa481a5-0383-40c0-bb70-db318abb5c9f): created successfully
Jul 03 01:35:40 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1b14a518-c20f-4d50-acd8-adb5d3558047 tempest-SnapshotDependencyTests-1272075077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (829e7bcd-c01c-4288-b2ab-a7a227d223fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86891) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 01:35:40 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1b14a518-c20f-4d50-acd8-adb5d3558047 tempest-SnapshotDependencyTests-1272075077 None] Flow 'volume_create_manager' (2a64a4d0-8b3c-4c84-b96c-9b85c34c7131) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86891) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 01:35:40 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-1b14a518-c20f-4d50-acd8-adb5d3558047 tempest-SnapshotDependencyTests-1272075077 None] Created volume successfully.
Jul 03 01:35:41 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e262d1cd-de04-43e6-a427-ecd338fa9e05 tempest-SnapshotDependencyTests-1272075077 None] Acquiring lock "cinder-96956cb8-c988-4c15-b036-8d5931eb08e0-delete_snapshot" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:35:41 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e262d1cd-de04-43e6-a427-ecd338fa9e05 tempest-SnapshotDependencyTests-1272075077 None] Lock "cinder-96956cb8-c988-4c15-b036-8d5931eb08e0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:35:41 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e262d1cd-de04-43e6-a427-ecd338fa9e05 tempest-SnapshotDependencyTests-1272075077 None] Acquiring lock "cinder-quobyte-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a" by "delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:35:41 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e262d1cd-de04-43e6-a427-ecd338fa9e05 tempest-SnapshotDependencyTests-1272075077 None] Lock "cinder-quobyte-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:35:41 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e262d1cd-de04-43e6-a427-ecd338fa9e05 tempest-SnapshotDependencyTests-1272075077 None] Acquiring lock "cinder-quobyte-96956cb8-c988-4c15-b036-8d5931eb08e0" by "_delete_snapshot" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:35:41 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e262d1cd-de04-43e6-a427-ecd338fa9e05 tempest-SnapshotDependencyTests-1272075077 None] Lock "cinder-quobyte-96956cb8-c988-4c15-b036-8d5931eb08e0" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:35:41 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-e262d1cd-de04-43e6-a427-ecd338fa9e05 tempest-SnapshotDependencyTests-1272075077 None] Deleting offline snapshot 96956cb8-c988-4c15-b036-8d5931eb08e0 of volume 7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 01:35:41 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-e262d1cd-de04-43e6-a427-ecd338fa9e05 tempest-SnapshotDependencyTests-1272075077 None] snapshot_file for this snap is: volume-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a.96956cb8-c988-4c15-b036-8d5931eb08e0 {{(pid=86891) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 01:35:41 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2b7edd-824c-4dbd-99a1-35ac7cdf0f74]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:35:41 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e262d1cd-de04-43e6-a427-ecd338fa9e05 tempest-SnapshotDependencyTests-1272075077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a.96956cb8-c988-4c15-b036-8d5931eb08e0 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:35:41 devstack sudo[108596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a.96956cb8-c988-4c15-b036-8d5931eb08e0
Jul 03 01:35:41 devstack sudo[108596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:35:42 devstack sudo[108596]: pam_unix(sudo:session): session closed for user root
Jul 03 01:35:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e262d1cd-de04-43e6-a427-ecd338fa9e05 tempest-SnapshotDependencyTests-1272075077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a.96956cb8-c988-4c15-b036-8d5931eb08e0" returned: 0 in 0.724s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:35:42 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.remotefs [None req-e262d1cd-de04-43e6-a427-ecd338fa9e05 tempest-SnapshotDependencyTests-1272075077 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86891) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 01:35:42 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf5abef-5f69-452c-b0d6-ccd3387722b9]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:35:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e262d1cd-de04-43e6-a427-ecd338fa9e05 tempest-SnapshotDependencyTests-1272075077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:35:42 devstack sudo[108607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a
Jul 03 01:35:42 devstack sudo[108607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:35:42 devstack sudo[108607]: pam_unix(sudo:session): session closed for user root
Jul 03 01:35:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e262d1cd-de04-43e6-a427-ecd338fa9e05 tempest-SnapshotDependencyTests-1272075077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a" returned: 0 in 0.718s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:35:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e262d1cd-de04-43e6-a427-ecd338fa9e05 tempest-SnapshotDependencyTests-1272075077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a.96956cb8-c988-4c15-b036-8d5931eb08e0 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:35:42 devstack sudo[108612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a.96956cb8-c988-4c15-b036-8d5931eb08e0
Jul 03 01:35:42 devstack sudo[108612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:35:43 devstack sudo[108612]: pam_unix(sudo:session): session closed for user root
Jul 03 01:35:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e262d1cd-de04-43e6-a427-ecd338fa9e05 tempest-SnapshotDependencyTests-1272075077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a.96956cb8-c988-4c15-b036-8d5931eb08e0" returned: 0 in 0.728s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:35:43 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e262d1cd-de04-43e6-a427-ecd338fa9e05 tempest-SnapshotDependencyTests-1272075077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a.96956cb8-c988-4c15-b036-8d5931eb08e0 {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:35:43 devstack sudo[108617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a.96956cb8-c988-4c15-b036-8d5931eb08e0
Jul 03 01:35:43 devstack sudo[108617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:35:44 devstack sudo[108617]: pam_unix(sudo:session): session closed for user root
Jul 03 01:35:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-e262d1cd-de04-43e6-a427-ecd338fa9e05 tempest-SnapshotDependencyTests-1272075077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a.96956cb8-c988-4c15-b036-8d5931eb08e0" returned: 0 in 0.621s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:35:44 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e262d1cd-de04-43e6-a427-ecd338fa9e05 tempest-SnapshotDependencyTests-1272075077 None] Lock "cinder-quobyte-96956cb8-c988-4c15-b036-8d5931eb08e0" released by "_delete_snapshot" :: held 2.878s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:35:44 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e262d1cd-de04-43e6-a427-ecd338fa9e05 tempest-SnapshotDependencyTests-1272075077 None] Lock "cinder-quobyte-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a" released by "delete_snapshot" :: held 2.899s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:35:44 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-e262d1cd-de04-43e6-a427-ecd338fa9e05 tempest-SnapshotDependencyTests-1272075077 None] Created reservations ['1b1c17f4-41fe-4f46-a910-ebe128f15c0f', '6ebc51e4-57db-418d-8bac-b1b135eb9144', '5102aa82-d0ca-4402-8762-3ee90578c313', 'fb16bdda-d38a-4245-a09a-5ee30068c200'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:35:44 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-e262d1cd-de04-43e6-a427-ecd338fa9e05 tempest-SnapshotDependencyTests-1272075077 None] Delete snapshot completed successfully.
Jul 03 01:35:44 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-e262d1cd-de04-43e6-a427-ecd338fa9e05 tempest-SnapshotDependencyTests-1272075077 None] Lock "cinder-96956cb8-c988-4c15-b036-8d5931eb08e0-delete_snapshot" released by "delete_snapshot" :: held 3.026s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:35:44 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-3c966a07-3a99-4957-a96c-007266457382 tempest-SnapshotDependencyTests-1272075077 None] Acquiring lock "cinder-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:35:44 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-3c966a07-3a99-4957-a96c-007266457382 tempest-SnapshotDependencyTests-1272075077 None] Lock "cinder-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:35:44 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-3c966a07-3a99-4957-a96c-007266457382 tempest-SnapshotDependencyTests-1272075077 None] Acquiring lock "cinder-quobyte-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:35:44 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-3c966a07-3a99-4957-a96c-007266457382 tempest-SnapshotDependencyTests-1272075077 None] Lock "cinder-quobyte-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a" acquired by "delete_volume" :: waited 0.014s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:35:44 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[e457f0fe-0118-43c7-abb8-ab6e581c10f3]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:35:44 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-3c966a07-3a99-4957-a96c-007266457382 tempest-SnapshotDependencyTests-1272075077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:35:44 devstack sudo[108620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a
Jul 03 01:35:44 devstack sudo[108620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:35:45 devstack sudo[108620]: pam_unix(sudo:session): session closed for user root
Jul 03 01:35:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-3c966a07-3a99-4957-a96c-007266457382 tempest-SnapshotDependencyTests-1272075077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a" returned: 0 in 0.740s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:35:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-3c966a07-3a99-4957-a96c-007266457382 tempest-SnapshotDependencyTests-1272075077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:35:45 devstack sudo[108625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a
Jul 03 01:35:45 devstack sudo[108625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:35:45 devstack sudo[108625]: pam_unix(sudo:session): session closed for user root
Jul 03 01:35:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-3c966a07-3a99-4957-a96c-007266457382 tempest-SnapshotDependencyTests-1272075077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a" returned: 0 in 0.620s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:35:45 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-3c966a07-3a99-4957-a96c-007266457382 tempest-SnapshotDependencyTests-1272075077 None] Lock "cinder-quobyte-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a" released by "delete_volume" :: held 1.412s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:35:45 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-3c966a07-3a99-4957-a96c-007266457382 tempest-SnapshotDependencyTests-1272075077 None] Created reservations ['bed76850-fad5-4969-8db4-22b60ab4ca06', 'dfef2712-cded-42ca-b8fb-f4537673d460', 'f62110e4-9ef2-4fb4-b761-901fd385975b', '2f4baf24-b2ee-485c-9352-0e6614a41b87'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:35:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-3c966a07-3a99-4957-a96c-007266457382 tempest-SnapshotDependencyTests-1272075077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:35:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-3c966a07-3a99-4957-a96c-007266457382 tempest-SnapshotDependencyTests-1272075077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:35:45 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-3c966a07-3a99-4957-a96c-007266457382 tempest-SnapshotDependencyTests-1272075077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:35:45 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-3c966a07-3a99-4957-a96c-007266457382 tempest-SnapshotDependencyTests-1272075077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:35:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-3c966a07-3a99-4957-a96c-007266457382 tempest-SnapshotDependencyTests-1272075077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:35:45 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-3c966a07-3a99-4957-a96c-007266457382 tempest-SnapshotDependencyTests-1272075077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:35:46 devstack sudo[108628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:35:46 devstack sudo[108628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:35:46 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-6aa323a8-5847-4b10-87c7-6f6dd3d770f2 tempest-SnapshotDependencyTests-1272075077 None] Acquiring lock "cinder-dfa481a5-0383-40c0-bb70-db318abb5c9f-delete_volume" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:35:46 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-6aa323a8-5847-4b10-87c7-6f6dd3d770f2 tempest-SnapshotDependencyTests-1272075077 None] Lock "cinder-dfa481a5-0383-40c0-bb70-db318abb5c9f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:35:46 devstack sudo[108628]: pam_unix(sudo:session): session closed for user root
Jul 03 01:35:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-3c966a07-3a99-4957-a96c-007266457382 tempest-SnapshotDependencyTests-1272075077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.647s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:35:46 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-3c966a07-3a99-4957-a96c-007266457382 tempest-SnapshotDependencyTests-1272075077 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:35:46 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-3c966a07-3a99-4957-a96c-007266457382 tempest-SnapshotDependencyTests-1272075077 None] Deleted volume successfully.
Jul 03 01:35:46 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-3c966a07-3a99-4957-a96c-007266457382 tempest-SnapshotDependencyTests-1272075077 None] Lock "cinder-7f65fd8a-95d4-4b60-ae6e-72a22c3ad65a-delete_volume" released by "delete_volume" :: held 2.251s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:35:46 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-6aa323a8-5847-4b10-87c7-6f6dd3d770f2 tempest-SnapshotDependencyTests-1272075077 None] Acquiring lock "cinder-quobyte-dfa481a5-0383-40c0-bb70-db318abb5c9f" by "delete_volume" {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 01:35:46 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-6aa323a8-5847-4b10-87c7-6f6dd3d770f2 tempest-SnapshotDependencyTests-1272075077 None] Lock "cinder-quobyte-dfa481a5-0383-40c0-bb70-db318abb5c9f" acquired by "delete_volume" :: waited 0.013s {{(pid=86891) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 01:35:46 devstack cinder-volume[86891]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9729bbb-f720-4ed9-97c4-7f37044449a6]: (4, 'qcow2') {{(pid=88230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 01:35:46 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6aa323a8-5847-4b10-87c7-6f6dd3d770f2 tempest-SnapshotDependencyTests-1272075077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-dfa481a5-0383-40c0-bb70-db318abb5c9f {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:35:46 devstack sudo[108631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-dfa481a5-0383-40c0-bb70-db318abb5c9f
Jul 03 01:35:46 devstack sudo[108631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:35:47 devstack sudo[108631]: pam_unix(sudo:session): session closed for user root
Jul 03 01:35:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6aa323a8-5847-4b10-87c7-6f6dd3d770f2 tempest-SnapshotDependencyTests-1272075077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-dfa481a5-0383-40c0-bb70-db318abb5c9f" returned: 0 in 0.732s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:35:47 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6aa323a8-5847-4b10-87c7-6f6dd3d770f2 tempest-SnapshotDependencyTests-1272075077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-dfa481a5-0383-40c0-bb70-db318abb5c9f {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:35:47 devstack sudo[108636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-dfa481a5-0383-40c0-bb70-db318abb5c9f
Jul 03 01:35:47 devstack sudo[108636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:35:48 devstack sudo[108636]: pam_unix(sudo:session): session closed for user root
Jul 03 01:35:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6aa323a8-5847-4b10-87c7-6f6dd3d770f2 tempest-SnapshotDependencyTests-1272075077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc/volume-dfa481a5-0383-40c0-bb70-db318abb5c9f" returned: 0 in 0.615s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:35:48 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-6aa323a8-5847-4b10-87c7-6f6dd3d770f2 tempest-SnapshotDependencyTests-1272075077 None] Lock "cinder-quobyte-dfa481a5-0383-40c0-bb70-db318abb5c9f" released by "delete_volume" :: held 1.382s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:35:48 devstack cinder-volume[86891]: DEBUG cinder.quota [None req-6aa323a8-5847-4b10-87c7-6f6dd3d770f2 tempest-SnapshotDependencyTests-1272075077 None] Created reservations ['b33ded0e-24d6-4bbb-944f-01da8a2d110b', '4c8e3362-eb68-4fad-ae3c-fcc5b88d161d', '9b107f8b-e367-4ed1-b729-6affc7e03fc8', '19803ec9-d4a2-4b80-b6af-b49366b9c4aa'] {{(pid=86891) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 01:35:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-6aa323a8-5847-4b10-87c7-6f6dd3d770f2 tempest-SnapshotDependencyTests-1272075077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:35:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-6aa323a8-5847-4b10-87c7-6f6dd3d770f2 tempest-SnapshotDependencyTests-1272075077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:35:48 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-6aa323a8-5847-4b10-87c7-6f6dd3d770f2 tempest-SnapshotDependencyTests-1272075077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:35:48 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-6aa323a8-5847-4b10-87c7-6f6dd3d770f2 tempest-SnapshotDependencyTests-1272075077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:35:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-6aa323a8-5847-4b10-87c7-6f6dd3d770f2 tempest-SnapshotDependencyTests-1272075077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:35:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6aa323a8-5847-4b10-87c7-6f6dd3d770f2 tempest-SnapshotDependencyTests-1272075077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:35:48 devstack sudo[108639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:35:48 devstack sudo[108639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:35:48 devstack sudo[108639]: pam_unix(sudo:session): session closed for user root
Jul 03 01:35:48 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-6aa323a8-5847-4b10-87c7-6f6dd3d770f2 tempest-SnapshotDependencyTests-1272075077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.610s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:35:48 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-6aa323a8-5847-4b10-87c7-6f6dd3d770f2 tempest-SnapshotDependencyTests-1272075077 None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:35:48 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-6aa323a8-5847-4b10-87c7-6f6dd3d770f2 tempest-SnapshotDependencyTests-1272075077 None] Deleted volume successfully.
Jul 03 01:35:48 devstack cinder-volume[86891]: DEBUG cinder.coordination [None req-6aa323a8-5847-4b10-87c7-6f6dd3d770f2 tempest-SnapshotDependencyTests-1272075077 None] Lock "cinder-dfa481a5-0383-40c0-bb70-db318abb5c9f-delete_volume" released by "delete_volume" :: held 2.196s {{(pid=86891) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 01:35:58 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:SELECT=27,cinder:INSERT=8,cinder:UPDATE=25,cinder:DELETE=1 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:35:58 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:UPDATE=31,cinder:SELECT=20,cinder:DELETE=4,cinder:INSERT=6 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 01:36:01 devstack cinder-volume[86891]: DEBUG oslo_service.periodic_task [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86891) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 01:36:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 01:36:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 01:36:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3': None} {{(pid=86891) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 01:36:01 devstack cinder-volume[86891]: DEBUG cinder.volume.drivers.quobyte [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b64d28c8-253f-438e-b20a-6778a31ff1c3'] {{(pid=86891) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 01:36:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86891) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 01:36:01 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 01:36:01 devstack sudo[108653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc
Jul 03 01:36:01 devstack sudo[108653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 01:36:02 devstack sudo[108653]: pam_unix(sudo:session): session closed for user root
Jul 03 01:36:02 devstack cinder-volume[86891]: DEBUG oslo_concurrency.processutils [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/781c488c6dbb1b2e76fb83104f3ef7dc" returned: 0 in 0.643s {{(pid=86891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 01:36:02 devstack cinder-volume[86891]: DEBUG cinder.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Notifying Schedulers of capabilities ... {{(pid=86891) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 01:36:02 devstack cinder-volume[86891]: DEBUG oslo_service.periodic_task [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] Running periodic task VolumeManager._thread_info {{(pid=86891) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 01:36:02 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] thread count: 28 {{(pid=86891) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 01:36:02 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-57912b8e-a5e4-48a9-88a6-3f83acddb42d None None] thread info: [<_MainThread(MainThread, started 136731296534656)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136731184953280)>, <Thread(Thread-3 (stat_writer), started daemon 136731184058816)>, <Thread(Rabbit-heartbeat, started daemon 136731184846080)>, <Thread(Thread-5 (_runner), started daemon 136731182936576)>, <Thread(Thread-7 (_runner), started daemon 136731182954944)>, <Thread(fd_logger, started daemon 136731181916416)>, <Thread(privsep_reader, started daemon 136731180942208)>, <Thread(tpool_thread_0, started daemon 136731172161216)>, <Thread(tpool_thread_1, started daemon 136731163768512)>, <Thread(tpool_thread_2, started daemon 136731155375808)>, <Thread(tpool_thread_3, started daemon 136731146983104)>, <Thread(tpool_thread_4, started daemon 136731138590400)>, <Thread(tpool_thread_5, started daemon 136731130197696)>, <Thread(tpool_thread_6, started daemon 136731121804992)>, <Thread(tpool_thread_7, started daemon 136731113412288)>, <Thread(tpool_thread_8, started daemon 136731105003200)>, <Thread(tpool_thread_9, started daemon 136731096594112)>, <Thread(tpool_thread_10, started daemon 136731088185024)>, <Thread(tpool_thread_11, started daemon 136731079775936)>, <Thread(tpool_thread_12, started daemon 136731071366848)>, <Thread(tpool_thread_13, started daemon 136731062957760)>, <Thread(tpool_thread_14, started daemon 136731054548672)>, <Thread(tpool_thread_15, started daemon 136731046139584)>, <Thread(tpool_thread_16, started daemon 136731037730496)>, <Thread(tpool_thread_17, started daemon 136731029321408)>, <Thread(tpool_thread_18, started daemon 136731020912320)>, <Thread(tpool_thread_19, started daemon 136731012503232)>] {{(pid=86891) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}